-- Logs begin at Thu 2022-05-19 21:11:36 UTC, end at Thu 2022-05-19 22:26:34 UTC. -- May 19 21:50:57.271006 dv-cinder-842237-1-smb systemd[1]: Starting Devstack devstack@keystone.service... May 19 21:50:57.289776 dv-cinder-842237-1-smb devstack@keystone.service[80197]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 19 21:50:57.291858 dv-cinder-842237-1-smb devstack@keystone.service[80197]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 21:50:57 2022] *** May 19 21:50:57.291858 dv-cinder-842237-1-smb devstack@keystone.service[80197]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 21:50:57.291858 dv-cinder-842237-1-smb devstack@keystone.service[80197]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 21:50:57.291858 dv-cinder-842237-1-smb devstack@keystone.service[80197]: nodename: dv-cinder-842237-1-smb May 19 21:50:57.291858 dv-cinder-842237-1-smb devstack@keystone.service[80197]: machine: x86_64 May 19 21:50:57.291858 dv-cinder-842237-1-smb devstack@keystone.service[80197]: clock source: unix May 19 21:50:57.291858 dv-cinder-842237-1-smb devstack@keystone.service[80197]: pcre jit disabled May 19 21:50:57.291858 dv-cinder-842237-1-smb devstack@keystone.service[80197]: detected number of CPU cores: 4 May 19 21:50:57.291858 dv-cinder-842237-1-smb devstack@keystone.service[80197]: current working directory: / May 19 21:50:57.291858 dv-cinder-842237-1-smb devstack@keystone.service[80197]: detected binary path: /usr/bin/uwsgi-core May 19 21:50:57.292670 dv-cinder-842237-1-smb devstack@keystone.service[80197]: your processes number limit is 47680 May 19 21:50:57.292670 dv-cinder-842237-1-smb devstack@keystone.service[80197]: your memory page size is 4096 bytes May 19 21:50:57.292670 dv-cinder-842237-1-smb devstack@keystone.service[80197]: detected max file descriptor number: 2048 May 19 21:50:57.292670 dv-cinder-842237-1-smb devstack@keystone.service[80197]: lock engine: pthread robust mutexes May 19 21:50:57.292670 dv-cinder-842237-1-smb devstack@keystone.service[80197]: thunder lock: enabled May 19 21:50:57.292670 dv-cinder-842237-1-smb devstack@keystone.service[80197]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 19 21:50:57.292670 dv-cinder-842237-1-smb devstack@keystone.service[80197]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 21:50:57.338528 dv-cinder-842237-1-smb devstack@keystone.service[80197]: Python main interpreter initialized at 0x559bb4bc39c0 May 19 21:50:57.338528 dv-cinder-842237-1-smb devstack@keystone.service[80197]: python threads support enabled May 19 21:50:57.338528 dv-cinder-842237-1-smb devstack@keystone.service[80197]: your server socket listen backlog is limited to 100 connections May 19 21:50:57.338528 dv-cinder-842237-1-smb devstack@keystone.service[80197]: your mercy for graceful operations on workers is 90 seconds May 19 21:50:57.339919 dv-cinder-842237-1-smb devstack@keystone.service[80197]: mapped 403077 bytes (393 KB) for 2 cores May 19 21:50:57.339919 dv-cinder-842237-1-smb devstack@keystone.service[80197]: *** Operational MODE: preforking *** May 19 21:50:57.339919 dv-cinder-842237-1-smb devstack@keystone.service[80197]: *** uWSGI is running in multiple interpreter mode *** May 19 21:50:57.339919 dv-cinder-842237-1-smb devstack@keystone.service[80197]: spawned uWSGI master process (pid: 80197) May 19 21:50:57.343001 dv-cinder-842237-1-smb devstack@keystone.service[80197]: spawned uWSGI worker 1 (pid: 80209, cores: 1) May 19 21:50:57.343001 dv-cinder-842237-1-smb devstack@keystone.service[80197]: spawned uWSGI worker 2 (pid: 80210, cores: 1) May 19 21:50:57.340008 dv-cinder-842237-1-smb systemd[1]: Started Devstack devstack@keystone.service. May 19 21:50:57.344644 dv-cinder-842237-1-smb devstack@keystone.service[80197]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 21:51:03.157402 dv-cinder-842237-1-smb devstack@keystone.service[80209]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 21:51:03.157402 dv-cinder-842237-1-smb devstack@keystone.service[80209]: from cryptography.utils import int_from_bytes May 19 21:51:03.158195 dv-cinder-842237-1-smb devstack@keystone.service[80209]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 21:51:03.158195 dv-cinder-842237-1-smb devstack@keystone.service[80209]: from cryptography.utils import int_from_bytes May 19 21:51:03.190138 dv-cinder-842237-1-smb devstack@keystone.service[80210]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 21:51:03.190138 dv-cinder-842237-1-smb devstack@keystone.service[80210]: from cryptography.utils import int_from_bytes May 19 21:51:03.190741 dv-cinder-842237-1-smb devstack@keystone.service[80210]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 21:51:03.190741 dv-cinder-842237-1-smb devstack@keystone.service[80210]: from cryptography.utils import int_from_bytes May 19 21:51:03.209365 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 21:51:03.209536 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 21:51:03.209726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] command line args: [] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 21:51:03.210006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 21:51:03.210192 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ================================================================================ {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 21:51:03.210461 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] admin_token = **** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.210706 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] config_dir = [] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.210894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.211076 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] config_source = [] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.211256 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] debug = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.211454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.213756 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.213756 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.213756 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.213756 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.213756 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] list_limit = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.213756 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] log_config_append = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.213756 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.213756 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] log_dir = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.213756 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] log_file = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.214878 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.214878 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.214878 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.215199 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.215538 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.215538 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.215945 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.216146 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.216347 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.216574 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.216783 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.216974 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.217200 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.217403 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.217697 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.218200 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.35/identity {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.218485 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] publish_errors = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.218723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.218955 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.219126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.219384 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.219628 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.219947 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] standard_threads = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.220115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.220330 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.220583 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.220718 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] use_journal = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.220878 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] use_json = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.221018 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] use_stderr = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.221182 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] use_syslog = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.221359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.221623 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.221879 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.222122 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.222363 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.222620 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.222855 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.223106 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.223345 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.223597 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.223845 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.224107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.224350 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.224631 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.224868 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.225119 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.225351 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.225591 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.225878 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.226101 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.226348 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.226584 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.226837 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.227239 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.227526 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.227956 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.228375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.228845 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.229267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.229689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.231095 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.231328 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.231660 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.232081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.232556 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.233007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.233433 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.233877 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.234309 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.234720 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.235149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.235562 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.235974 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.236388 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.236839 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.237289 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.237737 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.238116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.238752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.239157 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.239713 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.239963 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.240221 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.240485 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.240733 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.240974 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.241123 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 21:51:03.241258 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 21:51:03.241387 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.241516 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] command line args: [] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 21:51:03.241643 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.241789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 21:51:03.241927 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.242081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ================================================================================ {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 21:51:03.242302 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.242468 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] admin_token = **** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.242599 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.242727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] config_dir = [] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.242954 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.243150 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.243319 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.243452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] config_source = [] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.243452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] debug = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.243703 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.243843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.244011 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.244141 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.244268 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.244397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.244589 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.244719 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.244853 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.244982 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.245115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.245243 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] list_limit = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.245378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.245540 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] log_config_append = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.245540 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.245822 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.245950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] log_dir = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.246079 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.246218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] log_file = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.246353 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.246633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.246776 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.246904 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.247038 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.247176 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.247304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.247438 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.247438 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.247708 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.247846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.247978 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.248106 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.248240 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.248368 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.248533 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.248740 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.248879 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.249008 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.249136 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.249274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.249409 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.249546 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.249675 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.249804 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.249932 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.250060 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.250188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.250329 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.250459 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.250459 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.250707 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.35/identity {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.250837 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.250988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] publish_errors = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.251379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.251514 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.251650 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.251778 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.251918 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.252046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.252174 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.252302 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.252457 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.252593 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.252732 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.252861 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] standard_threads = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.252990 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.253129 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.253257 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.253391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.253527 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.253662 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.253662 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] use_journal = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.253901 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.254029 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] use_json = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.254157 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.254295 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] use_stderr = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.254295 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] use_syslog = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.254536 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.254663 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:51:03.256140 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.256316 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.256579 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.256839 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.257045 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.257267 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.257464 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.257657 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.257898 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] auth.external = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.258065 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.258260 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.258454 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.258647 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.258967 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.259183 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.259352 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.259547 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] auth.password = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.259776 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.259944 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] auth.token = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.260175 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.260378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.260584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.260820 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.260992 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.261224 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.261360 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.261529 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.261686 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.261858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.261996 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.262131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.262260 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.262399 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.262538 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.262711 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] credential.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.262840 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.262969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.263096 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.263225 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.263362 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.263493 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.263636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.263765 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.263922 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.264068 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.264198 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.264327 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.264533 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.264763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.264927 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.265069 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.265199 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.265329 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.265459 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.265605 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.265735 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.265735 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.266036 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.266262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.266506 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.266708 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.266843 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.267083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.267219 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.267348 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.267482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.267617 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.267746 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] federation.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.267894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.268059 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.268200 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.268336 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.268489 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.268620 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.268761 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.268891 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.269019 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.269189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.269332 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.269462 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.269599 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.269752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.269892 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.270023 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.270152 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.270287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.270473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.270473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.270985 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.271246 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.271506 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.271716 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.271886 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.272065 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.272243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.272539 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.272713 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.272883 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.273050 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.273237 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.273405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.273573 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.273741 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.273909 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.274075 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.274252 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.274429 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.274597 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.274776 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.274945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.275120 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.275302 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.275470 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.275680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.275860 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.276031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.276218 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.276506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.277267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.277543 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.277784 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.277974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.278168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.278347 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.278539 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.278727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.278727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.279070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.279247 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.279424 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.279604 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.279789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.279970 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.280151 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.280329 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.280551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.280729 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.280922 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.281100 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.281279 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.281456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.281634 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.281786 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.281927 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.282059 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.282189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.282320 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.282450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.282983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.283535 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.283684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.283825 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.283957 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.284101 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.284232 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.284373 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.284556 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.284698 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.284829 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.284960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.285091 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.285091 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.285362 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.285495 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.285625 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.285755 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.285894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.286399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.286548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.287090 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.287224 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.287355 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.287487 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.287696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.287831 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.287962 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.288105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.288236 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.288373 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.288541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.288683 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.288818 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.288950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.289081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.289211 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.289351 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.289851 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.290425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.290425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.290694 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.290838 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.290838 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.291095 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.291225 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.291355 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.291485 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.291615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.291755 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.291755 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.292003 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.292132 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.292262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.292425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] auth.external = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.292425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.293230 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.293362 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.293495 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.293633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.293633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] auth.password = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.293893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.294024 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] auth.token = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.294154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.294283 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.294419 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.294558 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.294698 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.294830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.294972 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.295102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.295232 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.295374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.295505 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.295636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.295636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.295881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.296011 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] credential.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.296149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.296280 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.296454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.296592 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.296592 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.296864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.297004 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.297136 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.297265 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.297395 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.297525 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.297655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.297793 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.297924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.298062 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.298193 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.298323 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.298453 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.298453 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.298879 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.299014 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.299152 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.299291 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.299425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.299565 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.299696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.299833 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.299963 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.300095 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.300237 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.300377 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.300532 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] federation.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.300674 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.300805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.300935 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.301065 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.301208 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.301340 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.301470 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.301599 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.301729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.301859 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.301998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.302130 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.302274 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.302415 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.302547 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.302677 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.302816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.302947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.303078 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] resource.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.303207 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.303339 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.303482 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.303624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.303756 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.303887 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.304018 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.304149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.304300 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.304462 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.304600 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.304736 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.304866 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.304997 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.305127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.305267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.305399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.305687 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.305832 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.305965 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] role.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.306095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.306235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] role.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.306378 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.306510 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.306640 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.306771 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.306901 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.307041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.307180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.307312 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.307442 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.307573 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.307702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.307841 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.307991 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.308305 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.308509 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.308650 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.308794 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.308928 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.309059 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.309190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.309330 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.309462 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.309602 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.309735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.309865 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.309997 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.310137 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.310269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.310408 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.310408 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.310658 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.310788 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.310925 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.311057 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.311057 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.311314 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.311445 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.311445 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.311692 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.311823 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.311971 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.311971 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.312219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.312350 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.312505 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.312638 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.312781 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.312914 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.313046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.313176 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.313306 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.313443 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.313589 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.313741 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.313878 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.314016 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.314153 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.314290 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.314436 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.314575 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.314712 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.314851 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.314989 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.315126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.315339 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.315480 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.315617 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.315802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.315946 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.316084 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] token.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.316230 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.316370 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.316530 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.316669 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.316806 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.316945 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.317094 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.317233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.317370 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.317507 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.317645 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.317792 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.317940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.317940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.318201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.318201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.318461 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.318461 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.318729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.318867 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.319006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.319153 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.319291 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.319291 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.319570 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.319570 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.319830 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.319967 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.320104 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.320249 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.320388 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.320609 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.320747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.320884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.321021 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.321170 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.321309 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] database.connection = **** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.321455 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.321611 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.321750 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.321888 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.322024 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.322162 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.322438 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.322582 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.322721 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.322860 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.322999 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.323139 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.323289 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.323430 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.323594 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.324068 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.324212 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.324386 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.324568 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.324891 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.325045 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.325184 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.325332 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.325471 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.325619 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.325758 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.325896 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.326034 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.326183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.326322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.326469 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.326608 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.326747 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.326885 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.327024 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.327163 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.327163 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 21:51:03.327439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.327439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.327439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.327439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.327439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.327439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.327439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] resource.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.327439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.327439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.328660 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.328660 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.328660 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.328660 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.328660 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.328660 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.328660 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.328660 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] role.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.328660 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] role.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.329899 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.329899 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.329899 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.329899 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.329899 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.329899 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.329899 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.329899 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.329899 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.331035 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.331035 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.331035 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.331035 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.331035 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.331035 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.331035 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.331035 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.331035 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.332186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.332186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.332186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.332186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.332186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.332186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.332186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.332186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.332186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.333534 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.333534 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.333534 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.333534 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.333534 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.333534 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.333534 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] token.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.333534 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.333534 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.334702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.334702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.334702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.334702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.334702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.334702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.334702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.334702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.334702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.335834 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.335834 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.335834 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.335834 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.335834 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.335834 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.335834 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] database.connection = **** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.335834 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.335834 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.342772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.342772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.342772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.342772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.342772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.342772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.342772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.342772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.342772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.343984 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.343984 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.343984 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.343984 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.343984 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.343984 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.343984 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:51:03.343984 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 21:51:03.345046 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.345046 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.345046 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.347933 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.353036 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.353267 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.353491 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.364495 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.377709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.377923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.383886 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.384167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.433259 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.433502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.487889 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.488131 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.488946 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.489185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.556109 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.556289 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.556389 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.556684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.556753 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.556815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.556876 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.556959 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.557026 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.557374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.557541 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.557684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.581665 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.582002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.582159 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.582304 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.582519 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.582734 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.582945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.587129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.587368 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.587561 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.587780 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.587997 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.588209 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.588431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.595273 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.597157 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.608992 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.609261 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.609414 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.609632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.609851 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.610041 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.610251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80210) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.611275 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.611510 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.611736 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.611960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.612178 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.612392 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.612632 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80209) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 21:51:03.628455 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.628694 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 21:51:03.628991 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.629191 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 21:51:03.629458 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.629716 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.629972 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.630228 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.633198 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.633506 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 21:51:03.633996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.634287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 21:51:03.634682 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.635080 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.635464 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.635835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.644034 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.644333 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.644603 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.644887 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.650425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.650715 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.650981 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.651264 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.653285 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.656561 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.656838 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.657115 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.657520 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.657802 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.658064 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.658334 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.658598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.659019 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.659238 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.659538 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.659775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.662747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.663016 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.663296 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.663690 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.663971 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.664229 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.664518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.664796 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.665074 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.665346 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.665615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.687185 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.691498 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.691498 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.694218 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.694612 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.694859 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.695164 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.697456 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.697956 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.702826 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.703115 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.705606 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.705890 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.706173 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.707724 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.708007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.708290 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.708612 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.708888 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.709162 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.709429 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.709696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.713449 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.713731 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.718394 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.718678 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.718958 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.719238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.719510 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.719779 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.720043 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.720306 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.728376 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.728696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.733789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.737401 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.737697 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.739748 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.740031 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.743092 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.744755 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.746818 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.749150 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.749448 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.751162 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.751468 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.751848 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.752023 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.752303 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.752612 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.754476 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.758107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.762185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.762518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.762838 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.763154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.763483 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.763768 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.771492 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.771871 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.772139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.772434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.780314 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.782027 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.782299 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.782850 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.783226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.783495 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.783764 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.785349 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.785625 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.785909 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.786194 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.786467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.791733 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.794078 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.794348 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.797488 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.797965 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.798143 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.798355 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.798629 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.800549 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.800847 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.801137 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.801462 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.801678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.801955 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.802226 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.812895 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.813178 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.813452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.813727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.814010 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.814275 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.814546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.820738 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.824229 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.827530 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.829153 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.830773 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.831056 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.831337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.832723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.835932 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.838727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.839775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.840971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.841395 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.843051 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.843340 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.843625 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.844293 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.844626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.844910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.845186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.851267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.852927 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.854883 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.855392 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.855849 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.856265 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.856578 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.856864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.857145 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.866691 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.867005 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.867285 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.871758 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80210) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.872031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.872311 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.872617 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.872891 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.873171 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.873453 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.873731 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.873999 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.874270 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.874545 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.874805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.875066 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.875334 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80210) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.876219 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80209) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 21:51:03.876521 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.876801 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.877082 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.877353 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.877641 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.877913 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.878190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.878458 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.878738 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.879005 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.879264 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.879541 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.879800 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80209) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 21:51:03.915007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559bb4bc39c0 pid: 80210 (default app) May 19 21:51:03.918684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc76bc-7f5c-4015-99e6-63df83282b2a None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:03.918989 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc76bc-7f5c-4015-99e6-63df83282b2a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:03.919276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc76bc-7f5c-4015-99e6-63df83282b2a None None] PATH_INFO: `/v3` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:03.925311 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1/1] 10.222.0.35 () {50 vars in 791 bytes} [Thu May 19 21:51:03 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:03.930108 dv-cinder-842237-1-smb devstack@keystone.service[80209]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559bb4bc39c0 pid: 80209 (default app) May 19 21:51:12.053995 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193a0bd-0d02-426a-9bb2-ddf2bdc5e0d2 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:12.054570 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193a0bd-0d02-426a-9bb2-ddf2bdc5e0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:12.054570 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193a0bd-0d02-426a-9bb2-ddf2bdc5e0d2 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:12.055896 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 2/2] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:51:12.063700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bee3e-4d05-4a9d-a5f4-f0d68c314e13 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:12.064122 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bee3e-4d05-4a9d-a5f4-f0d68c314e13 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:12.064307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bee3e-4d05-4a9d-a5f4-f0d68c314e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:12.134921 dv-cinder-842237-1-smb devstack@keystone.service[80209]: INFO dbcounter [None req-023bee3e-4d05-4a9d-a5f4-f0d68c314e13 None None] Registered counter for database keystone May 19 21:51:12.157238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG oslo_db.sqlalchemy.engines [None req-023bee3e-4d05-4a9d-a5f4-f0d68c314e13 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 21:51:12.163639 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writer thread running {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 21:51:12.356998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG passlib.handlers.bcrypt [None req-023bee3e-4d05-4a9d-a5f4-f0d68c314e13 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80209) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 21:51:12.357345 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG passlib.handlers.bcrypt [None req-023bee3e-4d05-4a9d-a5f4-f0d68c314e13 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80209) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 21:51:12.414790 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-023bee3e-4d05-4a9d-a5f4-f0d68c314e13 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:12.416386 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-023bee3e-4d05-4a9d-a5f4-f0d68c314e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:12.546124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1/3] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 486 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 19 21:51:12.731047 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193a0bd-0d02-426a-9bb2-ddf2bdc5e0d2 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:12.801579 dv-cinder-842237-1-smb devstack@keystone.service[80210]: INFO dbcounter [None req-4193a0bd-0d02-426a-9bb2-ddf2bdc5e0d2 None None] Registered counter for database keystone May 19 21:51:12.822616 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG oslo_db.sqlalchemy.engines [None req-4193a0bd-0d02-426a-9bb2-ddf2bdc5e0d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 21:51:12.829080 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writer thread running {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 21:51:12.952492 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193a0bd-0d02-426a-9bb2-ddf2bdc5e0d2 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:12.956997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120d38c-c303-40b7-a611-04cfaad9b8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:12.957670 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120d38c-c303-40b7-a611-04cfaad9b8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:12.957961 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120d38c-c303-40b7-a611-04cfaad9b8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:12.958248 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120d38c-c303-40b7-a611-04cfaad9b8f4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:12.968069 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120d38c-c303-40b7-a611-04cfaad9b8f4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:13.019221 dv-cinder-842237-1-smb devstack@keystone.service[80210]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f120d38c-c303-40b7-a611-04cfaad9b8f4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 21:51:13.019477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120d38c-c303-40b7-a611-04cfaad9b8f4 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:13.030564 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 3/4] 10.222.0.35 () {58 vars in 1324 bytes} [Thu May 19 21:51:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 19 21:51:13.036767 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bee3e-4d05-4a9d-a5f4-f0d68c314e13 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:13.052518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bee3e-4d05-4a9d-a5f4-f0d68c314e13 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:13.056998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b4a41-4ae9-4051-9a3c-7d2ec7e9e2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:13.058446 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b4a41-4ae9-4051-9a3c-7d2ec7e9e2bc admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:13.058739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b4a41-4ae9-4051-9a3c-7d2ec7e9e2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:13.059022 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b4a41-4ae9-4051-9a3c-7d2ec7e9e2bc admin admin] PATH_INFO: `/v3/projects/64ecee0211ba477d8f867eb1b5f77c2e` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:13.060709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b4a41-4ae9-4051-9a3c-7d2ec7e9e2bc admin admin] RBAC: Authorizing `identity:get_project(project_id=64ecee0211ba477d8f867eb1b5f77c2e)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:13.222008 dv-cinder-842237-1-smb devstack@keystone.service[80209]: WARNING keystone.common.rbac_enforcer.enforcer [None req-db2b4a41-4ae9-4051-9a3c-7d2ec7e9e2bc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 21:51:13.222678 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b4a41-4ae9-4051-9a3c-7d2ec7e9e2bc admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:13.227248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 2/5] 10.222.0.35 () {56 vars in 1207 bytes} [Thu May 19 21:51:13 2022] GET /identity/v3/projects/64ecee0211ba477d8f867eb1b5f77c2e => generated 344 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:51:15.493951 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c33cf-4861-4b2a-a986-72115d7c9a42 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:15.494491 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c33cf-4861-4b2a-a986-72115d7c9a42 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:15.494491 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c33cf-4861-4b2a-a986-72115d7c9a42 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:15.498734 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 4/6] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:15.504301 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3a563-0b7b-46e3-bd37-2ec2372c4c68 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:15.504762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3a563-0b7b-46e3-bd37-2ec2372c4c68 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:15.504894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3a563-0b7b-46e3-bd37-2ec2372c4c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:15.525180 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8ba3a563-0b7b-46e3-bd37-2ec2372c4c68 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:15.527358 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8ba3a563-0b7b-46e3-bd37-2ec2372c4c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:15.535273 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 3/7] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 19 21:51:15.557746 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c33cf-4861-4b2a-a986-72115d7c9a42 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:15.570539 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c33cf-4861-4b2a-a986-72115d7c9a42 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:15.575591 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3bc11-62bc-417e-b99d-f1f656723dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:15.576241 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3bc11-62bc-417e-b99d-f1f656723dcf admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:15.576562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3bc11-62bc-417e-b99d-f1f656723dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:15.576841 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3bc11-62bc-417e-b99d-f1f656723dcf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:15.585242 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3bc11-62bc-417e-b99d-f1f656723dcf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:15.587027 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3bc11-62bc-417e-b99d-f1f656723dcf admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:15.596365 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 5/8] 10.222.0.35 () {58 vars in 1324 bytes} [Thu May 19 21:51:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 21:51:15.602149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3a563-0b7b-46e3-bd37-2ec2372c4c68 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:15.611718 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3a563-0b7b-46e3-bd37-2ec2372c4c68 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:15.624828 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e676ac3-2d9d-4b25-ba83-1b585aca8305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:15.625647 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e676ac3-2d9d-4b25-ba83-1b585aca8305 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:15.625935 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e676ac3-2d9d-4b25-ba83-1b585aca8305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:15.626212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e676ac3-2d9d-4b25-ba83-1b585aca8305 admin admin] PATH_INFO: `/v3/users/8b8aa11a54f3466da61ca05643c14d59` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:15.627711 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e676ac3-2d9d-4b25-ba83-1b585aca8305 admin admin] RBAC: Authorizing `identity:get_user(user_id=8b8aa11a54f3466da61ca05643c14d59)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:15.629604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e676ac3-2d9d-4b25-ba83-1b585aca8305 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:15.631218 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 4/9] 10.222.0.35 () {56 vars in 1198 bytes} [Thu May 19 21:51:15 2022] GET /identity/v3/users/8b8aa11a54f3466da61ca05643c14d59 => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:17.988827 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cc4ef-d609-49d4-af5a-14858c5ddda9 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:17.989345 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cc4ef-d609-49d4-af5a-14858c5ddda9 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:17.989455 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cc4ef-d609-49d4-af5a-14858c5ddda9 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:17.990840 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 6/10] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:17.996852 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e9f0d-934d-48ed-bd8f-0586a40e4c6c None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:17.997241 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e9f0d-934d-48ed-bd8f-0586a40e4c6c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:17.997415 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e9f0d-934d-48ed-bd8f-0586a40e4c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:18.014516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-957e9f0d-934d-48ed-bd8f-0586a40e4c6c None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:18.015769 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-957e9f0d-934d-48ed-bd8f-0586a40e4c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:18.023131 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782314e-1dec-4747-aad9-8a30e643b889 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:18.023420 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782314e-1dec-4747-aad9-8a30e643b889 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:18.023706 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782314e-1dec-4747-aad9-8a30e643b889 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:18.025112 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 7/11] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:18.030532 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0a331-924a-4f2a-97ae-1027e3ce268f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:18.030823 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0a331-924a-4f2a-97ae-1027e3ce268f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:18.031116 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0a331-924a-4f2a-97ae-1027e3ce268f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:18.076980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG passlib.handlers.bcrypt [None req-1fc0a331-924a-4f2a-97ae-1027e3ce268f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80210) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 21:51:18.077408 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG passlib.handlers.bcrypt [None req-1fc0a331-924a-4f2a-97ae-1027e3ce268f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80210) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 21:51:18.099277 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 5/12] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:18.124388 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e9f0d-934d-48ed-bd8f-0586a40e4c6c None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:18.125613 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1fc0a331-924a-4f2a-97ae-1027e3ce268f None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:18.127303 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1fc0a331-924a-4f2a-97ae-1027e3ce268f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:18.148619 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:18.233348 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e9f0d-934d-48ed-bd8f-0586a40e4c6c None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:18.240494 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 8/13] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:51:18.263754 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0a331-924a-4f2a-97ae-1027e3ce268f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:18.269145 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42348b2b-402e-49d0-9340-2342e264b9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:18.269951 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42348b2b-402e-49d0-9340-2342e264b9ed None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:18.270238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42348b2b-402e-49d0-9340-2342e264b9ed None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:18.270546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42348b2b-402e-49d0-9340-2342e264b9ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:18.285567 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42348b2b-402e-49d0-9340-2342e264b9ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:51:18.297503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-42348b2b-402e-49d0-9340-2342e264b9ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:51:18.297503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:51:18.297503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:51:18.297503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:51:18.297503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:51:18.297503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:51:18.297503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:51:18.297503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:51:18.297503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:51:18.297503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:51:18.297503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:51:18.297503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:51:18.297503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:51:18.297503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:51:18.297503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:51:18.297503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:51:18.298570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:51:18.298570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:51:18.298570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:51:18.298570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:51:18.298570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:51:18.298570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:51:18.298570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:51:18.298570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:51:18.298570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:51:18.298570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:51:18.298570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:51:18.298570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:51:18.298570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:51:18.298570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:51:18.298570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:51:18.298570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:51:18.299344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:51:18.299344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:51:18.299344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:51:18.299344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:51:18.299344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:51:18.299344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:51:18.299344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:51:18.299344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:51:18.299344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:51:18.299344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:51:18.299344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:51:18.299344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:51:18.299344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 6/14] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:51:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:51:18.304594 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42348b2b-402e-49d0-9340-2342e264b9ed None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:18.390976 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0a331-924a-4f2a-97ae-1027e3ce268f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:18.393433 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:18.395043 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:18.415657 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42348b2b-402e-49d0-9340-2342e264b9ed None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:18.432297 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e1e44-edc7-419e-b0ea-3cf4e43619e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:18.433450 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e1e44-edc7-419e-b0ea-3cf4e43619e2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:18.433770 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e1e44-edc7-419e-b0ea-3cf4e43619e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:18.434042 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e1e44-edc7-419e-b0ea-3cf4e43619e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:18.458018 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed526a-64fc-4233-bb49-f9e7f0b6d313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:18.458697 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed526a-64fc-4233-bb49-f9e7f0b6d313 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:18.459056 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed526a-64fc-4233-bb49-f9e7f0b6d313 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:18.459264 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed526a-64fc-4233-bb49-f9e7f0b6d313 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:18.460024 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed526a-64fc-4233-bb49-f9e7f0b6d313 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:18.460334 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed526a-64fc-4233-bb49-f9e7f0b6d313 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:18.461825 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed526a-64fc-4233-bb49-f9e7f0b6d313 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:18.474572 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 7/15] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:51:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:51:18.481322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed526a-64fc-4233-bb49-f9e7f0b6d313 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:18.514080 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e1e44-edc7-419e-b0ea-3cf4e43619e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:18.515538 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e1e44-edc7-419e-b0ea-3cf4e43619e2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:18.593612 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed526a-64fc-4233-bb49-f9e7f0b6d313 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:18.625819 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 9/16] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:51:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 21:51:18.627812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab745dee-c547-4243-8e3a-5472108fe4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:18.628786 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab745dee-c547-4243-8e3a-5472108fe4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:18.629132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab745dee-c547-4243-8e3a-5472108fe4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:18.629474 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab745dee-c547-4243-8e3a-5472108fe4c6 None admin] PATH_INFO: `/v3/users/8b8aa11a54f3466da61ca05643c14d59` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:18.630763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab745dee-c547-4243-8e3a-5472108fe4c6 None admin] RBAC: Authorizing `identity:get_user(user_id=8b8aa11a54f3466da61ca05643c14d59)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:18.631487 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e1e44-edc7-419e-b0ea-3cf4e43619e2 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:18.632236 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab745dee-c547-4243-8e3a-5472108fe4c6 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:18.634051 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 8/17] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:51:18 2022] GET /identity/v3/users/8b8aa11a54f3466da61ca05643c14d59 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:51:18.634430 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:18.642169 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab745dee-c547-4243-8e3a-5472108fe4c6 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:18.657677 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:18.745743 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e1e44-edc7-419e-b0ea-3cf4e43619e2 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:18.748066 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab745dee-c547-4243-8e3a-5472108fe4c6 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:18.781481 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb23a4-bcc5-4576-b14d-400612b00b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:18.782206 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb23a4-bcc5-4576-b14d-400612b00b5d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:18.782497 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb23a4-bcc5-4576-b14d-400612b00b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:18.782771 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb23a4-bcc5-4576-b14d-400612b00b5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:18.783625 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c7464-30d0-4562-bf5b-c5339c0c5cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:18.784450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c7464-30d0-4562-bf5b-c5339c0c5cdc None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:18.784824 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c7464-30d0-4562-bf5b-c5339c0c5cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:18.785017 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c7464-30d0-4562-bf5b-c5339c0c5cdc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:18.786217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c7464-30d0-4562-bf5b-c5339c0c5cdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:18.787690 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c7464-30d0-4562-bf5b-c5339c0c5cdc None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:18.789348 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 9/18] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:51:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:18.795663 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c7464-30d0-4562-bf5b-c5339c0c5cdc None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:18.803646 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb23a4-bcc5-4576-b14d-400612b00b5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:18.805189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb23a4-bcc5-4576-b14d-400612b00b5d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:18.826830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-35fb23a4-bcc5-4576-b14d-400612b00b5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:51:18.826830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:51:18.826830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:51:18.826830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:51:18.826830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:51:18.826830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:51:18.826830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:51:18.826830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:51:18.826830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:51:18.826830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:51:18.826830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:51:18.826830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:51:18.826830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:51:18.826830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:51:18.826830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:51:18.827673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:51:18.827673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:51:18.827673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:51:18.827673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:51:18.827673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:51:18.827673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:51:18.827673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:51:18.827673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:51:18.827673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:51:18.827673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:51:18.827673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:51:18.827673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:51:18.827673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:51:18.827673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:51:18.827673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:51:18.827673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:51:18.827673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:51:18.828467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:51:18.828467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:51:18.828467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:51:18.828467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:51:18.828467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 10/19] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:51:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:51:18.833864 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb23a4-bcc5-4576-b14d-400612b00b5d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:18.879497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:18.893915 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:18.908170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c7464-30d0-4562-bf5b-c5339c0c5cdc None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:18.942423 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb23a4-bcc5-4576-b14d-400612b00b5d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:18.949635 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9f149-8514-414a-92cb-12bccc80fd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:18.950315 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9f149-8514-414a-92cb-12bccc80fd07 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:18.950597 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9f149-8514-414a-92cb-12bccc80fd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:18.950868 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9f149-8514-414a-92cb-12bccc80fd07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:18.951731 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9f149-8514-414a-92cb-12bccc80fd07 None admin] RBAC: Adding query filter params (role.id=04369f3c13174671a298fcd8175998d8, scope.domain.id=default, user.id=8b8aa11a54f3466da61ca05643c14d59) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:18.952046 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9f149-8514-414a-92cb-12bccc80fd07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:18.953634 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9f149-8514-414a-92cb-12bccc80fd07 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:18.961463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 10/20] 10.222.0.35 () {56 vars in 1322 bytes} [Thu May 19 21:51:18 2022] GET /identity/v3/role_assignments?user.id=8b8aa11a54f3466da61ca05643c14d59&scope.domain.id=default&role.id=04369f3c13174671a298fcd8175998d8 => generated 233 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:51:18.985866 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cace4de-c4a9-4e3b-a8ff-1144ff9c8684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:18.986561 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cace4de-c4a9-4e3b-a8ff-1144ff9c8684 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:18.986848 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cace4de-c4a9-4e3b-a8ff-1144ff9c8684 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:18.987125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cace4de-c4a9-4e3b-a8ff-1144ff9c8684 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:18.987959 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cace4de-c4a9-4e3b-a8ff-1144ff9c8684 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:18.988197 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cace4de-c4a9-4e3b-a8ff-1144ff9c8684 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:18.989956 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cace4de-c4a9-4e3b-a8ff-1144ff9c8684 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:19.012672 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 11/21] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:51:21.447864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1dbebe-8d74-42d9-9e64-794344761f7a None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:21.448989 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1dbebe-8d74-42d9-9e64-794344761f7a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:21.449294 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1dbebe-8d74-42d9-9e64-794344761f7a None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:21.450997 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 11/22] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:21.456876 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c5581-21a2-4e74-82d5-e44fd93e8b31 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:21.457410 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c5581-21a2-4e74-82d5-e44fd93e8b31 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:21.457410 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c5581-21a2-4e74-82d5-e44fd93e8b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:21.481927 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-053c5581-21a2-4e74-82d5-e44fd93e8b31 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:21.483141 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-053c5581-21a2-4e74-82d5-e44fd93e8b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:21.707788 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 12/23] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:21.746210 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1dbebe-8d74-42d9-9e64-794344761f7a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:21.886763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1dbebe-8d74-42d9-9e64-794344761f7a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:21.934879 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981163c0-53d8-4bab-a9b0-3c4bc5171331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:21.935679 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981163c0-53d8-4bab-a9b0-3c4bc5171331 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:21.935962 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981163c0-53d8-4bab-a9b0-3c4bc5171331 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:21.936240 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981163c0-53d8-4bab-a9b0-3c4bc5171331 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:21.953453 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981163c0-53d8-4bab-a9b0-3c4bc5171331 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:51:21.962586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-981163c0-53d8-4bab-a9b0-3c4bc5171331 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:51:21.962586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:51:21.962586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:51:21.962586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:51:21.962586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:51:21.962586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:51:21.962586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:51:21.962586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:51:21.962586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:51:21.962586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:51:21.962586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:51:21.962586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:51:21.962586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:51:21.962586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:51:21.962586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:51:21.962586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:51:21.963422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:51:21.963422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:51:21.963422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:51:21.963422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:51:21.963422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:51:21.963422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:51:21.963422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:51:21.963422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:51:21.963422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:51:21.963422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:51:21.963422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:51:21.963422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:51:21.963422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:51:21.963422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:51:21.963422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:51:21.963422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:51:21.964696 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:51:21.964696 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:51:21.964696 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:51:21.964696 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:51:21.964696 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:51:21.964696 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:51:21.964696 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:51:21.964696 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:51:21.964696 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:51:21.964696 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:51:21.964696 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:51:21.964696 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:51:21.964696 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 12/24] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:51:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:51:21.972793 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c5581-21a2-4e74-82d5-e44fd93e8b31 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:22.032334 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e141b-2532-4a29-bb32-807960f62745 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:22.032689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e141b-2532-4a29-bb32-807960f62745 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:22.032962 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e141b-2532-4a29-bb32-807960f62745 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:22.034558 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 13/25] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:51:22.041138 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d1a90-78c9-4876-a5e7-9db2b7794d7a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:22.041426 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d1a90-78c9-4876-a5e7-9db2b7794d7a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:22.041708 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d1a90-78c9-4876-a5e7-9db2b7794d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:22.049199 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:22.063235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-785d1a90-78c9-4876-a5e7-9db2b7794d7a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:22.064809 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-785d1a90-78c9-4876-a5e7-9db2b7794d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:22.091810 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:22.175219 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 14/26] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:51:22.218797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c5581-21a2-4e74-82d5-e44fd93e8b31 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:22.219622 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d1a90-78c9-4876-a5e7-9db2b7794d7a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:22.277361 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fa842-f005-433f-af2e-beae0b2aa452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:22.278057 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fa842-f005-433f-af2e-beae0b2aa452 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:22.278338 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fa842-f005-433f-af2e-beae0b2aa452 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:22.278615 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fa842-f005-433f-af2e-beae0b2aa452 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:22.279391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180fa842-f005-433f-af2e-beae0b2aa452 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:22.279699 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180fa842-f005-433f-af2e-beae0b2aa452 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:22.281175 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180fa842-f005-433f-af2e-beae0b2aa452 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:22.312896 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 13/27] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:51:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:22.314283 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc940959-bbd1-47b0-8275-ebda3f394158 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:22.314568 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc940959-bbd1-47b0-8275-ebda3f394158 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:22.314841 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc940959-bbd1-47b0-8275-ebda3f394158 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:22.316309 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 14/28] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:22.324123 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f9593-0350-4367-8246-3d28d131b4c1 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:22.324451 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f9593-0350-4367-8246-3d28d131b4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:22.324733 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f9593-0350-4367-8246-3d28d131b4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:22.361476 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6d0f9593-0350-4367-8246-3d28d131b4c1 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:22.362711 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6d0f9593-0350-4367-8246-3d28d131b4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:22.402989 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d1a90-78c9-4876-a5e7-9db2b7794d7a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:22.443845 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587cd9c-0f03-497c-9f33-c79f0632f70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:22.445210 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587cd9c-0f03-497c-9f33-c79f0632f70e None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:22.446405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587cd9c-0f03-497c-9f33-c79f0632f70e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:22.447298 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587cd9c-0f03-497c-9f33-c79f0632f70e None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:22.448977 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587cd9c-0f03-497c-9f33-c79f0632f70e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:22.451037 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587cd9c-0f03-497c-9f33-c79f0632f70e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:22.453935 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:22.529651 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 15/29] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:22.530419 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f9593-0350-4367-8246-3d28d131b4c1 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:22.593159 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:22.605354 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 15/30] 10.222.0.35 () {60 vars in 1131 bytes} [Thu May 19 21:51:22 2022] POST /identity/v3/roles => generated 219 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:51:22.607360 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcf482-7876-4a99-a251-466c1f9ed39f None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:22.607871 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcf482-7876-4a99-a251-466c1f9ed39f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:22.608361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcf482-7876-4a99-a251-466c1f9ed39f None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:22.610078 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 16/31] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:22.611042 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcf482-7876-4a99-a251-466c1f9ed39f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:22.747581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcf482-7876-4a99-a251-466c1f9ed39f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:22.792706 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f9593-0350-4367-8246-3d28d131b4c1 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:22.794144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eef3c6-565b-48b5-8199-44b3d509b17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:22.795249 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eef3c6-565b-48b5-8199-44b3d509b17d None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:22.795729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eef3c6-565b-48b5-8199-44b3d509b17d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:22.796200 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eef3c6-565b-48b5-8199-44b3d509b17d None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:22.797247 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eef3c6-565b-48b5-8199-44b3d509b17d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:22.799017 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eef3c6-565b-48b5-8199-44b3d509b17d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:22.826254 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 17/32] 10.222.0.35 () {60 vars in 1131 bytes} [Thu May 19 21:51:22 2022] POST /identity/v3/roles => generated 225 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:51:22.829626 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c924ead-de42-45e8-88df-002a9bfda7b4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:22.832353 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c924ead-de42-45e8-88df-002a9bfda7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:22.832924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c924ead-de42-45e8-88df-002a9bfda7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:22.862248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4c924ead-de42-45e8-88df-002a9bfda7b4 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:22.866360 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4c924ead-de42-45e8-88df-002a9bfda7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:22.893082 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d43cb2-957c-45bd-bccd-52edb8ef0652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:22.894519 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d43cb2-957c-45bd-bccd-52edb8ef0652 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:22.896933 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d43cb2-957c-45bd-bccd-52edb8ef0652 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:22.897508 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d43cb2-957c-45bd-bccd-52edb8ef0652 None admin] PATH_INFO: `/v3/users/8b8aa11a54f3466da61ca05643c14d59` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:22.902330 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d43cb2-957c-45bd-bccd-52edb8ef0652 None admin] RBAC: Authorizing `identity:get_user(user_id=8b8aa11a54f3466da61ca05643c14d59)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:22.905931 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d43cb2-957c-45bd-bccd-52edb8ef0652 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:22.911957 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 16/33] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:51:22 2022] GET /identity/v3/users/8b8aa11a54f3466da61ca05643c14d59 => generated 247 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:22.918725 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d43cb2-957c-45bd-bccd-52edb8ef0652 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:22.996027 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:23.054352 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 18/34] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:23.081860 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d43cb2-957c-45bd-bccd-52edb8ef0652 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:23.090955 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:23.092355 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c924ead-de42-45e8-88df-002a9bfda7b4 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:23.147027 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5224b30-d237-48cf-911e-6e7982520a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:23.147223 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5224b30-d237-48cf-911e-6e7982520a04 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:23.147395 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5224b30-d237-48cf-911e-6e7982520a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:23.147862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5224b30-d237-48cf-911e-6e7982520a04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:23.149266 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5224b30-d237-48cf-911e-6e7982520a04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:23.150921 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5224b30-d237-48cf-911e-6e7982520a04 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:23.156453 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 17/35] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:51:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:23.161790 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5224b30-d237-48cf-911e-6e7982520a04 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:23.255118 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c924ead-de42-45e8-88df-002a9bfda7b4 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:23.305495 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5224b30-d237-48cf-911e-6e7982520a04 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:23.305687 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fccca8-5fb6-44fe-9ff7-3e45d74712e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:23.306429 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fccca8-5fb6-44fe-9ff7-3e45d74712e0 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:23.306884 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fccca8-5fb6-44fe-9ff7-3e45d74712e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:23.307323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fccca8-5fb6-44fe-9ff7-3e45d74712e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:23.321049 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fccca8-5fb6-44fe-9ff7-3e45d74712e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:23.322918 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fccca8-5fb6-44fe-9ff7-3e45d74712e0 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:23.356893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-00fccca8-5fb6-44fe-9ff7-3e45d74712e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:51:23.356893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:51:23.356893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:51:23.356893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:51:23.356893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:51:23.356893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:51:23.356893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:51:23.356893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:51:23.356893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:51:23.356893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:51:23.356893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:51:23.356893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:51:23.356893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:51:23.356893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:51:23.356893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:51:23.357766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:51:23.357766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:51:23.357766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:51:23.357766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:51:23.357766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:51:23.357766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:51:23.357766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:51:23.357766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:51:23.357766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:51:23.357766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:51:23.357766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:51:23.357766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:51:23.357766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:51:23.357766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:51:23.357766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:51:23.357766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:51:23.357766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:51:23.358546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:51:23.358546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:51:23.358546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:51:23.358546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:51:23.358746 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603e509-a6b1-4acf-bde2-f93fa8185d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:23.358746 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603e509-a6b1-4acf-bde2-f93fa8185d42 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:23.359405 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603e509-a6b1-4acf-bde2-f93fa8185d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:23.359775 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603e509-a6b1-4acf-bde2-f93fa8185d42 None admin] PATH_INFO: `/v3/domains/default/users/8b8aa11a54f3466da61ca05643c14d59/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:23.361058 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 19/36] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:51:23.364510 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603e509-a6b1-4acf-bde2-f93fa8185d42 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8b8aa11a54f3466da61ca05643c14d59, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:23.364510 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603e509-a6b1-4acf-bde2-f93fa8185d42 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:23.375516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fccca8-5fb6-44fe-9ff7-3e45d74712e0 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:23.432801 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:23.510352 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fccca8-5fb6-44fe-9ff7-3e45d74712e0 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:23.515488 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 18/37] 10.222.0.35 () {58 vars in 1361 bytes} [Thu May 19 21:51:23 2022] PUT /identity/v3/domains/default/users/8b8aa11a54f3466da61ca05643c14d59/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:51:23.522162 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb18816-8226-4426-bf8c-7fcc01651535 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:23.522728 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb18816-8226-4426-bf8c-7fcc01651535 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:23.523215 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb18816-8226-4426-bf8c-7fcc01651535 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:23.528626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 19/38] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:51:23.534437 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377ae8e-65d5-4645-8cf3-24aa1758a1d2 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:23.535034 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377ae8e-65d5-4645-8cf3-24aa1758a1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:23.535034 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377ae8e-65d5-4645-8cf3-24aa1758a1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:23.554308 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8377ae8e-65d5-4645-8cf3-24aa1758a1d2 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:23.555992 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8377ae8e-65d5-4645-8cf3-24aa1758a1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:23.561267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94bc67-589c-4416-9c7f-4cad3bda95e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:23.562302 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94bc67-589c-4416-9c7f-4cad3bda95e7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:23.562816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94bc67-589c-4416-9c7f-4cad3bda95e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:23.563313 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94bc67-589c-4416-9c7f-4cad3bda95e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:23.564286 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94bc67-589c-4416-9c7f-4cad3bda95e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:23.564860 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94bc67-589c-4416-9c7f-4cad3bda95e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:23.566554 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94bc67-589c-4416-9c7f-4cad3bda95e7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:23.592717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:23.593882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 20/39] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:23.595252 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94bc67-589c-4416-9c7f-4cad3bda95e7 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:23.638302 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 20/40] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:51:23.639721 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7e6e0-8c33-48fa-b0e3-e1a2ad4c24cb None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:23.640021 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7e6e0-8c33-48fa-b0e3-e1a2ad4c24cb None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:23.640309 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7e6e0-8c33-48fa-b0e3-e1a2ad4c24cb None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:23.641918 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 21/41] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:23.647710 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cc7f6-2c35-4750-9ef6-283ec61ff6f6 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:23.648013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cc7f6-2c35-4750-9ef6-283ec61ff6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:23.648292 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cc7f6-2c35-4750-9ef6-283ec61ff6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:23.667538 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1a9cc7f6-2c35-4750-9ef6-283ec61ff6f6 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:23.668834 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1a9cc7f6-2c35-4750-9ef6-283ec61ff6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:23.727227 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:23.738666 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94bc67-589c-4416-9c7f-4cad3bda95e7 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:23.768125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 22/42] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:51:23.771105 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cc7f6-2c35-4750-9ef6-283ec61ff6f6 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:23.784061 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e29aa-9cab-4045-8f4a-bbf2925c288a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:23.784779 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e29aa-9cab-4045-8f4a-bbf2925c288a None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:23.785144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e29aa-9cab-4045-8f4a-bbf2925c288a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:23.785579 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e29aa-9cab-4045-8f4a-bbf2925c288a None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:23.786162 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e29aa-9cab-4045-8f4a-bbf2925c288a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:23.787628 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e29aa-9cab-4045-8f4a-bbf2925c288a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:23.823118 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 21/43] 10.222.0.35 () {60 vars in 1141 bytes} [Thu May 19 21:51:23 2022] POST /identity/v3/projects => generated 301 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:51:23.824655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e29aa-9cab-4045-8f4a-bbf2925c288a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:23.907039 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:23.917888 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cc7f6-2c35-4750-9ef6-283ec61ff6f6 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:23.954040 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e29aa-9cab-4045-8f4a-bbf2925c288a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:23.983210 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb75feb-3ec2-4ba2-b685-167a6e5c09bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:23.985241 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb75feb-3ec2-4ba2-b685-167a6e5c09bf None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:23.985989 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb75feb-3ec2-4ba2-b685-167a6e5c09bf None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:23.986454 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb75feb-3ec2-4ba2-b685-167a6e5c09bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:23.988971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb75feb-3ec2-4ba2-b685-167a6e5c09bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:23.991937 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb75feb-3ec2-4ba2-b685-167a6e5c09bf None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:23.996887 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 23/44] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:51:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:24.002262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ef56b-0e43-4b43-b257-47ba2d1f5a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:24.002971 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ef56b-0e43-4b43-b257-47ba2d1f5a8a None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:24.003313 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ef56b-0e43-4b43-b257-47ba2d1f5a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:24.003593 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ef56b-0e43-4b43-b257-47ba2d1f5a8a None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:24.004079 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb75feb-3ec2-4ba2-b685-167a6e5c09bf None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:24.004431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ef56b-0e43-4b43-b257-47ba2d1f5a8a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:24.005902 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ef56b-0e43-4b43-b257-47ba2d1f5a8a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:24.027569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 22/45] 10.222.0.35 () {60 vars in 1131 bytes} [Thu May 19 21:51:23 2022] POST /identity/v3/roles => generated 223 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:51:24.147852 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb75feb-3ec2-4ba2-b685-167a6e5c09bf None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:24.191299 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3c990-d47d-4cc1-8fa9-0c41a72ce1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:24.191995 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3c990-d47d-4cc1-8fa9-0c41a72ce1d2 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:24.192284 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3c990-d47d-4cc1-8fa9-0c41a72ce1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:24.192603 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3c990-d47d-4cc1-8fa9-0c41a72ce1d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:24.193341 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3c990-d47d-4cc1-8fa9-0c41a72ce1d2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:24.194836 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3c990-d47d-4cc1-8fa9-0c41a72ce1d2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:24.226088 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 24/46] 10.222.0.35 () {60 vars in 1141 bytes} [Thu May 19 21:51:24 2022] POST /identity/v3/projects => generated 312 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:51:25.828798 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45da208-0974-4afc-aeb7-35760bbd0b23 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:25.829318 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45da208-0974-4afc-aeb7-35760bbd0b23 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:25.829431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45da208-0974-4afc-aeb7-35760bbd0b23 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:25.830903 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 23/47] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:25.836834 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545996e5-b0a0-4bf1-a701-994cf68b5574 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:25.837334 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545996e5-b0a0-4bf1-a701-994cf68b5574 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:25.837524 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545996e5-b0a0-4bf1-a701-994cf68b5574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:25.855207 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-545996e5-b0a0-4bf1-a701-994cf68b5574 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:25.856517 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-545996e5-b0a0-4bf1-a701-994cf68b5574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:25.866084 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:25.927323 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 25/48] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:25.951577 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45da208-0974-4afc-aeb7-35760bbd0b23 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:25.964253 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:26.062055 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45da208-0974-4afc-aeb7-35760bbd0b23 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:26.095615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f02fd9-cd1c-47ee-b40a-5eb6f0183fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:26.096351 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f02fd9-cd1c-47ee-b40a-5eb6f0183fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:26.096673 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f02fd9-cd1c-47ee-b40a-5eb6f0183fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:26.096958 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f02fd9-cd1c-47ee-b40a-5eb6f0183fa9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:26.108589 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f02fd9-cd1c-47ee-b40a-5eb6f0183fa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:51:26.116569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-56f02fd9-cd1c-47ee-b40a-5eb6f0183fa9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:51:26.116569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:51:26.116569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:51:26.116569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:51:26.116569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:51:26.116569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:51:26.116569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:51:26.116569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:51:26.116569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:51:26.116569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:51:26.116569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:51:26.116569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:51:26.116569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:51:26.116569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:51:26.116569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:51:26.116569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:51:26.117438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:51:26.117438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:51:26.117438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:51:26.117438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:51:26.117438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:51:26.117438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:51:26.117438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:51:26.117438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:51:26.117438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:51:26.117438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:51:26.117438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:51:26.117438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:51:26.117438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:51:26.117438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:51:26.117438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:51:26.117438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:51:26.118152 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:51:26.118152 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:51:26.118152 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:51:26.118152 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:51:26.118152 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:51:26.118152 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:51:26.118152 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:51:26.118152 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:51:26.118152 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:51:26.118152 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:51:26.118152 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:51:26.118152 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:51:26.118152 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 24/49] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:51:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:51:26.124133 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545996e5-b0a0-4bf1-a701-994cf68b5574 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:26.225019 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545996e5-b0a0-4bf1-a701-994cf68b5574 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:26.267247 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876dbd8-4ae9-4cc9-9f47-5186bcaa5f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:26.267928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876dbd8-4ae9-4cc9-9f47-5186bcaa5f2b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:26.268217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876dbd8-4ae9-4cc9-9f47-5186bcaa5f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:26.268513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876dbd8-4ae9-4cc9-9f47-5186bcaa5f2b None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:26.269280 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876dbd8-4ae9-4cc9-9f47-5186bcaa5f2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:26.269586 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876dbd8-4ae9-4cc9-9f47-5186bcaa5f2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:26.270985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876dbd8-4ae9-4cc9-9f47-5186bcaa5f2b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:26.280596 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 26/50] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:51:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:26.286082 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f02fd9-cd1c-47ee-b40a-5eb6f0183fa9 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:26.362473 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:26.396493 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f02fd9-cd1c-47ee-b40a-5eb6f0183fa9 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:26.431595 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d5bb8-99d7-452a-a118-dc4ccb92bc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:26.433017 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d5bb8-99d7-452a-a118-dc4ccb92bc3a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:26.433322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d5bb8-99d7-452a-a118-dc4ccb92bc3a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:26.433590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d5bb8-99d7-452a-a118-dc4ccb92bc3a None admin] PATH_INFO: `/v3/users/8b8aa11a54f3466da61ca05643c14d59` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:26.434908 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d5bb8-99d7-452a-a118-dc4ccb92bc3a None admin] RBAC: Authorizing `identity:get_user(user_id=8b8aa11a54f3466da61ca05643c14d59)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:26.436351 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d5bb8-99d7-452a-a118-dc4ccb92bc3a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:26.438000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 25/51] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:51:26 2022] GET /identity/v3/users/8b8aa11a54f3466da61ca05643c14d59 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:51:26.443354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876dbd8-4ae9-4cc9-9f47-5186bcaa5f2b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:26.453236 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:26.496910 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca28a1a-5541-4200-8d73-eeb08d05e804 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:26.497205 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca28a1a-5541-4200-8d73-eeb08d05e804 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:26.497488 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca28a1a-5541-4200-8d73-eeb08d05e804 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:26.498874 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 26/52] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:51:26.504005 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6b93a-94c5-489c-87ad-33f9009a1ab8 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:26.504308 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6b93a-94c5-489c-87ad-33f9009a1ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:26.504623 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6b93a-94c5-489c-87ad-33f9009a1ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:26.530705 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8fd6b93a-94c5-489c-87ad-33f9009a1ab8 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:26.531976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8fd6b93a-94c5-489c-87ad-33f9009a1ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:26.550413 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876dbd8-4ae9-4cc9-9f47-5186bcaa5f2b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:26.589454 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0b91d-5a9a-46f0-9451-fe402d221fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:26.590361 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0b91d-5a9a-46f0-9451-fe402d221fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:26.590646 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0b91d-5a9a-46f0-9451-fe402d221fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:26.590928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0b91d-5a9a-46f0-9451-fe402d221fb8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:26.592134 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0b91d-5a9a-46f0-9451-fe402d221fb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:26.593640 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0b91d-5a9a-46f0-9451-fe402d221fb8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:26.595268 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 27/53] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:51:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:26.600903 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0b91d-5a9a-46f0-9451-fe402d221fb8 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:26.602548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 27/54] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:51:26.626518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6b93a-94c5-489c-87ad-33f9009a1ab8 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:26.680878 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:26.694438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:26.708889 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0b91d-5a9a-46f0-9451-fe402d221fb8 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:26.733360 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6b93a-94c5-489c-87ad-33f9009a1ab8 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:26.744779 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cab23-9d0e-44b1-9177-d32c395f9d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:26.746066 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cab23-9d0e-44b1-9177-d32c395f9d68 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:26.746358 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cab23-9d0e-44b1-9177-d32c395f9d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:26.746641 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cab23-9d0e-44b1-9177-d32c395f9d68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:26.747495 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cab23-9d0e-44b1-9177-d32c395f9d68 None admin] RBAC: Adding query filter params (role.id=04369f3c13174671a298fcd8175998d8, scope.domain.id=default, user.id=8b8aa11a54f3466da61ca05643c14d59) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:26.747814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cab23-9d0e-44b1-9177-d32c395f9d68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:26.749321 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cab23-9d0e-44b1-9177-d32c395f9d68 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:26.757388 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 28/55] 10.222.0.35 () {56 vars in 1322 bytes} [Thu May 19 21:51:26 2022] GET /identity/v3/role_assignments?user.id=8b8aa11a54f3466da61ca05643c14d59&scope.domain.id=default&role.id=04369f3c13174671a298fcd8175998d8 => generated 530 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:51:26.768617 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486cbdf2-b8b6-494b-a534-8144f1e68b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:26.769453 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486cbdf2-b8b6-494b-a534-8144f1e68b91 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:26.769898 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486cbdf2-b8b6-494b-a534-8144f1e68b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:26.770004 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486cbdf2-b8b6-494b-a534-8144f1e68b91 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:26.771347 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486cbdf2-b8b6-494b-a534-8144f1e68b91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:26.772976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486cbdf2-b8b6-494b-a534-8144f1e68b91 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:26.774807 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 28/56] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:51:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:51:26.780863 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cab23-9d0e-44b1-9177-d32c395f9d68 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:26.895898 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cab23-9d0e-44b1-9177-d32c395f9d68 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:26.933337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef6a31-4377-458a-a25f-ce7eaa5cedd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:26.934030 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef6a31-4377-458a-a25f-ce7eaa5cedd8 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:26.934315 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef6a31-4377-458a-a25f-ce7eaa5cedd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:26.934595 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef6a31-4377-458a-a25f-ce7eaa5cedd8 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:26.935338 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef6a31-4377-458a-a25f-ce7eaa5cedd8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:26.936845 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef6a31-4377-458a-a25f-ce7eaa5cedd8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:26.946752 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:26.966481 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 29/57] 10.222.0.35 () {60 vars in 1140 bytes} [Thu May 19 21:51:26 2022] POST /identity/v3/projects => generated 298 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:51:29.248623 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42eaab2-8260-4f6f-b3c6-ee41694d5a22 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:29.249130 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42eaab2-8260-4f6f-b3c6-ee41694d5a22 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:29.249214 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42eaab2-8260-4f6f-b3c6-ee41694d5a22 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:29.250570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 29/58] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:29.255979 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a932fa-dd11-448e-bb39-12dadab54db9 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:29.256435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a932fa-dd11-448e-bb39-12dadab54db9 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:29.256574 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a932fa-dd11-448e-bb39-12dadab54db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:29.273525 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-d6a932fa-dd11-448e-bb39-12dadab54db9 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:29.274749 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d6a932fa-dd11-448e-bb39-12dadab54db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:29.344195 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 30/59] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:29.368694 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42eaab2-8260-4f6f-b3c6-ee41694d5a22 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:29.478709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42eaab2-8260-4f6f-b3c6-ee41694d5a22 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:29.515129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4fe43-b704-422f-a56e-a0cdedebc6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:29.515826 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4fe43-b704-422f-a56e-a0cdedebc6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:29.516112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4fe43-b704-422f-a56e-a0cdedebc6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:29.516389 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4fe43-b704-422f-a56e-a0cdedebc6d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:29.517584 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4fe43-b704-422f-a56e-a0cdedebc6d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:29.519039 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4fe43-b704-422f-a56e-a0cdedebc6d2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:29.520977 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 30/60] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:51:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:29.526787 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a932fa-dd11-448e-bb39-12dadab54db9 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:29.628723 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a932fa-dd11-448e-bb39-12dadab54db9 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:29.649270 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:29.664487 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf0e59-ba5e-4fb0-93ab-96ba320bbd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:29.665183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf0e59-ba5e-4fb0-93ab-96ba320bbd8e None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:29.665468 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf0e59-ba5e-4fb0-93ab-96ba320bbd8e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:29.665746 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf0e59-ba5e-4fb0-93ab-96ba320bbd8e None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:29.666471 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf0e59-ba5e-4fb0-93ab-96ba320bbd8e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:29.668669 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf0e59-ba5e-4fb0-93ab-96ba320bbd8e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:29.694790 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 31/61] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 21:51:29 2022] POST /identity/v3/users => generated 275 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:51:33.093823 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82726ba3-fcb2-4b7b-ae93-f2cc039ddc52 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:33.094838 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82726ba3-fcb2-4b7b-ae93-f2cc039ddc52 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:33.095347 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82726ba3-fcb2-4b7b-ae93-f2cc039ddc52 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:33.097040 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 31/62] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:33.102824 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14151f77-07ea-49c2-a45d-63bfc651ab24 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:33.103741 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14151f77-07ea-49c2-a45d-63bfc651ab24 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:33.104225 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14151f77-07ea-49c2-a45d-63bfc651ab24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:33.127317 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-14151f77-07ea-49c2-a45d-63bfc651ab24 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:33.129101 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-14151f77-07ea-49c2-a45d-63bfc651ab24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:33.197165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5085f-ab66-4b8b-a2cb-aae9a60ce65f None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:33.197790 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5085f-ab66-4b8b-a2cb-aae9a60ce65f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:33.198498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5085f-ab66-4b8b-a2cb-aae9a60ce65f None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:33.200262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 32/63] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:51:33.205816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785022cc-b98b-459d-8289-22418e0d3faf None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:33.206365 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785022cc-b98b-459d-8289-22418e0d3faf None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:33.206846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785022cc-b98b-459d-8289-22418e0d3faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:33.220781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:33.230681 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 32/64] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:33.239496 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-785022cc-b98b-459d-8289-22418e0d3faf None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:33.240777 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-785022cc-b98b-459d-8289-22418e0d3faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:33.291823 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14151f77-07ea-49c2-a45d-63bfc651ab24 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:33.396380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 33/65] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:33.420077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785022cc-b98b-459d-8289-22418e0d3faf None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:33.445089 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14151f77-07ea-49c2-a45d-63bfc651ab24 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:33.453878 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:33.513172 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf8097-0de5-44ff-8e9e-a54dbc0d30cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:33.514003 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf8097-0de5-44ff-8e9e-a54dbc0d30cb None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:33.514292 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf8097-0de5-44ff-8e9e-a54dbc0d30cb None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:33.514568 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf8097-0de5-44ff-8e9e-a54dbc0d30cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:33.534011 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf8097-0de5-44ff-8e9e-a54dbc0d30cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:51:33.543702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-0cbf8097-0de5-44ff-8e9e-a54dbc0d30cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:51:33.543702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:51:33.543702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:51:33.543702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:51:33.543702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:51:33.543702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:51:33.543702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:51:33.543702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:51:33.543702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:51:33.543702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:51:33.543702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:51:33.543702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:51:33.543702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:51:33.543702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:51:33.543702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:51:33.543702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:51:33.544830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:51:33.544830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:51:33.544830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:51:33.544830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:51:33.544830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:51:33.544830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:51:33.544830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:51:33.544830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:51:33.544830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:51:33.544830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:51:33.544830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:51:33.544830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:51:33.544830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:51:33.544830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:51:33.544830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:51:33.544830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:51:33.545696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:51:33.545696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:51:33.545696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:51:33.545696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:51:33.545696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:51:33.545696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:51:33.545696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:51:33.545696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:51:33.545696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:51:33.545696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:51:33.545696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:51:33.545696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:51:33.547111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785022cc-b98b-459d-8289-22418e0d3faf None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:33.547988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 33/66] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:51:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:51:33.554060 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf8097-0de5-44ff-8e9e-a54dbc0d30cb None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:33.579104 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:33.588247 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c90c9-766e-4f1f-bc04-b4e4b73d75f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:33.589435 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c90c9-766e-4f1f-bc04-b4e4b73d75f9 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:33.590141 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c90c9-766e-4f1f-bc04-b4e4b73d75f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:33.591425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c90c9-766e-4f1f-bc04-b4e4b73d75f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:33.614736 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c90c9-766e-4f1f-bc04-b4e4b73d75f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:51:33.624518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-b40c90c9-766e-4f1f-bc04-b4e4b73d75f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:51:33.624518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:51:33.624518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:51:33.624518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:51:33.624518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:51:33.624518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:51:33.624518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:51:33.624518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:51:33.624518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:51:33.624518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:51:33.624518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:51:33.624518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:51:33.624518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:51:33.624518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:51:33.624518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:51:33.624518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:51:33.625557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:51:33.625557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:51:33.625557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:51:33.625557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:51:33.625557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:51:33.625557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:51:33.625557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:51:33.625557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:51:33.625557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:51:33.625557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:51:33.625557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:51:33.625557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:51:33.625557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:51:33.625557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:51:33.625557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:51:33.625557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:51:33.626471 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:51:33.626471 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:51:33.626471 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:51:33.626471 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:51:33.626471 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:51:33.626471 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:51:33.626471 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:51:33.626471 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:51:33.626471 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:51:33.626471 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:51:33.626471 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:51:33.626471 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:51:33.637698 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 34/67] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:51:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:51:33.644842 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c90c9-766e-4f1f-bc04-b4e4b73d75f9 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:33.728850 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf8097-0de5-44ff-8e9e-a54dbc0d30cb None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:33.759621 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c90c9-766e-4f1f-bc04-b4e4b73d75f9 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:33.769356 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de340b9-e655-48a9-a6fc-b171810594a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:33.770275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de340b9-e655-48a9-a6fc-b171810594a7 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:33.770775 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de340b9-e655-48a9-a6fc-b171810594a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:33.771256 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de340b9-e655-48a9-a6fc-b171810594a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:33.772205 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de340b9-e655-48a9-a6fc-b171810594a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:33.772726 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de340b9-e655-48a9-a6fc-b171810594a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:33.774330 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de340b9-e655-48a9-a6fc-b171810594a7 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:33.783657 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 34/68] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:51:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:51:33.785426 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c72d11-9a00-4f80-980f-25cce0116da5 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:33.785935 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c72d11-9a00-4f80-980f-25cce0116da5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:33.786402 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c72d11-9a00-4f80-980f-25cce0116da5 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:33.787856 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 35/69] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:33.793380 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c72d11-9a00-4f80-980f-25cce0116da5 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:33.796821 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73f431-f4ae-43b6-b18c-64cb57800717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:33.797621 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73f431-f4ae-43b6-b18c-64cb57800717 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:33.797906 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73f431-f4ae-43b6-b18c-64cb57800717 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:33.798185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73f431-f4ae-43b6-b18c-64cb57800717 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:33.798997 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73f431-f4ae-43b6-b18c-64cb57800717 None admin] RBAC: Adding query filter params (name=member) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:33.799313 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73f431-f4ae-43b6-b18c-64cb57800717 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:33.800819 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73f431-f4ae-43b6-b18c-64cb57800717 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:33.811788 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 35/70] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 21:51:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:51:33.813242 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ac006-e55d-4448-bde3-9ae52de78d13 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:33.813535 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ac006-e55d-4448-bde3-9ae52de78d13 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:33.813813 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ac006-e55d-4448-bde3-9ae52de78d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:33.826864 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:33.833150 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-204ac006-e55d-4448-bde3-9ae52de78d13 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:33.834531 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-204ac006-e55d-4448-bde3-9ae52de78d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:33.891786 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:33.914209 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 36/71] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:33.915311 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ac006-e55d-4448-bde3-9ae52de78d13 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:33.920686 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c72d11-9a00-4f80-980f-25cce0116da5 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:33.958425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a6182-a581-4851-9286-334d5a72cdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:33.959335 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a6182-a581-4851-9286-334d5a72cdcd None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:33.959620 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a6182-a581-4851-9286-334d5a72cdcd None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:33.959893 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a6182-a581-4851-9286-334d5a72cdcd None admin] PATH_INFO: `/v3/users/8b8aa11a54f3466da61ca05643c14d59` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:33.961259 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a6182-a581-4851-9286-334d5a72cdcd None admin] RBAC: Authorizing `identity:get_user(user_id=8b8aa11a54f3466da61ca05643c14d59)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:33.962768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a6182-a581-4851-9286-334d5a72cdcd None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:33.965124 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 36/72] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:51:33 2022] GET /identity/v3/users/8b8aa11a54f3466da61ca05643c14d59 => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:33.966539 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf3376-d002-45ea-80bd-dd039a827dc9 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:33.966831 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf3376-d002-45ea-80bd-dd039a827dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:33.967107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf3376-d002-45ea-80bd-dd039a827dc9 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:33.972369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 37/73] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:33.972369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e26568-5503-48c5-a533-e6e4a8bf3291 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:33.972369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e26568-5503-48c5-a533-e6e4a8bf3291 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:33.972369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e26568-5503-48c5-a533-e6e4a8bf3291 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:33.972369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 38/74] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:33.976213 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e26568-5503-48c5-a533-e6e4a8bf3291 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:34.029042 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ac006-e55d-4448-bde3-9ae52de78d13 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:34.063835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991c6ad-7646-45b2-aeaa-9ee3bb743e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:34.064813 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991c6ad-7646-45b2-aeaa-9ee3bb743e71 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:34.065098 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991c6ad-7646-45b2-aeaa-9ee3bb743e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:34.065373 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991c6ad-7646-45b2-aeaa-9ee3bb743e71 None admin] PATH_INFO: `/v3/users/8adc91e3b100408bb77c02ef2a959cd1` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:34.074979 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:34.079882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991c6ad-7646-45b2-aeaa-9ee3bb743e71 None admin] RBAC: Authorizing `identity:get_user(user_id=8adc91e3b100408bb77c02ef2a959cd1)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:34.081401 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991c6ad-7646-45b2-aeaa-9ee3bb743e71 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:34.083037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e26568-5503-48c5-a533-e6e4a8bf3291 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:34.083155 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 37/75] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:51:33 2022] GET /identity/v3/users/8adc91e3b100408bb77c02ef2a959cd1 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:34.083907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991c6ad-7646-45b2-aeaa-9ee3bb743e71 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:34.120674 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94650ac5-e750-493e-b665-27587171c233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:34.121679 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94650ac5-e750-493e-b665-27587171c233 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:34.121966 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94650ac5-e750-493e-b665-27587171c233 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:34.122242 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94650ac5-e750-493e-b665-27587171c233 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:34.132783 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:34.133390 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94650ac5-e750-493e-b665-27587171c233 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:51:34.142483 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-94650ac5-e750-493e-b665-27587171c233 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:51:34.142483 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:51:34.142483 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:51:34.142483 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:51:34.142483 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:51:34.142483 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:51:34.142483 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:51:34.142483 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:51:34.142483 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:51:34.142483 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:51:34.142483 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:51:34.142483 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:51:34.142483 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:51:34.142483 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:51:34.142483 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:51:34.142483 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:51:34.143388 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:51:34.143388 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:51:34.143388 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:51:34.143388 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:51:34.143388 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:51:34.143388 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:51:34.143388 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:51:34.143388 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:51:34.143388 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:51:34.143388 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:51:34.143388 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:51:34.143388 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:51:34.143388 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:51:34.143388 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:51:34.143388 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:51:34.143388 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:51:34.144117 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:51:34.144117 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:51:34.144117 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:51:34.144117 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:51:34.144117 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:51:34.144117 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:51:34.144117 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:51:34.144117 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:51:34.144117 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:51:34.144117 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:51:34.144117 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:51:34.144117 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:51:34.144117 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 39/76] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 21:51:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:51:34.144966 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ca317-b066-44c5-9300-304c60a5c8a9 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:34.145205 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ca317-b066-44c5-9300-304c60a5c8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:34.145488 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ca317-b066-44c5-9300-304c60a5c8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:34.162347 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-db4ca317-b066-44c5-9300-304c60a5c8a9 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:34.170408 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-db4ca317-b066-44c5-9300-304c60a5c8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:34.202578 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991c6ad-7646-45b2-aeaa-9ee3bb743e71 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:34.238038 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 40/77] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:34.248706 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56232146-d981-435b-a9c7-eff7d2595291 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:34.248804 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb3f5d-9bd1-4684-80d5-05e3aa2313ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:34.248902 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56232146-d981-435b-a9c7-eff7d2595291 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:34.248902 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56232146-d981-435b-a9c7-eff7d2595291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:34.249052 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb3f5d-9bd1-4684-80d5-05e3aa2313ef None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:34.249052 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb3f5d-9bd1-4684-80d5-05e3aa2313ef None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:34.249052 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb3f5d-9bd1-4684-80d5-05e3aa2313ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:34.261135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-56232146-d981-435b-a9c7-eff7d2595291 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:34.262393 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-56232146-d981-435b-a9c7-eff7d2595291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:34.315215 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb3f5d-9bd1-4684-80d5-05e3aa2313ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:34.316752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb3f5d-9bd1-4684-80d5-05e3aa2313ef None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:34.334460 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 41/78] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:34.339446 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56232146-d981-435b-a9c7-eff7d2595291 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:34.369881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:34.379178 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:34.448805 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 38/79] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:51:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:51:34.448805 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb3f5d-9bd1-4684-80d5-05e3aa2313ef None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:34.466257 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56232146-d981-435b-a9c7-eff7d2595291 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:34.502979 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d764db-789f-4e72-ad42-7466465cbdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:34.503638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d764db-789f-4e72-ad42-7466465cbdb1 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:34.503921 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d764db-789f-4e72-ad42-7466465cbdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:34.504202 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d764db-789f-4e72-ad42-7466465cbdb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:34.554081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb3f5d-9bd1-4684-80d5-05e3aa2313ef None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:34.578057 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d764db-789f-4e72-ad42-7466465cbdb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:34.579679 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d764db-789f-4e72-ad42-7466465cbdb1 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:34.589542 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20822ebc-805b-41a5-b176-9ddbb1c7e41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:34.590215 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20822ebc-805b-41a5-b176-9ddbb1c7e41e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:34.590499 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20822ebc-805b-41a5-b176-9ddbb1c7e41e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:34.590777 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20822ebc-805b-41a5-b176-9ddbb1c7e41e None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:34.591530 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20822ebc-805b-41a5-b176-9ddbb1c7e41e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:34.591833 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20822ebc-805b-41a5-b176-9ddbb1c7e41e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:34.593280 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20822ebc-805b-41a5-b176-9ddbb1c7e41e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:34.598562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:34.602087 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 39/80] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:51:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:34.607618 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20822ebc-805b-41a5-b176-9ddbb1c7e41e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:34.609295 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:34.701537 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 42/81] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:51:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:51:34.702399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d764db-789f-4e72-ad42-7466465cbdb1 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:34.719999 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20822ebc-805b-41a5-b176-9ddbb1c7e41e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:34.758447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b7480-4f4a-4df6-a80c-3f60c87f81c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:34.759260 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b7480-4f4a-4df6-a80c-3f60c87f81c6 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:34.759546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b7480-4f4a-4df6-a80c-3f60c87f81c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:34.759828 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b7480-4f4a-4df6-a80c-3f60c87f81c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:34.770866 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b7480-4f4a-4df6-a80c-3f60c87f81c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:51:34.778789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-012b7480-4f4a-4df6-a80c-3f60c87f81c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:51:34.778789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:51:34.778789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:51:34.778789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:51:34.778789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:51:34.778789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:51:34.778789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:51:34.778789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:51:34.778789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:51:34.778789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:51:34.778789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:51:34.778789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:51:34.778789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:51:34.778789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:51:34.778789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:51:34.778789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:51:34.779655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:51:34.779655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:51:34.779655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:51:34.779655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:51:34.779655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:51:34.779655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:51:34.779655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:51:34.779655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:51:34.779655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:51:34.779655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:51:34.779655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:51:34.779655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:51:34.779655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:51:34.779655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:51:34.779655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:51:34.779655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:51:34.780393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:51:34.780393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:51:34.780393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:51:34.780393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:51:34.780393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:51:34.780393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:51:34.780393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:51:34.780393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:51:34.780393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:51:34.780393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:51:34.780393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:51:34.780393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:51:34.780393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 40/82] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:51:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:51:34.781026 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b7480-4f4a-4df6-a80c-3f60c87f81c6 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:34.813153 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d764db-789f-4e72-ad42-7466465cbdb1 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:34.830054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:34.846424 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:34.859042 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396d2ec-3998-4a3f-9e3b-b50f4e375594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:34.859846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396d2ec-3998-4a3f-9e3b-b50f4e375594 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:34.860149 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396d2ec-3998-4a3f-9e3b-b50f4e375594 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:34.860443 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396d2ec-3998-4a3f-9e3b-b50f4e375594 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:34.861653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396d2ec-3998-4a3f-9e3b-b50f4e375594 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:34.863127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396d2ec-3998-4a3f-9e3b-b50f4e375594 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:34.865143 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 43/83] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:51:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:34.867010 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396d2ec-3998-4a3f-9e3b-b50f4e375594 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:34.889848 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b7480-4f4a-4df6-a80c-3f60c87f81c6 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:34.924851 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4e821-2704-40bd-8c45-7490634fbd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:34.925716 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4e821-2704-40bd-8c45-7490634fbd03 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:34.926005 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4e821-2704-40bd-8c45-7490634fbd03 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:34.926280 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4e821-2704-40bd-8c45-7490634fbd03 None admin] PATH_INFO: `/v3/projects/eeea527f528b47d882789251a2058689` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:34.927478 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4e821-2704-40bd-8c45-7490634fbd03 None admin] RBAC: Authorizing `identity:get_project(project_id=eeea527f528b47d882789251a2058689)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:34.928990 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4e821-2704-40bd-8c45-7490634fbd03 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:34.935971 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 41/84] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:51:34 2022] GET /identity/v3/projects/eeea527f528b47d882789251a2058689 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:34.935971 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4e821-2704-40bd-8c45-7490634fbd03 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:34.983479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396d2ec-3998-4a3f-9e3b-b50f4e375594 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:35.022621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9e67b-44cb-49ea-9e34-f6bd08781f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:35.023501 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9e67b-44cb-49ea-9e34-f6bd08781f37 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:35.023788 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9e67b-44cb-49ea-9e34-f6bd08781f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:35.024069 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9e67b-44cb-49ea-9e34-f6bd08781f37 None admin] PATH_INFO: `/v3/users/8adc91e3b100408bb77c02ef2a959cd1` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:35.025444 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9e67b-44cb-49ea-9e34-f6bd08781f37 None admin] RBAC: Authorizing `identity:get_user(user_id=8adc91e3b100408bb77c02ef2a959cd1)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:35.027469 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9e67b-44cb-49ea-9e34-f6bd08781f37 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:35.029226 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 44/85] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:51:34 2022] GET /identity/v3/users/8adc91e3b100408bb77c02ef2a959cd1 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:35.030000 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9e67b-44cb-49ea-9e34-f6bd08781f37 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:35.040300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4e821-2704-40bd-8c45-7490634fbd03 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:35.072314 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:35.078175 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e2c6c-4dd0-48aa-be76-b4ca7bedfac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:35.079046 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e2c6c-4dd0-48aa-be76-b4ca7bedfac5 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:35.079339 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e2c6c-4dd0-48aa-be76-b4ca7bedfac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:35.079615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e2c6c-4dd0-48aa-be76-b4ca7bedfac5 None admin] PATH_INFO: `/v3/projects/eeea527f528b47d882789251a2058689` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:35.080841 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e2c6c-4dd0-48aa-be76-b4ca7bedfac5 None admin] RBAC: Authorizing `identity:get_project(project_id=eeea527f528b47d882789251a2058689)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:35.082309 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e2c6c-4dd0-48aa-be76-b4ca7bedfac5 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:35.084069 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 42/86] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:51:34 2022] GET /identity/v3/projects/eeea527f528b47d882789251a2058689 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:35.084841 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e2c6c-4dd0-48aa-be76-b4ca7bedfac5 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:35.089654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:35.143148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9e67b-44cb-49ea-9e34-f6bd08781f37 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:35.187963 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff64e8-14fa-44ae-9381-ccdf6b20c30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:35.188673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff64e8-14fa-44ae-9381-ccdf6b20c30f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:35.188963 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff64e8-14fa-44ae-9381-ccdf6b20c30f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:35.189246 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e2c6c-4dd0-48aa-be76-b4ca7bedfac5 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:35.189709 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff64e8-14fa-44ae-9381-ccdf6b20c30f None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:35.190005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff64e8-14fa-44ae-9381-ccdf6b20c30f None admin] RBAC: Adding query filter params (name=member) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:35.190314 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff64e8-14fa-44ae-9381-ccdf6b20c30f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:35.191753 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff64e8-14fa-44ae-9381-ccdf6b20c30f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:35.200524 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 45/87] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 21:51:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:35.201269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff64e8-14fa-44ae-9381-ccdf6b20c30f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:35.228869 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12dd474-65ff-4175-920b-ba43741e246b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:35.230066 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12dd474-65ff-4175-920b-ba43741e246b None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:35.230526 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12dd474-65ff-4175-920b-ba43741e246b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:35.230816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12dd474-65ff-4175-920b-ba43741e246b None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:35.231528 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12dd474-65ff-4175-920b-ba43741e246b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:35.233005 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12dd474-65ff-4175-920b-ba43741e246b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:35.264868 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 43/88] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 21:51:35 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:51:35.269445 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12dd474-65ff-4175-920b-ba43741e246b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:35.314301 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff64e8-14fa-44ae-9381-ccdf6b20c30f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:35.332103 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:35.350546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:35.360385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b2eb2-fb4d-4ca3-ad5a-79be375a6167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:35.361178 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b2eb2-fb4d-4ca3-ad5a-79be375a6167 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:35.361534 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b2eb2-fb4d-4ca3-ad5a-79be375a6167 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:35.361880 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b2eb2-fb4d-4ca3-ad5a-79be375a6167 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:35.362820 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b2eb2-fb4d-4ca3-ad5a-79be375a6167 None admin] RBAC: Adding query filter params (role.id=04369f3c13174671a298fcd8175998d8, scope.project.id=eeea527f528b47d882789251a2058689, user.id=8b8aa11a54f3466da61ca05643c14d59) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:35.363212 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b2eb2-fb4d-4ca3-ad5a-79be375a6167 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:35.367031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b2eb2-fb4d-4ca3-ad5a-79be375a6167 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:35.372814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 46/89] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:51:35 2022] GET /identity/v3/role_assignments?user.id=8b8aa11a54f3466da61ca05643c14d59&scope.project.id=eeea527f528b47d882789251a2058689&role.id=04369f3c13174671a298fcd8175998d8 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:35.381116 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b2eb2-fb4d-4ca3-ad5a-79be375a6167 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:35.429008 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12dd474-65ff-4175-920b-ba43741e246b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:35.483215 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94d8bc-6a46-4f61-89b0-3bfb09904e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:35.484109 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94d8bc-6a46-4f61-89b0-3bfb09904e79 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:35.484500 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94d8bc-6a46-4f61-89b0-3bfb09904e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:35.484889 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94d8bc-6a46-4f61-89b0-3bfb09904e79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:35.510208 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b2eb2-fb4d-4ca3-ad5a-79be375a6167 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:35.571905 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fad03-4f4e-4035-826b-d9e3181eea5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:35.572931 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fad03-4f4e-4035-826b-d9e3181eea5f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:35.573250 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fad03-4f4e-4035-826b-d9e3181eea5f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:35.573538 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fad03-4f4e-4035-826b-d9e3181eea5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:35.574664 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02fad03-4f4e-4035-826b-d9e3181eea5f None admin] RBAC: Adding query filter params (role.id=4749055b54a542b29f57155df3756136, scope.project.id=eeea527f528b47d882789251a2058689, user.id=8adc91e3b100408bb77c02ef2a959cd1) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:35.574981 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02fad03-4f4e-4035-826b-d9e3181eea5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:35.578860 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02fad03-4f4e-4035-826b-d9e3181eea5f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:35.586114 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 47/90] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:51:35 2022] GET /identity/v3/role_assignments?user.id=8adc91e3b100408bb77c02ef2a959cd1&scope.project.id=eeea527f528b47d882789251a2058689&role.id=4749055b54a542b29f57155df3756136 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:35.593391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fad03-4f4e-4035-826b-d9e3181eea5f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:35.597314 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94d8bc-6a46-4f61-89b0-3bfb09904e79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:35.599155 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94d8bc-6a46-4f61-89b0-3bfb09904e79 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:35.688998 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:35.697111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:35.757557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 44/91] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:51:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:51:35.764351 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94d8bc-6a46-4f61-89b0-3bfb09904e79 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:35.780176 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fad03-4f4e-4035-826b-d9e3181eea5f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:35.824474 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c354b-a7b7-4e30-b297-867445074fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:35.825743 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c354b-a7b7-4e30-b297-867445074fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:35.826238 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c354b-a7b7-4e30-b297-867445074fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:35.826742 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c354b-a7b7-4e30-b297-867445074fa8 None admin] PATH_INFO: `/v3/users/8adc91e3b100408bb77c02ef2a959cd1` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:35.828562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c354b-a7b7-4e30-b297-867445074fa8 None admin] RBAC: Authorizing `identity:get_user(user_id=8adc91e3b100408bb77c02ef2a959cd1)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:35.830391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c354b-a7b7-4e30-b297-867445074fa8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:35.832562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 48/92] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:51:35 2022] GET /identity/v3/users/8adc91e3b100408bb77c02ef2a959cd1 => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:35.840223 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c354b-a7b7-4e30-b297-867445074fa8 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:35.982871 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94d8bc-6a46-4f61-89b0-3bfb09904e79 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:35.987108 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c354b-a7b7-4e30-b297-867445074fa8 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:36.014424 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:36.032152 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262053b-5a7b-4ad7-9d06-311bd940d9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:36.034075 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262053b-5a7b-4ad7-9d06-311bd940d9fd None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:36.034826 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262053b-5a7b-4ad7-9d06-311bd940d9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:36.035346 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262053b-5a7b-4ad7-9d06-311bd940d9fd None admin] PATH_INFO: `/v3/projects/eeea527f528b47d882789251a2058689` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:36.037843 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262053b-5a7b-4ad7-9d06-311bd940d9fd None admin] RBAC: Authorizing `identity:get_project(project_id=eeea527f528b47d882789251a2058689)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:36.039707 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262053b-5a7b-4ad7-9d06-311bd940d9fd None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:36.042327 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 45/93] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:51:35 2022] GET /identity/v3/projects/eeea527f528b47d882789251a2058689 => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:51:36.049670 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262053b-5a7b-4ad7-9d06-311bd940d9fd None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:36.078175 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50cfb6-e113-4054-8004-141f10d85b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:36.078922 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50cfb6-e113-4054-8004-141f10d85b71 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:36.079037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50cfb6-e113-4054-8004-141f10d85b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:36.079302 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50cfb6-e113-4054-8004-141f10d85b71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:36.086197 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:36.180376 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262053b-5a7b-4ad7-9d06-311bd940d9fd None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:36.226071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eeda92-283e-4ae7-a1c0-9f5375f13521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:36.227536 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eeda92-283e-4ae7-a1c0-9f5375f13521 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:36.228027 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eeda92-283e-4ae7-a1c0-9f5375f13521 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:36.228543 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eeda92-283e-4ae7-a1c0-9f5375f13521 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:36.229889 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eeda92-283e-4ae7-a1c0-9f5375f13521 None admin] RBAC: Adding query filter params (role.id=3fb2a96d6ee74a7dbd046488f5ec322b, scope.project.id=eeea527f528b47d882789251a2058689, user.id=8adc91e3b100408bb77c02ef2a959cd1) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:36.231178 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eeda92-283e-4ae7-a1c0-9f5375f13521 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:36.233190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eeda92-283e-4ae7-a1c0-9f5375f13521 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:36.240799 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 46/94] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:51:36 2022] GET /identity/v3/role_assignments?user.id=8adc91e3b100408bb77c02ef2a959cd1&scope.project.id=eeea527f528b47d882789251a2058689&role.id=3fb2a96d6ee74a7dbd046488f5ec322b => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:36.273050 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50cfb6-e113-4054-8004-141f10d85b71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:36.274589 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50cfb6-e113-4054-8004-141f10d85b71 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:36.428968 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 49/95] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:51:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 21:51:36.435593 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eeda92-283e-4ae7-a1c0-9f5375f13521 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:36.551381 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:36.567239 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eeda92-283e-4ae7-a1c0-9f5375f13521 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:36.618754 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a82cf8-e078-4edb-8354-e81d9024ac24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:36.619574 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a82cf8-e078-4edb-8354-e81d9024ac24 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:36.619960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a82cf8-e078-4edb-8354-e81d9024ac24 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:36.620897 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a82cf8-e078-4edb-8354-e81d9024ac24 None admin] PATH_INFO: `/v3/projects/066c3bcd7d4d4cd9ac4093ccb3add8e4` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:36.622379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a82cf8-e078-4edb-8354-e81d9024ac24 None admin] RBAC: Authorizing `identity:get_project(project_id=066c3bcd7d4d4cd9ac4093ccb3add8e4)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:36.623856 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a82cf8-e078-4edb-8354-e81d9024ac24 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:36.625886 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 47/96] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:51:36 2022] GET /identity/v3/projects/066c3bcd7d4d4cd9ac4093ccb3add8e4 => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:36.631636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50cfb6-e113-4054-8004-141f10d85b71 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:36.643719 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:36.769793 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50cfb6-e113-4054-8004-141f10d85b71 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:36.810591 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf8eea-938d-4906-9ce2-43a86660e266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:36.811262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf8eea-938d-4906-9ce2-43a86660e266 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:36.811545 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf8eea-938d-4906-9ce2-43a86660e266 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:36.811815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf8eea-938d-4906-9ce2-43a86660e266 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:36.812693 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf8eea-938d-4906-9ce2-43a86660e266 None admin] RBAC: Adding query filter params (role.id=4749055b54a542b29f57155df3756136, scope.project.id=066c3bcd7d4d4cd9ac4093ccb3add8e4, user.id=8adc91e3b100408bb77c02ef2a959cd1) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:36.813003 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf8eea-938d-4906-9ce2-43a86660e266 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:36.814488 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf8eea-938d-4906-9ce2-43a86660e266 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:36.821401 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 50/97] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:51:36 2022] GET /identity/v3/role_assignments?user.id=8adc91e3b100408bb77c02ef2a959cd1&scope.project.id=066c3bcd7d4d4cd9ac4093ccb3add8e4&role.id=4749055b54a542b29f57155df3756136 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:38.673552 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d526d-6732-44e5-a9db-0705a4638292 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:38.674063 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d526d-6732-44e5-a9db-0705a4638292 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:38.674063 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d526d-6732-44e5-a9db-0705a4638292 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:38.675716 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 48/98] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:38.681060 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179569e-203e-4517-b13d-72e97379de36 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:38.681543 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179569e-203e-4517-b13d-72e97379de36 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:38.681629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179569e-203e-4517-b13d-72e97379de36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:38.700227 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c179569e-203e-4517-b13d-72e97379de36 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:38.701502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c179569e-203e-4517-b13d-72e97379de36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:38.793950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 51/99] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:38.833870 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d526d-6732-44e5-a9db-0705a4638292 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:38.973730 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d526d-6732-44e5-a9db-0705a4638292 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:39.014864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7c1a6-6c2c-4b39-9547-fa90027434cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:39.015711 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7c1a6-6c2c-4b39-9547-fa90027434cd None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:39.016002 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7c1a6-6c2c-4b39-9547-fa90027434cd None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:39.016281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7c1a6-6c2c-4b39-9547-fa90027434cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:39.017661 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7c1a6-6c2c-4b39-9547-fa90027434cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:39.019488 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7c1a6-6c2c-4b39-9547-fa90027434cd None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:39.021287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 49/100] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:51:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:39.027561 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179569e-203e-4517-b13d-72e97379de36 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:39.030957 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:39.119765 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b328bde-0f66-4914-a06d-b4bb5eb4c44c None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:39.120645 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b328bde-0f66-4914-a06d-b4bb5eb4c44c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:39.120933 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b328bde-0f66-4914-a06d-b4bb5eb4c44c None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:39.122548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 50/101] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:51:39.128720 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b95eb-450b-4b09-9266-8c1cc3143b4b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:39.129009 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b95eb-450b-4b09-9266-8c1cc3143b4b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:39.129289 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b95eb-450b-4b09-9266-8c1cc3143b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:39.169591 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-953b95eb-450b-4b09-9266-8c1cc3143b4b None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:39.171510 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-953b95eb-450b-4b09-9266-8c1cc3143b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:39.221739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:39.244207 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179569e-203e-4517-b13d-72e97379de36 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:39.322761 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c16e6-b1cb-4f91-8242-71cfdb30f0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:39.322761 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c16e6-b1cb-4f91-8242-71cfdb30f0e3 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:39.322761 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c16e6-b1cb-4f91-8242-71cfdb30f0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:39.322761 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c16e6-b1cb-4f91-8242-71cfdb30f0e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:39.323214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c16e6-b1cb-4f91-8242-71cfdb30f0e3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:39.323214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c16e6-b1cb-4f91-8242-71cfdb30f0e3 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:39.328368 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 51/102] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:39.357849 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373d978-e218-42c7-9d7d-d073c2e59ac9 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:39.358142 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373d978-e218-42c7-9d7d-d073c2e59ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:39.358420 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373d978-e218-42c7-9d7d-d073c2e59ac9 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:39.359875 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 52/103] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:39.370717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373d978-e218-42c7-9d7d-d073c2e59ac9 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:39.384680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 52/104] 10.222.0.35 () {60 vars in 1141 bytes} [Thu May 19 21:51:39 2022] POST /identity/v3/projects => generated 302 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:51:39.386119 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e917892-8b89-484a-b508-39cdcfe7ef10 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:39.386414 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e917892-8b89-484a-b508-39cdcfe7ef10 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:39.386708 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e917892-8b89-484a-b508-39cdcfe7ef10 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:39.387994 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 53/105] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:39.389359 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17331af4-804c-4d8c-a814-d91b8b46957d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:39.389853 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17331af4-804c-4d8c-a814-d91b8b46957d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:39.390309 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17331af4-804c-4d8c-a814-d91b8b46957d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:39.410652 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-17331af4-804c-4d8c-a814-d91b8b46957d None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:39.411993 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-17331af4-804c-4d8c-a814-d91b8b46957d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:39.474822 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:39.498868 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 54/106] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:39.500130 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90197e-2360-4f95-9fae-11b3e7345c90 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:39.508815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90197e-2360-4f95-9fae-11b3e7345c90 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:39.509368 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90197e-2360-4f95-9fae-11b3e7345c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:39.532558 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373d978-e218-42c7-9d7d-d073c2e59ac9 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:39.555551 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-5e90197e-2360-4f95-9fae-11b3e7345c90 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:39.556833 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5e90197e-2360-4f95-9fae-11b3e7345c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:39.577851 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b315cf-ae28-4396-9aeb-fd8464f7a231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:39.578684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b315cf-ae28-4396-9aeb-fd8464f7a231 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:39.578974 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b315cf-ae28-4396-9aeb-fd8464f7a231 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:39.579262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b315cf-ae28-4396-9aeb-fd8464f7a231 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:39.592974 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b315cf-ae28-4396-9aeb-fd8464f7a231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:51:39.601126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-f4b315cf-ae28-4396-9aeb-fd8464f7a231 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:51:39.601126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:51:39.601126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:51:39.601126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:51:39.601126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:51:39.601126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:51:39.601126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:51:39.601126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:51:39.601126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:51:39.601126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:51:39.601126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:51:39.601126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:51:39.601126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:51:39.601126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:51:39.601126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:51:39.601126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:51:39.602006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:51:39.602006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:51:39.602006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:51:39.602006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:51:39.602006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:51:39.602006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:51:39.602006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:51:39.602006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:51:39.602006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:51:39.602006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:51:39.602006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:51:39.602006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:51:39.602006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:51:39.602006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:51:39.602006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:51:39.602006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:51:39.602772 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:51:39.602772 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:51:39.602772 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:51:39.602772 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:51:39.602772 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:51:39.602772 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:51:39.602772 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:51:39.602772 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:51:39.602772 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:51:39.602772 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:51:39.602772 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:51:39.602772 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:51:39.602772 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 53/107] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:51:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:51:39.604256 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71432620-3432-4f71-8f0b-0b99614e9be4 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:39.604256 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71432620-3432-4f71-8f0b-0b99614e9be4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:39.604447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71432620-3432-4f71-8f0b-0b99614e9be4 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:39.605747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 54/108] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:39.606576 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71432620-3432-4f71-8f0b-0b99614e9be4 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:39.628035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:39.653969 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 55/109] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:39.656084 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06107d-038f-4a62-bd2d-1ec4e571b52d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:39.656601 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06107d-038f-4a62-bd2d-1ec4e571b52d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:39.657061 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06107d-038f-4a62-bd2d-1ec4e571b52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:39.676570 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6a06107d-038f-4a62-bd2d-1ec4e571b52d None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:39.677770 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6a06107d-038f-4a62-bd2d-1ec4e571b52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:39.748508 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71432620-3432-4f71-8f0b-0b99614e9be4 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:39.768937 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 56/110] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:39.769736 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06107d-038f-4a62-bd2d-1ec4e571b52d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:39.797374 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13903db-0a7a-4d3d-96a3-b1322005e9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:39.798887 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13903db-0a7a-4d3d-96a3-b1322005e9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:39.799189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13903db-0a7a-4d3d-96a3-b1322005e9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:39.799627 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13903db-0a7a-4d3d-96a3-b1322005e9a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:39.814504 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13903db-0a7a-4d3d-96a3-b1322005e9a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:51:39.823927 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:39.827522 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-b13903db-0a7a-4d3d-96a3-b1322005e9a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:51:39.827522 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:51:39.827522 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:51:39.827522 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:51:39.827522 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:51:39.827522 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:51:39.827522 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:51:39.827522 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:51:39.827522 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:51:39.827522 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:51:39.827522 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:51:39.827522 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:51:39.827522 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:51:39.827522 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:51:39.827522 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:51:39.827522 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:51:39.828499 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:51:39.828499 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:51:39.828499 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:51:39.828499 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:51:39.828499 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:51:39.828499 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:51:39.828499 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:51:39.828499 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:51:39.828499 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:51:39.828499 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:51:39.828499 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:51:39.828499 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:51:39.828499 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:51:39.828499 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:51:39.828499 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:51:39.828499 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:51:39.829236 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:51:39.829236 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:51:39.829236 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:51:39.829236 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:51:39.829236 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:51:39.829236 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:51:39.829236 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:51:39.829236 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:51:39.829236 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:51:39.829236 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:51:39.829236 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:51:39.829236 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:51:39.830279 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 55/111] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 21:51:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:51:39.833340 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13903db-0a7a-4d3d-96a3-b1322005e9a4 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:39.907892 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06107d-038f-4a62-bd2d-1ec4e571b52d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:39.926948 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:39.955996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13903db-0a7a-4d3d-96a3-b1322005e9a4 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:39.960632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81840cfb-4359-4693-b20b-d2c2fca1fb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:39.961421 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81840cfb-4359-4693-b20b-d2c2fca1fb38 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:39.961718 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81840cfb-4359-4693-b20b-d2c2fca1fb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:39.962058 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81840cfb-4359-4693-b20b-d2c2fca1fb38 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:39.962837 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81840cfb-4359-4693-b20b-d2c2fca1fb38 None admin] RBAC: Adding query filter params (name=member) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:39.963210 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81840cfb-4359-4693-b20b-d2c2fca1fb38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:39.965658 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81840cfb-4359-4693-b20b-d2c2fca1fb38 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:39.978916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 57/112] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 21:51:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:39.979914 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81840cfb-4359-4693-b20b-d2c2fca1fb38 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:40.001816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e70a39-9241-4456-9ae3-b88644f3978c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:40.002664 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e70a39-9241-4456-9ae3-b88644f3978c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:40.002951 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e70a39-9241-4456-9ae3-b88644f3978c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:40.003233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e70a39-9241-4456-9ae3-b88644f3978c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:40.016324 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e70a39-9241-4456-9ae3-b88644f3978c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:51:40.024299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-22e70a39-9241-4456-9ae3-b88644f3978c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:51:40.024299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:51:40.024299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:51:40.024299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:51:40.024299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:51:40.024299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:51:40.024299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:51:40.024299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:51:40.024299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:51:40.024299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:51:40.024299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:51:40.024299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:51:40.024299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:51:40.024299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:51:40.024299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:51:40.024299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:51:40.026640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:51:40.026640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:51:40.026640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:51:40.026640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:51:40.026640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:51:40.026640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:51:40.026640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:51:40.026640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:51:40.026640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:51:40.026640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:51:40.026640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:51:40.026640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:51:40.026640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:51:40.026640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:51:40.026640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:51:40.026640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:51:40.027681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:51:40.027681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:51:40.027681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:51:40.027681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:51:40.027681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:51:40.027681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:51:40.027681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:51:40.027681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:51:40.027681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:51:40.027681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:51:40.027681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:51:40.027681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:51:40.027681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 56/113] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:51:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:51:40.027681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e70a39-9241-4456-9ae3-b88644f3978c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:40.126083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81840cfb-4359-4693-b20b-d2c2fca1fb38 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:40.140066 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:40.142648 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e70a39-9241-4456-9ae3-b88644f3978c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:40.178214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad20ccd-9b57-48b4-8968-cfeaf7b0d456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:40.179231 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad20ccd-9b57-48b4-8968-cfeaf7b0d456 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:40.179640 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad20ccd-9b57-48b4-8968-cfeaf7b0d456 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:40.179925 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad20ccd-9b57-48b4-8968-cfeaf7b0d456 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:40.181844 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0174cf-25fe-4cf2-be66-68c279fc4afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:40.183504 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0174cf-25fe-4cf2-be66-68c279fc4afe None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:40.184193 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0174cf-25fe-4cf2-be66-68c279fc4afe None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:40.184704 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0174cf-25fe-4cf2-be66-68c279fc4afe None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:40.185764 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0174cf-25fe-4cf2-be66-68c279fc4afe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:40.186300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0174cf-25fe-4cf2-be66-68c279fc4afe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:40.187984 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0174cf-25fe-4cf2-be66-68c279fc4afe None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:40.190264 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:40.197580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad20ccd-9b57-48b4-8968-cfeaf7b0d456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:51:40.200222 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 57/114] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:51:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:40.201417 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0174cf-25fe-4cf2-be66-68c279fc4afe None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:40.210642 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-1ad20ccd-9b57-48b4-8968-cfeaf7b0d456 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:51:40.210642 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:51:40.210642 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:51:40.210642 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:51:40.210642 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:51:40.210642 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:51:40.210642 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:51:40.210642 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:51:40.210642 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:51:40.210642 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:51:40.210642 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:51:40.210642 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:51:40.210642 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:51:40.210642 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:51:40.210642 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:51:40.210642 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:51:40.211722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:51:40.211722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:51:40.211722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:51:40.211722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:51:40.211722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:51:40.211722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:51:40.211722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:51:40.211722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:51:40.211722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:51:40.211722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:51:40.211722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:51:40.211722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:51:40.211722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:51:40.211722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:51:40.211722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:51:40.211722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:51:40.212502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:51:40.212502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:51:40.212502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:51:40.212502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:51:40.212502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:51:40.212502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:51:40.212502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:51:40.212502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:51:40.212502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:51:40.212502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:51:40.212502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:51:40.212502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:51:40.215055 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 58/115] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:51:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:51:40.216130 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad20ccd-9b57-48b4-8968-cfeaf7b0d456 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:40.337546 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad20ccd-9b57-48b4-8968-cfeaf7b0d456 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:40.353728 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0174cf-25fe-4cf2-be66-68c279fc4afe None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:40.386980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4c267-c2bb-4e12-8a72-34837e48213c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:40.387724 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4c267-c2bb-4e12-8a72-34837e48213c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:40.387957 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4c267-c2bb-4e12-8a72-34837e48213c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:40.388252 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4c267-c2bb-4e12-8a72-34837e48213c None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:40.389046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4c267-c2bb-4e12-8a72-34837e48213c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:40.389508 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4c267-c2bb-4e12-8a72-34837e48213c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:40.390765 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4c267-c2bb-4e12-8a72-34837e48213c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:40.399843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 59/116] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:51:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:40.400801 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4c267-c2bb-4e12-8a72-34837e48213c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:40.401678 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1812203-2429-46a4-9d09-0ecc507cad72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:40.402824 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1812203-2429-46a4-9d09-0ecc507cad72 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:40.403310 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1812203-2429-46a4-9d09-0ecc507cad72 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:40.403797 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1812203-2429-46a4-9d09-0ecc507cad72 None admin] PATH_INFO: `/v3/users/8adc91e3b100408bb77c02ef2a959cd1` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:40.405425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1812203-2429-46a4-9d09-0ecc507cad72 None admin] RBAC: Authorizing `identity:get_user(user_id=8adc91e3b100408bb77c02ef2a959cd1)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:40.406989 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1812203-2429-46a4-9d09-0ecc507cad72 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:40.408881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 58/117] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:51:40 2022] GET /identity/v3/users/8adc91e3b100408bb77c02ef2a959cd1 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:40.411475 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1812203-2429-46a4-9d09-0ecc507cad72 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:40.437966 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:40.481711 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:40.522145 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4c267-c2bb-4e12-8a72-34837e48213c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:40.527645 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1812203-2429-46a4-9d09-0ecc507cad72 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:40.562418 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b73cef-b82c-4bbd-ad9a-9b85c3eefc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:40.563091 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b73cef-b82c-4bbd-ad9a-9b85c3eefc78 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:40.563380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b73cef-b82c-4bbd-ad9a-9b85c3eefc78 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:40.563662 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b73cef-b82c-4bbd-ad9a-9b85c3eefc78 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:40.564438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b73cef-b82c-4bbd-ad9a-9b85c3eefc78 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:40.564748 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b73cef-b82c-4bbd-ad9a-9b85c3eefc78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:40.565271 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eead3d-f7f0-4023-b781-9d33f47d75c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:40.566140 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eead3d-f7f0-4023-b781-9d33f47d75c0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:40.566231 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b73cef-b82c-4bbd-ad9a-9b85c3eefc78 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:40.566455 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eead3d-f7f0-4023-b781-9d33f47d75c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:40.566745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eead3d-f7f0-4023-b781-9d33f47d75c0 None admin] PATH_INFO: `/v3/users/8adc91e3b100408bb77c02ef2a959cd1` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:40.568301 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eead3d-f7f0-4023-b781-9d33f47d75c0 None admin] RBAC: Authorizing `identity:get_user(user_id=8adc91e3b100408bb77c02ef2a959cd1)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:40.570291 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eead3d-f7f0-4023-b781-9d33f47d75c0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:40.578175 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 60/118] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:51:40 2022] GET /identity/v3/users/8adc91e3b100408bb77c02ef2a959cd1 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:40.578175 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e72b3b-92e1-4b26-a279-cbd1520b05f8 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:40.578175 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e72b3b-92e1-4b26-a279-cbd1520b05f8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:40.578175 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e72b3b-92e1-4b26-a279-cbd1520b05f8 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:40.578505 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 59/119] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 21:51:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:40.578505 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b73cef-b82c-4bbd-ad9a-9b85c3eefc78 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:40.578659 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 61/120] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:40.578659 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e72b3b-92e1-4b26-a279-cbd1520b05f8 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:40.688389 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:40.694282 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e72b3b-92e1-4b26-a279-cbd1520b05f8 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:40.696654 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b73cef-b82c-4bbd-ad9a-9b85c3eefc78 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:40.730190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:40.734783 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cdf77-38dd-43b3-8c89-110651233690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:40.735676 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cdf77-38dd-43b3-8c89-110651233690 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:40.735961 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cdf77-38dd-43b3-8c89-110651233690 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:40.736237 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cdf77-38dd-43b3-8c89-110651233690 None admin] PATH_INFO: `/v3/projects/eeea527f528b47d882789251a2058689` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:40.737630 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0cdf77-38dd-43b3-8c89-110651233690 None admin] RBAC: Authorizing `identity:get_project(project_id=eeea527f528b47d882789251a2058689)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:40.739373 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0cdf77-38dd-43b3-8c89-110651233690 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:40.740712 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952675c-6a16-4a42-81d0-22dbb383c471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:40.746435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 62/121] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:51:40 2022] GET /identity/v3/projects/eeea527f528b47d882789251a2058689 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:40.746582 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952675c-6a16-4a42-81d0-22dbb383c471 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:40.746582 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952675c-6a16-4a42-81d0-22dbb383c471 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:40.746707 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cdf77-38dd-43b3-8c89-110651233690 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:40.746771 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952675c-6a16-4a42-81d0-22dbb383c471 None admin] PATH_INFO: `/v3/users/8b8aa11a54f3466da61ca05643c14d59` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:40.747166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952675c-6a16-4a42-81d0-22dbb383c471 None admin] RBAC: Authorizing `identity:get_user(user_id=8b8aa11a54f3466da61ca05643c14d59)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:40.748575 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952675c-6a16-4a42-81d0-22dbb383c471 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:40.751072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 60/122] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:51:40 2022] GET /identity/v3/users/8b8aa11a54f3466da61ca05643c14d59 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:40.751292 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952675c-6a16-4a42-81d0-22dbb383c471 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:40.862537 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952675c-6a16-4a42-81d0-22dbb383c471 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:40.864257 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cdf77-38dd-43b3-8c89-110651233690 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:40.901751 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0537b-6975-41cb-8b92-e124ff1e3135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:40.902634 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0537b-6975-41cb-8b92-e124ff1e3135 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:40.902924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0537b-6975-41cb-8b92-e124ff1e3135 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:40.903206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0537b-6975-41cb-8b92-e124ff1e3135 None admin] PATH_INFO: `/v3/users/a65e0f21ef414ea29cd8c9c60a623330` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:40.910808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2d6a9-25e9-42ef-974d-53b9ff2eb7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:40.912005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2d6a9-25e9-42ef-974d-53b9ff2eb7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:40.912477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2d6a9-25e9-42ef-974d-53b9ff2eb7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:40.912900 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2d6a9-25e9-42ef-974d-53b9ff2eb7d8 None admin] PATH_INFO: `/v3/projects/eeea527f528b47d882789251a2058689` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:40.914352 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c2d6a9-25e9-42ef-974d-53b9ff2eb7d8 None admin] RBAC: Authorizing `identity:get_project(project_id=eeea527f528b47d882789251a2058689)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:40.916068 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c2d6a9-25e9-42ef-974d-53b9ff2eb7d8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:40.917161 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0537b-6975-41cb-8b92-e124ff1e3135 None admin] RBAC: Authorizing `identity:get_user(user_id=a65e0f21ef414ea29cd8c9c60a623330)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:40.922851 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0537b-6975-41cb-8b92-e124ff1e3135 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:40.922851 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 61/123] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:51:40 2022] GET /identity/v3/users/a65e0f21ef414ea29cd8c9c60a623330 => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:40.922851 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69f54c-311d-49ba-9ca5-1bd9589174d2 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:40.922851 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69f54c-311d-49ba-9ca5-1bd9589174d2 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:40.922851 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69f54c-311d-49ba-9ca5-1bd9589174d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:40.923380 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 63/124] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:51:40 2022] GET /identity/v3/projects/eeea527f528b47d882789251a2058689 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:40.924329 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2d6a9-25e9-42ef-974d-53b9ff2eb7d8 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:40.941633 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-9e69f54c-311d-49ba-9ca5-1bd9589174d2 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:40.942773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9e69f54c-311d-49ba-9ca5-1bd9589174d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:40.965189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:40.997741 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:41.024452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 62/125] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:41.024452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69f54c-311d-49ba-9ca5-1bd9589174d2 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:41.051880 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2d6a9-25e9-42ef-974d-53b9ff2eb7d8 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:41.087459 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfec508-1540-47ec-b393-b8362d2dfbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:41.088354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfec508-1540-47ec-b393-b8362d2dfbc2 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:41.088855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfec508-1540-47ec-b393-b8362d2dfbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:41.089149 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfec508-1540-47ec-b393-b8362d2dfbc2 None admin] PATH_INFO: `/v3/projects/eeea527f528b47d882789251a2058689/users/8adc91e3b100408bb77c02ef2a959cd1/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:41.091196 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfec508-1540-47ec-b393-b8362d2dfbc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=eeea527f528b47d882789251a2058689, user_id=8adc91e3b100408bb77c02ef2a959cd1, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:41.092726 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfec508-1540-47ec-b393-b8362d2dfbc2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:41.107936 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 64/126] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 21:51:40 2022] PUT /identity/v3/projects/eeea527f528b47d882789251a2058689/users/8adc91e3b100408bb77c02ef2a959cd1/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:51:41.108781 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfec508-1540-47ec-b393-b8362d2dfbc2 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:41.160510 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69f54c-311d-49ba-9ca5-1bd9589174d2 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:41.201558 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a51879-df9f-4994-ba69-62a05008640e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:41.202767 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a51879-df9f-4994-ba69-62a05008640e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:41.203210 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a51879-df9f-4994-ba69-62a05008640e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:41.203662 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a51879-df9f-4994-ba69-62a05008640e None admin] PATH_INFO: `/v3/projects/eeea527f528b47d882789251a2058689` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:41.206074 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a51879-df9f-4994-ba69-62a05008640e None admin] RBAC: Authorizing `identity:get_project(project_id=eeea527f528b47d882789251a2058689)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:41.208886 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a51879-df9f-4994-ba69-62a05008640e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:41.211900 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 63/127] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:51:41 2022] GET /identity/v3/projects/eeea527f528b47d882789251a2058689 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:41.214762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a51879-df9f-4994-ba69-62a05008640e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:41.232629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:41.243562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfec508-1540-47ec-b393-b8362d2dfbc2 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:41.294637 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252326f1-7747-4ce3-ab31-4a1c14bd20ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:41.295563 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252326f1-7747-4ce3-ab31-4a1c14bd20ab None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:41.295847 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252326f1-7747-4ce3-ab31-4a1c14bd20ab None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:41.296469 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252326f1-7747-4ce3-ab31-4a1c14bd20ab None admin] PATH_INFO: `/v3/projects/eeea527f528b47d882789251a2058689/users/8adc91e3b100408bb77c02ef2a959cd1/roles/3fb2a96d6ee74a7dbd046488f5ec322b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:41.298185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:41.302215 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252326f1-7747-4ce3-ab31-4a1c14bd20ab None admin] RBAC: Authorizing `identity:create_grant(project_id=eeea527f528b47d882789251a2058689, user_id=8adc91e3b100408bb77c02ef2a959cd1, role_id=3fb2a96d6ee74a7dbd046488f5ec322b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:41.305278 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252326f1-7747-4ce3-ab31-4a1c14bd20ab None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:41.326541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 65/128] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 21:51:41 2022] PUT /identity/v3/projects/eeea527f528b47d882789251a2058689/users/8adc91e3b100408bb77c02ef2a959cd1/roles/3fb2a96d6ee74a7dbd046488f5ec322b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:51:41.327906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252326f1-7747-4ce3-ab31-4a1c14bd20ab None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:41.389750 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a51879-df9f-4994-ba69-62a05008640e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:41.439414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d63437-dc14-4f81-a930-6a141091754a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:41.440140 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d63437-dc14-4f81-a930-6a141091754a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:41.440458 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d63437-dc14-4f81-a930-6a141091754a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:41.440742 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d63437-dc14-4f81-a930-6a141091754a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:41.477629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252326f1-7747-4ce3-ab31-4a1c14bd20ab None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:41.518627 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72000d01-9d30-43b4-9420-8bf61ea9fdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:41.519462 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72000d01-9d30-43b4-9420-8bf61ea9fdc0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:41.519749 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72000d01-9d30-43b4-9420-8bf61ea9fdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:41.520037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72000d01-9d30-43b4-9420-8bf61ea9fdc0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:41.525072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d63437-dc14-4f81-a930-6a141091754a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:41.527353 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d63437-dc14-4f81-a930-6a141091754a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:41.533689 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72000d01-9d30-43b4-9420-8bf61ea9fdc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:51:41.541575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-72000d01-9d30-43b4-9420-8bf61ea9fdc0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:51:41.541575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:51:41.541575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:51:41.541575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:51:41.541575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:51:41.541575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:51:41.541575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:51:41.541575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:51:41.541575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:51:41.541575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:51:41.541575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:51:41.541575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:51:41.541575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:51:41.541575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:51:41.541575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:51:41.541575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:51:41.542580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:51:41.542580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:51:41.542580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:51:41.542580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:51:41.542580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:51:41.542580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:51:41.542580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:51:41.542580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:51:41.542580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:51:41.542580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:51:41.542580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:51:41.542580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:51:41.542580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:51:41.542580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:51:41.542580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:51:41.542580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:51:41.543318 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:51:41.543318 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:51:41.543318 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:51:41.543318 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:51:41.543318 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:51:41.543318 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:51:41.543318 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:51:41.543318 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:51:41.543318 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:51:41.543318 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:51:41.543318 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:51:41.543318 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:51:41.543318 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 66/129] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:51:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:51:41.544491 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72000d01-9d30-43b4-9420-8bf61ea9fdc0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:41.563280 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:41.589475 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:41.660429 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 64/130] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:51:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:51:41.661404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d63437-dc14-4f81-a930-6a141091754a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:41.680691 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72000d01-9d30-43b4-9420-8bf61ea9fdc0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:41.757479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83c385-0f87-4c85-a323-aabdbb0083e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:41.758320 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83c385-0f87-4c85-a323-aabdbb0083e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:41.758610 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83c385-0f87-4c85-a323-aabdbb0083e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:41.758891 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83c385-0f87-4c85-a323-aabdbb0083e5 None admin] PATH_INFO: `/v3/projects/eeea527f528b47d882789251a2058689/users/8b8aa11a54f3466da61ca05643c14d59/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:41.761734 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83c385-0f87-4c85-a323-aabdbb0083e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=eeea527f528b47d882789251a2058689, user_id=8b8aa11a54f3466da61ca05643c14d59, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:41.763386 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83c385-0f87-4c85-a323-aabdbb0083e5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:41.788507 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d63437-dc14-4f81-a930-6a141091754a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:41.796623 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 67/131] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 21:51:41 2022] PUT /identity/v3/projects/eeea527f528b47d882789251a2058689/users/8b8aa11a54f3466da61ca05643c14d59/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:51:41.797854 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83c385-0f87-4c85-a323-aabdbb0083e5 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:41.842113 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24362bc-3db4-4d97-9b29-3c9c1d7285f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:41.842815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24362bc-3db4-4d97-9b29-3c9c1d7285f0 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:41.843104 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24362bc-3db4-4d97-9b29-3c9c1d7285f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:41.843384 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24362bc-3db4-4d97-9b29-3c9c1d7285f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:41.844156 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24362bc-3db4-4d97-9b29-3c9c1d7285f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:41.845360 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24362bc-3db4-4d97-9b29-3c9c1d7285f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:41.852251 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24362bc-3db4-4d97-9b29-3c9c1d7285f0 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:41.870645 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 65/132] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 21:51:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:41.878358 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24362bc-3db4-4d97-9b29-3c9c1d7285f0 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:41.910709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:41.928740 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:41.965117 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83c385-0f87-4c85-a323-aabdbb0083e5 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:42.012442 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd760bd-8798-4c4d-bfde-fa017936a3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:42.013268 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd760bd-8798-4c4d-bfde-fa017936a3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:42.013558 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd760bd-8798-4c4d-bfde-fa017936a3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:42.013837 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd760bd-8798-4c4d-bfde-fa017936a3a2 None admin] PATH_INFO: `/v3/projects/eeea527f528b47d882789251a2058689` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:42.016947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd760bd-8798-4c4d-bfde-fa017936a3a2 None admin] RBAC: Authorizing `identity:get_project(project_id=eeea527f528b47d882789251a2058689)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:42.019174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd760bd-8798-4c4d-bfde-fa017936a3a2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:42.021044 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 68/133] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:51:41 2022] GET /identity/v3/projects/eeea527f528b47d882789251a2058689 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:42.027279 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd760bd-8798-4c4d-bfde-fa017936a3a2 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:42.109414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24362bc-3db4-4d97-9b29-3c9c1d7285f0 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:42.143228 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd760bd-8798-4c4d-bfde-fa017936a3a2 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:42.174740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71deeda2-af95-4f8c-b814-8d620c824867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:42.175751 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71deeda2-af95-4f8c-b814-8d620c824867 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:42.176050 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71deeda2-af95-4f8c-b814-8d620c824867 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:42.176332 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71deeda2-af95-4f8c-b814-8d620c824867 None admin] PATH_INFO: `/v3/users/8adc91e3b100408bb77c02ef2a959cd1` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:42.177687 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71deeda2-af95-4f8c-b814-8d620c824867 None admin] RBAC: Authorizing `identity:get_user(user_id=8adc91e3b100408bb77c02ef2a959cd1)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:42.179352 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71deeda2-af95-4f8c-b814-8d620c824867 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:42.181207 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 66/134] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:51:41 2022] GET /identity/v3/users/8adc91e3b100408bb77c02ef2a959cd1 => generated 275 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:42.181406 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3db047-923b-4284-9085-356f59d51d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:42.182029 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3db047-923b-4284-9085-356f59d51d22 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:42.182945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3db047-923b-4284-9085-356f59d51d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:42.183230 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3db047-923b-4284-9085-356f59d51d22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:42.184273 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3db047-923b-4284-9085-356f59d51d22 None admin] RBAC: Adding query filter params (role.id=c6035635160b420194220cbe44e1abb9, scope.project.id=eeea527f528b47d882789251a2058689, user.id=a65e0f21ef414ea29cd8c9c60a623330) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:42.184624 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3db047-923b-4284-9085-356f59d51d22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:42.186615 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3db047-923b-4284-9085-356f59d51d22 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:42.187981 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71deeda2-af95-4f8c-b814-8d620c824867 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:42.195152 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 69/135] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:51:42 2022] GET /identity/v3/role_assignments?user.id=a65e0f21ef414ea29cd8c9c60a623330&scope.project.id=eeea527f528b47d882789251a2058689&role.id=c6035635160b420194220cbe44e1abb9 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:51:42.212725 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e906d01-efac-42d3-a75c-2e0337a92682 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:42.213098 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e906d01-efac-42d3-a75c-2e0337a92682 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:42.213298 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e906d01-efac-42d3-a75c-2e0337a92682 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:42.215374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 70/136] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:51:42.224849 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b08184-bf58-40ca-8e4e-06fc2b8b86e4 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:42.225146 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b08184-bf58-40ca-8e4e-06fc2b8b86e4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:42.225419 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b08184-bf58-40ca-8e4e-06fc2b8b86e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:42.249377 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:42.259019 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-88b08184-bf58-40ca-8e4e-06fc2b8b86e4 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:42.260257 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-88b08184-bf58-40ca-8e4e-06fc2b8b86e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:42.355287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:42.393458 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71deeda2-af95-4f8c-b814-8d620c824867 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:42.439723 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 71/137] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:42.459097 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992aee0-0e78-4f0d-a8d4-59f2dcd16a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:42.459993 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992aee0-0e78-4f0d-a8d4-59f2dcd16a5a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:42.460281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992aee0-0e78-4f0d-a8d4-59f2dcd16a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:42.460586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992aee0-0e78-4f0d-a8d4-59f2dcd16a5a None admin] PATH_INFO: `/v3/projects/066c3bcd7d4d4cd9ac4093ccb3add8e4` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:42.465259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992aee0-0e78-4f0d-a8d4-59f2dcd16a5a None admin] RBAC: Authorizing `identity:get_project(project_id=066c3bcd7d4d4cd9ac4093ccb3add8e4)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:42.466811 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992aee0-0e78-4f0d-a8d4-59f2dcd16a5a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:42.468884 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 67/138] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:51:42 2022] GET /identity/v3/projects/066c3bcd7d4d4cd9ac4093ccb3add8e4 => generated 312 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:51:42.469222 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b08184-bf58-40ca-8e4e-06fc2b8b86e4 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:42.477693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992aee0-0e78-4f0d-a8d4-59f2dcd16a5a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:42.681140 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b08184-bf58-40ca-8e4e-06fc2b8b86e4 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:42.715340 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992aee0-0e78-4f0d-a8d4-59f2dcd16a5a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:42.747364 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3bab3-aff7-44ed-8953-b2fbf1e69c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:42.748535 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3bab3-aff7-44ed-8953-b2fbf1e69c4a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:42.749015 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3bab3-aff7-44ed-8953-b2fbf1e69c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:42.749457 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3bab3-aff7-44ed-8953-b2fbf1e69c4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:42.752954 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb3bab3-aff7-44ed-8953-b2fbf1e69c4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:42.754662 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb3bab3-aff7-44ed-8953-b2fbf1e69c4a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:42.763277 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 72/139] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:51:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:51:42.773359 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3bab3-aff7-44ed-8953-b2fbf1e69c4a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:42.780431 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:42.796786 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b881178-408d-4b0f-84e8-37ff346cd90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:42.796786 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b881178-408d-4b0f-84e8-37ff346cd90b None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:42.796786 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b881178-408d-4b0f-84e8-37ff346cd90b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:42.796786 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b881178-408d-4b0f-84e8-37ff346cd90b None admin] PATH_INFO: `/v3/projects/066c3bcd7d4d4cd9ac4093ccb3add8e4/users/8adc91e3b100408bb77c02ef2a959cd1/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:42.797497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b881178-408d-4b0f-84e8-37ff346cd90b None admin] RBAC: Authorizing `identity:create_grant(project_id=066c3bcd7d4d4cd9ac4093ccb3add8e4, user_id=8adc91e3b100408bb77c02ef2a959cd1, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:42.800427 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b881178-408d-4b0f-84e8-37ff346cd90b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:42.844647 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 68/140] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 21:51:42 2022] PUT /identity/v3/projects/066c3bcd7d4d4cd9ac4093ccb3add8e4/users/8adc91e3b100408bb77c02ef2a959cd1/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:51:42.941020 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3bab3-aff7-44ed-8953-b2fbf1e69c4a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:42.991803 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2a2e6-94d7-4c4f-b1a4-2db1cb3224cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:42.992584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2a2e6-94d7-4c4f-b1a4-2db1cb3224cd None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:42.992873 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2a2e6-94d7-4c4f-b1a4-2db1cb3224cd None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:42.993157 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2a2e6-94d7-4c4f-b1a4-2db1cb3224cd None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:42.993960 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2a2e6-94d7-4c4f-b1a4-2db1cb3224cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:42.996016 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2a2e6-94d7-4c4f-b1a4-2db1cb3224cd None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:43.030820 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 73/141] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 21:51:42 2022] POST /identity/v3/users => generated 283 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:51:44.431893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ed7f4-1210-4234-8694-1ab8d87cb447 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:44.433078 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ed7f4-1210-4234-8694-1ab8d87cb447 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:44.433230 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ed7f4-1210-4234-8694-1ab8d87cb447 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:44.434842 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 69/142] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:44.440419 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b678e-9bc8-403a-9044-27bfb2880cfe None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:44.441360 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b678e-9bc8-403a-9044-27bfb2880cfe None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:44.441829 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b678e-9bc8-403a-9044-27bfb2880cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:44.459837 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-138b678e-9bc8-403a-9044-27bfb2880cfe None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:44.461070 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-138b678e-9bc8-403a-9044-27bfb2880cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:44.536182 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:44.550642 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 74/143] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:44.590824 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e9bd6-343c-4429-952c-5cba1e45c528 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:44.591175 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e9bd6-343c-4429-952c-5cba1e45c528 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:44.591418 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e9bd6-343c-4429-952c-5cba1e45c528 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:44.592926 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 70/144] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:44.594012 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b678e-9bc8-403a-9044-27bfb2880cfe None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:44.600226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a92ed-9ce4-4119-a945-66575c6369df None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:44.600541 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a92ed-9ce4-4119-a945-66575c6369df None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:44.600825 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a92ed-9ce4-4119-a945-66575c6369df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:44.634861 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-226a92ed-9ce4-4119-a945-66575c6369df None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:44.636157 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-226a92ed-9ce4-4119-a945-66575c6369df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:44.638451 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:44.805103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 71/145] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:51:44.830049 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b678e-9bc8-403a-9044-27bfb2880cfe None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:44.837417 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a92ed-9ce4-4119-a945-66575c6369df None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:44.892500 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2f9ab-adbb-43f5-95a3-aef9ceaba9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:44.893648 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2f9ab-adbb-43f5-95a3-aef9ceaba9cc None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:44.894140 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2f9ab-adbb-43f5-95a3-aef9ceaba9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:44.894727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2f9ab-adbb-43f5-95a3-aef9ceaba9cc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:44.916109 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2f9ab-adbb-43f5-95a3-aef9ceaba9cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:51:44.926039 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-e6b2f9ab-adbb-43f5-95a3-aef9ceaba9cc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:51:44.926039 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:51:44.926039 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:51:44.926039 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:51:44.926039 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:51:44.926039 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:51:44.926039 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:51:44.926039 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:51:44.926039 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:51:44.926039 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:51:44.926039 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:51:44.926039 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:51:44.926039 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:51:44.926039 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:51:44.926039 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:51:44.926039 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:51:44.926916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:51:44.926916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:51:44.926916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:51:44.926916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:51:44.926916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:51:44.926916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:51:44.926916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:51:44.926916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:51:44.926916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:51:44.926916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:51:44.926916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:51:44.926916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:51:44.926916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:51:44.926916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:51:44.926916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:51:44.926916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:51:44.927653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:51:44.927653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:51:44.927653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:51:44.927653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:51:44.927653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:51:44.927653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:51:44.927653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:51:44.927653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:51:44.927653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:51:44.927653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:51:44.927653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:51:44.927653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:51:44.930435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 75/146] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 21:51:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:51:44.936337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2f9ab-adbb-43f5-95a3-aef9ceaba9cc None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:45.025053 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:45.063547 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a92ed-9ce4-4119-a945-66575c6369df None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:45.094843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2f9ab-adbb-43f5-95a3-aef9ceaba9cc None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:45.162484 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e41fb-1578-4276-9883-4550061b167b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:45.163571 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e41fb-1578-4276-9883-4550061b167b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:45.164094 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e41fb-1578-4276-9883-4550061b167b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:45.164614 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e41fb-1578-4276-9883-4550061b167b None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:45.165830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e41fb-1578-4276-9883-4550061b167b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:45.166429 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e41fb-1578-4276-9883-4550061b167b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:45.168377 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e41fb-1578-4276-9883-4550061b167b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:45.176253 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd1193-7201-4eaa-b929-f2c6b35c7a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:45.177101 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd1193-7201-4eaa-b929-f2c6b35c7a65 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:45.177387 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd1193-7201-4eaa-b929-f2c6b35c7a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:45.177668 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd1193-7201-4eaa-b929-f2c6b35c7a65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:45.187643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 76/147] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:51:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:51:45.189037 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:45.193539 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e41fb-1578-4276-9883-4550061b167b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:45.193795 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd1193-7201-4eaa-b929-f2c6b35c7a65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:51:45.206879 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-abbd1193-7201-4eaa-b929-f2c6b35c7a65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:51:45.206879 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:51:45.206879 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:51:45.206879 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:51:45.206879 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:51:45.206879 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:51:45.206879 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:51:45.206879 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:51:45.206879 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:51:45.206879 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:51:45.206879 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:51:45.206879 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:51:45.206879 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:51:45.206879 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:51:45.206879 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:51:45.206879 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:51:45.207752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:51:45.207752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:51:45.207752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:51:45.207752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:51:45.207752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:51:45.207752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:51:45.207752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:51:45.207752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:51:45.207752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:51:45.207752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:51:45.207752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:51:45.207752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:51:45.207752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:51:45.207752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:51:45.207752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:51:45.207752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:51:45.208502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:51:45.208502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:51:45.208502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:51:45.208502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:51:45.208502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:51:45.208502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:51:45.208502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:51:45.208502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:51:45.208502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:51:45.208502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:51:45.208502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:51:45.208502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:51:45.210876 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 72/148] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:51:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:51:45.217713 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd1193-7201-4eaa-b929-f2c6b35c7a65 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:45.358374 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd1193-7201-4eaa-b929-f2c6b35c7a65 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:45.404100 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642363c0-a728-4768-b1a0-d3eb87f6ea72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:45.405292 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642363c0-a728-4768-b1a0-d3eb87f6ea72 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:45.405877 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642363c0-a728-4768-b1a0-d3eb87f6ea72 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:45.406362 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642363c0-a728-4768-b1a0-d3eb87f6ea72 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:45.407393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642363c0-a728-4768-b1a0-d3eb87f6ea72 None admin] RBAC: Adding query filter params (name=member) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:45.407975 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642363c0-a728-4768-b1a0-d3eb87f6ea72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:45.409613 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642363c0-a728-4768-b1a0-d3eb87f6ea72 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:45.419747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 73/149] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 21:51:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:51:45.425478 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642363c0-a728-4768-b1a0-d3eb87f6ea72 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:45.463541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e41fb-1578-4276-9883-4550061b167b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:45.483221 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:45.504793 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:45.529254 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4e57f-6072-4efa-b9bb-ad507b248ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:45.530175 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4e57f-6072-4efa-b9bb-ad507b248ead None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:45.530460 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4e57f-6072-4efa-b9bb-ad507b248ead None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:45.530735 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4e57f-6072-4efa-b9bb-ad507b248ead None admin] PATH_INFO: `/v3/users/8adc91e3b100408bb77c02ef2a959cd1` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:45.532129 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4e57f-6072-4efa-b9bb-ad507b248ead None admin] RBAC: Authorizing `identity:get_user(user_id=8adc91e3b100408bb77c02ef2a959cd1)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:45.533614 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4e57f-6072-4efa-b9bb-ad507b248ead None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:45.537337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 77/150] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:51:45 2022] GET /identity/v3/users/8adc91e3b100408bb77c02ef2a959cd1 => generated 275 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:51:45.538610 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa87040-f069-419c-950a-9956c8528477 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:45.539386 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa87040-f069-419c-950a-9956c8528477 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:45.539670 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa87040-f069-419c-950a-9956c8528477 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:45.544824 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642363c0-a728-4768-b1a0-d3eb87f6ea72 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:45.544982 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 78/151] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:45.545846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa87040-f069-419c-950a-9956c8528477 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:45.582247 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd57279-07e4-4d94-98b1-a371711fb053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:45.583534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd57279-07e4-4d94-98b1-a371711fb053 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:45.584081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd57279-07e4-4d94-98b1-a371711fb053 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:45.584635 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd57279-07e4-4d94-98b1-a371711fb053 None admin] PATH_INFO: `/v3/users/8adc91e3b100408bb77c02ef2a959cd1` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:45.586253 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd57279-07e4-4d94-98b1-a371711fb053 None admin] RBAC: Authorizing `identity:get_user(user_id=8adc91e3b100408bb77c02ef2a959cd1)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:45.587974 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd57279-07e4-4d94-98b1-a371711fb053 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:45.590207 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 74/152] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:51:45 2022] GET /identity/v3/users/8adc91e3b100408bb77c02ef2a959cd1 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:45.591890 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f173435-62c9-4159-8532-09996ed14963 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:45.592438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f173435-62c9-4159-8532-09996ed14963 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:45.592909 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f173435-62c9-4159-8532-09996ed14963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:45.612236 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4f173435-62c9-4159-8532-09996ed14963 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:45.614060 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4f173435-62c9-4159-8532-09996ed14963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:45.687643 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 75/153] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:45.688915 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f173435-62c9-4159-8532-09996ed14963 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:45.733095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa87040-f069-419c-950a-9956c8528477 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:45.771868 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:45.800806 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f173435-62c9-4159-8532-09996ed14963 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:45.805290 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747ab14-8699-4ee6-a1f0-9fb88c89feb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:45.805977 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747ab14-8699-4ee6-a1f0-9fb88c89feb0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:45.806268 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747ab14-8699-4ee6-a1f0-9fb88c89feb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:45.806547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747ab14-8699-4ee6-a1f0-9fb88c89feb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:45.841820 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe194d-f229-4fce-8c09-330a9dcb7cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:45.842890 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe194d-f229-4fce-8c09-330a9dcb7cec None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:45.843422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe194d-f229-4fce-8c09-330a9dcb7cec None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:45.843924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe194d-f229-4fce-8c09-330a9dcb7cec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:45.916930 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:45.944734 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe194d-f229-4fce-8c09-330a9dcb7cec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:45.947236 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe194d-f229-4fce-8c09-330a9dcb7cec None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:45.991529 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747ab14-8699-4ee6-a1f0-9fb88c89feb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:45.993062 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747ab14-8699-4ee6-a1f0-9fb88c89feb0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:46.023102 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:46.087142 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 76/154] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:51:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:51:46.088335 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe194d-f229-4fce-8c09-330a9dcb7cec None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:46.242371 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe194d-f229-4fce-8c09-330a9dcb7cec None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:46.291281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239cfa5-a9f9-4ed4-ad91-bcbbbb71ed1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:46.292578 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239cfa5-a9f9-4ed4-ad91-bcbbbb71ed1d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:46.293069 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239cfa5-a9f9-4ed4-ad91-bcbbbb71ed1d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:46.293727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239cfa5-a9f9-4ed4-ad91-bcbbbb71ed1d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:46.306007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239cfa5-a9f9-4ed4-ad91-bcbbbb71ed1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:51:46.332709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-1239cfa5-a9f9-4ed4-ad91-bcbbbb71ed1d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:51:46.332709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:51:46.332709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:51:46.332709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:51:46.332709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:51:46.332709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:51:46.332709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:51:46.332709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:51:46.332709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:51:46.332709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:51:46.332709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:51:46.332709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:51:46.332709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:51:46.332709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:51:46.332709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:51:46.332709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:51:46.333763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:51:46.333763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:51:46.333763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:51:46.333763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:51:46.333763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:51:46.333763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:51:46.333763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:51:46.333763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:51:46.333763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:51:46.333763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:51:46.333763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:51:46.333763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:51:46.333763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:51:46.333763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:51:46.333763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:51:46.333763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:51:46.334590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:51:46.334590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:51:46.334590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:51:46.334590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:51:46.334590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:51:46.334590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:51:46.334590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:51:46.334590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:51:46.334590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:51:46.334590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:51:46.334590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:51:46.334590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:51:46.343401 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 77/155] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:51:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:51:46.345091 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239cfa5-a9f9-4ed4-ad91-bcbbbb71ed1d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:46.359187 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 79/156] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:51:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 814 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:51:46.360742 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a312b-c895-4a54-b14b-7c61b950368e None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:46.361011 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a312b-c895-4a54-b14b-7c61b950368e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:46.361291 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a312b-c895-4a54-b14b-7c61b950368e None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:46.376185 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 80/157] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:46.376185 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a312b-c895-4a54-b14b-7c61b950368e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:46.400449 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:46.540008 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239cfa5-a9f9-4ed4-ad91-bcbbbb71ed1d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:46.617754 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adeca4-3e76-4371-ba12-6ec3f4c5e52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:46.619023 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adeca4-3e76-4371-ba12-6ec3f4c5e52d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:46.620259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adeca4-3e76-4371-ba12-6ec3f4c5e52d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:46.621115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adeca4-3e76-4371-ba12-6ec3f4c5e52d None admin] PATH_INFO: `/v3/projects/eeea527f528b47d882789251a2058689` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:46.631111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65adeca4-3e76-4371-ba12-6ec3f4c5e52d None admin] RBAC: Authorizing `identity:get_project(project_id=eeea527f528b47d882789251a2058689)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:46.633064 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65adeca4-3e76-4371-ba12-6ec3f4c5e52d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:46.635391 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 78/158] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:51:46 2022] GET /identity/v3/projects/eeea527f528b47d882789251a2058689 => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:46.637380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adeca4-3e76-4371-ba12-6ec3f4c5e52d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:46.716913 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:46.754871 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a312b-c895-4a54-b14b-7c61b950368e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:46.827175 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908bc811-2e4b-4eb6-aeb3-5cc8e429c8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:46.827438 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bc811-2e4b-4eb6-aeb3-5cc8e429c8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:46.827570 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bc811-2e4b-4eb6-aeb3-5cc8e429c8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:46.827904 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bc811-2e4b-4eb6-aeb3-5cc8e429c8e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:46.828685 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908bc811-2e4b-4eb6-aeb3-5cc8e429c8e5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:46.828994 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908bc811-2e4b-4eb6-aeb3-5cc8e429c8e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:46.830437 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908bc811-2e4b-4eb6-aeb3-5cc8e429c8e5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:46.839551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:46.852437 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 81/159] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 21:51:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 486 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:46.852437 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a01c7-7c9e-4e5e-b447-6ece71fa45fd None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:46.852437 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a01c7-7c9e-4e5e-b447-6ece71fa45fd None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:46.852437 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a01c7-7c9e-4e5e-b447-6ece71fa45fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:46.886361 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-830a01c7-7c9e-4e5e-b447-6ece71fa45fd None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:46.887942 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-830a01c7-7c9e-4e5e-b447-6ece71fa45fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:46.897853 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adeca4-3e76-4371-ba12-6ec3f4c5e52d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:46.992733 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7198882-d5d3-477d-a96a-d8d9cb8e3207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:46.994392 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7198882-d5d3-477d-a96a-d8d9cb8e3207 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:46.995083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7198882-d5d3-477d-a96a-d8d9cb8e3207 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:46.995607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7198882-d5d3-477d-a96a-d8d9cb8e3207 None admin] PATH_INFO: `/v3/projects/eeea527f528b47d882789251a2058689` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:46.998777 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7198882-d5d3-477d-a96a-d8d9cb8e3207 None admin] RBAC: Authorizing `identity:get_project(project_id=eeea527f528b47d882789251a2058689)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:47.001394 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7198882-d5d3-477d-a96a-d8d9cb8e3207 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:47.005084 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 79/160] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:51:46 2022] GET /identity/v3/projects/eeea527f528b47d882789251a2058689 => generated 298 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:47.006638 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7198882-d5d3-477d-a96a-d8d9cb8e3207 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:47.065071 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 82/161] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:47.065957 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a01c7-7c9e-4e5e-b447-6ece71fa45fd None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:47.238224 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:47.260028 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7198882-d5d3-477d-a96a-d8d9cb8e3207 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:47.319574 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a01c7-7c9e-4e5e-b447-6ece71fa45fd None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:47.335349 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d291080-dbda-4564-a891-571914dabf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:47.336289 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d291080-dbda-4564-a891-571914dabf8f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:47.336735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d291080-dbda-4564-a891-571914dabf8f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:47.337154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d291080-dbda-4564-a891-571914dabf8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:47.340773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d291080-dbda-4564-a891-571914dabf8f None admin] RBAC: Adding query filter params (role.id=4749055b54a542b29f57155df3756136, scope.project.id=eeea527f528b47d882789251a2058689, user.id=8adc91e3b100408bb77c02ef2a959cd1) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:47.341279 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d291080-dbda-4564-a891-571914dabf8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:47.342961 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d291080-dbda-4564-a891-571914dabf8f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:47.350322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 80/162] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:51:47 2022] GET /identity/v3/role_assignments?user.id=8adc91e3b100408bb77c02ef2a959cd1&scope.project.id=eeea527f528b47d882789251a2058689&role.id=4749055b54a542b29f57155df3756136 => generated 608 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:47.351691 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d291080-dbda-4564-a891-571914dabf8f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:47.379273 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:47.402584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738af056-68e3-4cad-a48d-c5ac09ac2866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:47.404866 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738af056-68e3-4cad-a48d-c5ac09ac2866 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:47.405165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738af056-68e3-4cad-a48d-c5ac09ac2866 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:47.405409 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738af056-68e3-4cad-a48d-c5ac09ac2866 None admin] PATH_INFO: `/v3/users/a65e0f21ef414ea29cd8c9c60a623330` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:47.407731 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738af056-68e3-4cad-a48d-c5ac09ac2866 None admin] RBAC: Authorizing `identity:get_user(user_id=a65e0f21ef414ea29cd8c9c60a623330)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:47.411960 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738af056-68e3-4cad-a48d-c5ac09ac2866 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:47.414896 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 83/163] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:51:47 2022] GET /identity/v3/users/a65e0f21ef414ea29cd8c9c60a623330 => generated 289 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:47.425686 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd599762-28bf-4109-ab99-c61a77ce00dc None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:47.426078 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd599762-28bf-4109-ab99-c61a77ce00dc None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:47.426244 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd599762-28bf-4109-ab99-c61a77ce00dc None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:47.432875 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 84/164] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:47 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:47.434113 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd599762-28bf-4109-ab99-c61a77ce00dc None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:47.551942 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d291080-dbda-4564-a891-571914dabf8f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:47.645515 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f075b-994e-4150-9ea3-4315c6f595a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:47.646214 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f075b-994e-4150-9ea3-4315c6f595a3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:47.646505 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f075b-994e-4150-9ea3-4315c6f595a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:47.646787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f075b-994e-4150-9ea3-4315c6f595a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:47.647667 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f075b-994e-4150-9ea3-4315c6f595a3 None admin] RBAC: Adding query filter params (role.id=3fb2a96d6ee74a7dbd046488f5ec322b, scope.project.id=eeea527f528b47d882789251a2058689, user.id=8adc91e3b100408bb77c02ef2a959cd1) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:47.647989 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f075b-994e-4150-9ea3-4315c6f595a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:47.658530 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f075b-994e-4150-9ea3-4315c6f595a3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:47.675921 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 81/165] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:51:47 2022] GET /identity/v3/role_assignments?user.id=8adc91e3b100408bb77c02ef2a959cd1&scope.project.id=eeea527f528b47d882789251a2058689&role.id=3fb2a96d6ee74a7dbd046488f5ec322b => generated 608 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:47.681469 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f075b-994e-4150-9ea3-4315c6f595a3 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:47.698427 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd599762-28bf-4109-ab99-c61a77ce00dc None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:47.795638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ed24b-7ecb-4635-90d4-ff4951678bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:47.797336 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ed24b-7ecb-4635-90d4-ff4951678bbd None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:47.797838 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ed24b-7ecb-4635-90d4-ff4951678bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:47.798309 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ed24b-7ecb-4635-90d4-ff4951678bbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:47.816520 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:47.820887 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ed24b-7ecb-4635-90d4-ff4951678bbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:51:47.834439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-9d9ed24b-7ecb-4635-90d4-ff4951678bbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:51:47.834439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:51:47.834439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:51:47.834439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:51:47.834439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:51:47.834439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:51:47.834439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:51:47.834439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:51:47.834439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:51:47.834439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:51:47.834439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:51:47.834439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:51:47.834439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:51:47.834439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:51:47.834439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:51:47.834439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:51:47.835360 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:51:47.835360 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:51:47.835360 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:51:47.835360 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:51:47.835360 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:51:47.835360 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:51:47.835360 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:51:47.835360 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:51:47.835360 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:51:47.835360 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:51:47.835360 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:51:47.835360 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:51:47.835360 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:51:47.835360 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:51:47.835360 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:51:47.835360 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:51:47.836339 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:51:47.836339 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:51:47.836339 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:51:47.836339 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:51:47.836339 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:51:47.836339 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:51:47.836339 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:51:47.836339 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:51:47.836339 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:51:47.836339 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:51:47.836339 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:51:47.836339 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:51:47.838952 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 85/166] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:51:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:51:47.840544 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f857214-6293-4ad2-86e9-f4bd5c90a2b7 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:47.841056 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f857214-6293-4ad2-86e9-f4bd5c90a2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:47.841529 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f857214-6293-4ad2-86e9-f4bd5c90a2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:47.866702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1f857214-6293-4ad2-86e9-f4bd5c90a2b7 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:47.868303 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1f857214-6293-4ad2-86e9-f4bd5c90a2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:47.872819 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:47.910478 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f075b-994e-4150-9ea3-4315c6f595a3 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:47.969092 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 86/167] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:47.969737 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f857214-6293-4ad2-86e9-f4bd5c90a2b7 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:47.998154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38dc94-5192-4d4b-9b42-5c6649118873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:47.999056 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38dc94-5192-4d4b-9b42-5c6649118873 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:47.999344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38dc94-5192-4d4b-9b42-5c6649118873 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:47.999623 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38dc94-5192-4d4b-9b42-5c6649118873 None admin] PATH_INFO: `/v3/projects/eeea527f528b47d882789251a2058689` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:48.000960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38dc94-5192-4d4b-9b42-5c6649118873 None admin] RBAC: Authorizing `identity:get_project(project_id=eeea527f528b47d882789251a2058689)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:48.002545 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38dc94-5192-4d4b-9b42-5c6649118873 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:48.004468 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 82/168] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:51:47 2022] GET /identity/v3/projects/eeea527f528b47d882789251a2058689 => generated 298 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:48.005725 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72902f-d1ee-4238-928d-ae6a5ba82484 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:48.006015 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72902f-d1ee-4238-928d-ae6a5ba82484 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:48.006297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72902f-d1ee-4238-928d-ae6a5ba82484 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:48.007764 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 83/169] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:48.015357 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72902f-d1ee-4238-928d-ae6a5ba82484 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:48.121381 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f857214-6293-4ad2-86e9-f4bd5c90a2b7 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:48.139386 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72902f-d1ee-4238-928d-ae6a5ba82484 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:48.153873 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:48.167093 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ececd2-bde7-4e54-9978-5557fbc00d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:48.167796 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ececd2-bde7-4e54-9978-5557fbc00d3e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:48.168070 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ececd2-bde7-4e54-9978-5557fbc00d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:48.168346 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ececd2-bde7-4e54-9978-5557fbc00d3e None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:48.169166 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ececd2-bde7-4e54-9978-5557fbc00d3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:48.169453 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ececd2-bde7-4e54-9978-5557fbc00d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:48.170849 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ececd2-bde7-4e54-9978-5557fbc00d3e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:48.178577 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ffedb-6f77-480b-ac17-3bb8a83aa092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:48.180137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ffedb-6f77-480b-ac17-3bb8a83aa092 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:48.180546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ffedb-6f77-480b-ac17-3bb8a83aa092 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:48.180782 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ffedb-6f77-480b-ac17-3bb8a83aa092 None admin] PATH_INFO: `/v3/projects/eeea527f528b47d882789251a2058689/users/a65e0f21ef414ea29cd8c9c60a623330/roles/c6035635160b420194220cbe44e1abb9` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:48.184130 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ffedb-6f77-480b-ac17-3bb8a83aa092 None admin] RBAC: Authorizing `identity:create_grant(project_id=eeea527f528b47d882789251a2058689, user_id=a65e0f21ef414ea29cd8c9c60a623330, role_id=c6035635160b420194220cbe44e1abb9)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:48.185731 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ffedb-6f77-480b-ac17-3bb8a83aa092 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:48.186524 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 87/170] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:51:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:48.189633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdd20f-54c7-49e9-960c-35a6e7783714 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:48.190317 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdd20f-54c7-49e9-960c-35a6e7783714 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:48.190756 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdd20f-54c7-49e9-960c-35a6e7783714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:48.211288 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 84/171] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 21:51:48 2022] PUT /identity/v3/projects/eeea527f528b47d882789251a2058689/users/a65e0f21ef414ea29cd8c9c60a623330/roles/c6035635160b420194220cbe44e1abb9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:51:48.212202 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ffedb-6f77-480b-ac17-3bb8a83aa092 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:48.215022 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-49fdd20f-54c7-49e9-960c-35a6e7783714 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:48.216396 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-49fdd20f-54c7-49e9-960c-35a6e7783714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:48.240091 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:48.310762 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 88/172] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:48.312419 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fdd20f-54c7-49e9-960c-35a6e7783714 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:48.366037 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ffedb-6f77-480b-ac17-3bb8a83aa092 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:48.454900 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6dbb1-df54-469c-a33e-3a9743372c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:48.456397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6dbb1-df54-469c-a33e-3a9743372c9f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:48.459019 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6dbb1-df54-469c-a33e-3a9743372c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:48.459563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6dbb1-df54-469c-a33e-3a9743372c9f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:48.484611 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6dbb1-df54-469c-a33e-3a9743372c9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:51:48.501171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-4af6dbb1-df54-469c-a33e-3a9743372c9f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:51:48.501171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:51:48.501171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:51:48.501171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:51:48.501171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:51:48.501171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:51:48.501171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:51:48.501171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:51:48.501171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:51:48.501171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:51:48.501171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:51:48.501171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:51:48.501171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:51:48.501171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:51:48.501171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:51:48.501171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:51:48.502137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:51:48.502137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:51:48.502137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:51:48.502137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:51:48.502137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:51:48.502137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:51:48.502137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:51:48.502137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:51:48.502137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:51:48.502137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:51:48.502137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:51:48.502137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:51:48.502137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:51:48.502137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:51:48.502137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:51:48.502137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:51:48.502930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:51:48.502930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:51:48.502930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:51:48.502930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:51:48.502930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:51:48.502930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:51:48.502930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:51:48.502930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:51:48.502930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:51:48.502930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:51:48.502930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:51:48.502930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:51:48.505760 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 85/173] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:51:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:51:48.506177 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6dbb1-df54-469c-a33e-3a9743372c9f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:48.530660 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fdd20f-54c7-49e9-960c-35a6e7783714 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:48.559164 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:48.574800 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77860f-4bb0-4a5f-8d3e-054ee0426dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:48.576132 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77860f-4bb0-4a5f-8d3e-054ee0426dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:48.576681 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77860f-4bb0-4a5f-8d3e-054ee0426dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:48.577183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77860f-4bb0-4a5f-8d3e-054ee0426dd5 None admin] PATH_INFO: `/v3/users/8b8aa11a54f3466da61ca05643c14d59` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:48.578753 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77860f-4bb0-4a5f-8d3e-054ee0426dd5 None admin] RBAC: Authorizing `identity:get_user(user_id=8b8aa11a54f3466da61ca05643c14d59)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:48.580527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77860f-4bb0-4a5f-8d3e-054ee0426dd5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:48.582817 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 89/174] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:51:48 2022] GET /identity/v3/users/8b8aa11a54f3466da61ca05643c14d59 => generated 247 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:48.584333 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2edba-f35b-431f-be4d-9802ddc44d96 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:48.584945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2edba-f35b-431f-be4d-9802ddc44d96 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:48.585422 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2edba-f35b-431f-be4d-9802ddc44d96 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:48.587189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 90/175] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:48.588226 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2edba-f35b-431f-be4d-9802ddc44d96 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:48.592491 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:48.628333 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6dbb1-df54-469c-a33e-3a9743372c9f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:48.666260 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565781e-6e41-4690-9a32-ca2602de8dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:48.667607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565781e-6e41-4690-9a32-ca2602de8dbc None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:48.668138 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565781e-6e41-4690-9a32-ca2602de8dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:48.668436 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565781e-6e41-4690-9a32-ca2602de8dbc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:48.680219 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565781e-6e41-4690-9a32-ca2602de8dbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:51:48.688863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-e565781e-6e41-4690-9a32-ca2602de8dbc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:51:48.688863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:51:48.688863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:51:48.688863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:51:48.688863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:51:48.688863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:51:48.688863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:51:48.688863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:51:48.688863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:51:48.688863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:51:48.688863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:51:48.688863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:51:48.688863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:51:48.688863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:51:48.688863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:51:48.688863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:51:48.689781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:51:48.689781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:51:48.689781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:51:48.689781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:51:48.689781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:51:48.689781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:51:48.689781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:51:48.689781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:51:48.689781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:51:48.689781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:51:48.689781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:51:48.689781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:51:48.689781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:51:48.689781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:51:48.689781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:51:48.689781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:51:48.690524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:51:48.690524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:51:48.690524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:51:48.690524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:51:48.690524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:51:48.690524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:51:48.690524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:51:48.690524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:51:48.690524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:51:48.690524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:51:48.690524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:51:48.690524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:51:48.690524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 86/176] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:51:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:51:48.691165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565781e-6e41-4690-9a32-ca2602de8dbc None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:48.712883 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2edba-f35b-431f-be4d-9802ddc44d96 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:48.754719 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f91dcb-f5fe-40dd-a584-e1f1a3e58383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:48.756488 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f91dcb-f5fe-40dd-a584-e1f1a3e58383 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:48.757007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f91dcb-f5fe-40dd-a584-e1f1a3e58383 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:48.757747 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f91dcb-f5fe-40dd-a584-e1f1a3e58383 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:48.759271 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f91dcb-f5fe-40dd-a584-e1f1a3e58383 None admin] RBAC: Adding query filter params (name=member) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:48.759894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f91dcb-f5fe-40dd-a584-e1f1a3e58383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:48.762252 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f91dcb-f5fe-40dd-a584-e1f1a3e58383 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:48.774833 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 91/177] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 21:51:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:48.776935 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4baa93-6b8e-4c89-bd5d-49d41dafa751 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:48.778164 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4baa93-6b8e-4c89-bd5d-49d41dafa751 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:48.778652 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4baa93-6b8e-4c89-bd5d-49d41dafa751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:48.798582 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-ae4baa93-6b8e-4c89-bd5d-49d41dafa751 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:48.799698 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ae4baa93-6b8e-4c89-bd5d-49d41dafa751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:48.812458 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565781e-6e41-4690-9a32-ca2602de8dbc None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:48.846194 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:48.851111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:48.853850 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c93ac-a9be-4913-84e3-ba0e8331b868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:48.855435 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c93ac-a9be-4913-84e3-ba0e8331b868 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:48.855748 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c93ac-a9be-4913-84e3-ba0e8331b868 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:48.856035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c93ac-a9be-4913-84e3-ba0e8331b868 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:48.875239 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 92/178] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:48.875954 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4baa93-6b8e-4c89-bd5d-49d41dafa751 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:48.941051 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c93ac-a9be-4913-84e3-ba0e8331b868 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:48.942545 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c93ac-a9be-4913-84e3-ba0e8331b868 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:48.990087 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4baa93-6b8e-4c89-bd5d-49d41dafa751 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:49.027021 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc3247-857a-4735-bc29-8e1840e22d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:49.027813 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc3247-857a-4735-bc29-8e1840e22d67 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:49.028100 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc3247-857a-4735-bc29-8e1840e22d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:49.028377 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc3247-857a-4735-bc29-8e1840e22d67 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:49.029844 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc3247-857a-4735-bc29-8e1840e22d67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:49.030155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc3247-857a-4735-bc29-8e1840e22d67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:49.032094 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc3247-857a-4735-bc29-8e1840e22d67 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:49.048077 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 93/179] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:51:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:49.049038 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc3247-857a-4735-bc29-8e1840e22d67 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:49.058740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 87/180] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:51:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:51:49.062352 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a406f47-7fb5-4a54-8ec4-db70db0d54f9 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:49.062870 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a406f47-7fb5-4a54-8ec4-db70db0d54f9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:49.063762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a406f47-7fb5-4a54-8ec4-db70db0d54f9 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:49.065292 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 88/181] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:49.065867 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a406f47-7fb5-4a54-8ec4-db70db0d54f9 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:49.100497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:49.101327 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:49.174927 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc3247-857a-4735-bc29-8e1840e22d67 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:49.180679 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a406f47-7fb5-4a54-8ec4-db70db0d54f9 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:49.214621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c953900-a74b-4c8a-89da-f134dd67182f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:49.215527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c953900-a74b-4c8a-89da-f134dd67182f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:49.215861 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c953900-a74b-4c8a-89da-f134dd67182f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:49.216125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c953900-a74b-4c8a-89da-f134dd67182f None admin] PATH_INFO: `/v3/users/8adc91e3b100408bb77c02ef2a959cd1` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:49.217368 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c953900-a74b-4c8a-89da-f134dd67182f None admin] RBAC: Authorizing `identity:get_user(user_id=8adc91e3b100408bb77c02ef2a959cd1)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:49.218835 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c953900-a74b-4c8a-89da-f134dd67182f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:49.225054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 94/182] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:51:49 2022] GET /identity/v3/users/8adc91e3b100408bb77c02ef2a959cd1 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:49.225193 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49c3e7-23d8-4a14-87a5-a57a2c108a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:49.225299 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c953900-a74b-4c8a-89da-f134dd67182f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:49.225383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49c3e7-23d8-4a14-87a5-a57a2c108a9f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:49.225383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49c3e7-23d8-4a14-87a5-a57a2c108a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:49.225383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49c3e7-23d8-4a14-87a5-a57a2c108a9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:49.226372 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f49c3e7-23d8-4a14-87a5-a57a2c108a9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:49.227850 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f49c3e7-23d8-4a14-87a5-a57a2c108a9f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:49.230255 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 89/183] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:51:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:49.231081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49c3e7-23d8-4a14-87a5-a57a2c108a9f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:49.345781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49c3e7-23d8-4a14-87a5-a57a2c108a9f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:49.348484 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:49.355496 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c953900-a74b-4c8a-89da-f134dd67182f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:49.373128 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:49.389582 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3089a-9b5c-4a72-bca3-7e108e972254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:49.390455 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3089a-9b5c-4a72-bca3-7e108e972254 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:49.390802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3089a-9b5c-4a72-bca3-7e108e972254 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:49.391206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3089a-9b5c-4a72-bca3-7e108e972254 None admin] PATH_INFO: `/v3/projects/eeea527f528b47d882789251a2058689` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:49.392658 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a3089a-9b5c-4a72-bca3-7e108e972254 None admin] RBAC: Authorizing `identity:get_project(project_id=eeea527f528b47d882789251a2058689)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:49.394144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a3089a-9b5c-4a72-bca3-7e108e972254 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:49.402100 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 90/184] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:51:49 2022] GET /identity/v3/projects/eeea527f528b47d882789251a2058689 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:49.402100 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89247b40-cad2-4af2-acc3-403df2e33c58 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:49.402100 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89247b40-cad2-4af2-acc3-403df2e33c58 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:49.402100 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89247b40-cad2-4af2-acc3-403df2e33c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:49.406999 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ccf8f-9c9f-4ea9-a818-0b94c15d842d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:49.407889 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ccf8f-9c9f-4ea9-a818-0b94c15d842d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:49.408176 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ccf8f-9c9f-4ea9-a818-0b94c15d842d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:49.408481 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ccf8f-9c9f-4ea9-a818-0b94c15d842d None admin] PATH_INFO: `/v3/users/1abf9cd855464cd184ef76e37d368839` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:49.419112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-89247b40-cad2-4af2-acc3-403df2e33c58 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:49.420368 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-89247b40-cad2-4af2-acc3-403df2e33c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:49.426349 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ccf8f-9c9f-4ea9-a818-0b94c15d842d None admin] RBAC: Authorizing `identity:get_user(user_id=1abf9cd855464cd184ef76e37d368839)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:49.427815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ccf8f-9c9f-4ea9-a818-0b94c15d842d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:49.430658 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 95/185] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:51:49 2022] GET /identity/v3/users/1abf9cd855464cd184ef76e37d368839 => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:49.430658 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ccf8f-9c9f-4ea9-a818-0b94c15d842d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:49.512053 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 91/186] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:49.512860 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89247b40-cad2-4af2-acc3-403df2e33c58 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:49.559787 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ccf8f-9c9f-4ea9-a818-0b94c15d842d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:49.597905 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a9e2f-3697-4e6f-adbf-82a82fe63905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:49.598546 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a9e2f-3697-4e6f-adbf-82a82fe63905 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:49.598839 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a9e2f-3697-4e6f-adbf-82a82fe63905 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:49.599034 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a9e2f-3697-4e6f-adbf-82a82fe63905 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:49.630689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:49.638066 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89247b40-cad2-4af2-acc3-403df2e33c58 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:49.645623 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:49.679122 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a902ef6-5805-4bfc-973c-d272ec18d033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:49.679765 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a902ef6-5805-4bfc-973c-d272ec18d033 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:49.680053 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a902ef6-5805-4bfc-973c-d272ec18d033 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:49.680521 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a902ef6-5805-4bfc-973c-d272ec18d033 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:49.681102 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a902ef6-5805-4bfc-973c-d272ec18d033 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:49.683420 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a902ef6-5805-4bfc-973c-d272ec18d033 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:49.687916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a9e2f-3697-4e6f-adbf-82a82fe63905 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:49.689422 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a9e2f-3697-4e6f-adbf-82a82fe63905 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:49.707145 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 92/187] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 21:51:49 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:51:49.708000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a902ef6-5805-4bfc-973c-d272ec18d033 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:49.842442 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a902ef6-5805-4bfc-973c-d272ec18d033 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:49.862821 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 96/188] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:51:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:51:49.864802 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a9e2f-3697-4e6f-adbf-82a82fe63905 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:49.884220 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee304f-74b3-4a7f-8d9b-84af2d98f7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:49.884927 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee304f-74b3-4a7f-8d9b-84af2d98f7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:49.885246 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee304f-74b3-4a7f-8d9b-84af2d98f7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:49.885762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee304f-74b3-4a7f-8d9b-84af2d98f7b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:49.886618 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee304f-74b3-4a7f-8d9b-84af2d98f7b5 None admin] RBAC: Adding query filter params (role.id=04369f3c13174671a298fcd8175998d8, scope.project.id=eeea527f528b47d882789251a2058689, user.id=8b8aa11a54f3466da61ca05643c14d59) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:49.886934 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee304f-74b3-4a7f-8d9b-84af2d98f7b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:49.888433 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee304f-74b3-4a7f-8d9b-84af2d98f7b5 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:49.895256 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 93/189] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:51:49 2022] GET /identity/v3/role_assignments?user.id=8b8aa11a54f3466da61ca05643c14d59&scope.project.id=eeea527f528b47d882789251a2058689&role.id=04369f3c13174671a298fcd8175998d8 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:49.896117 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee304f-74b3-4a7f-8d9b-84af2d98f7b5 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:49.930516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:49.978468 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:50.009806 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a9e2f-3697-4e6f-adbf-82a82fe63905 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:50.035208 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee304f-74b3-4a7f-8d9b-84af2d98f7b5 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:50.060420 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922ecbe-32b6-4c85-9bbb-150f925926df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:50.060630 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922ecbe-32b6-4c85-9bbb-150f925926df None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:50.060871 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922ecbe-32b6-4c85-9bbb-150f925926df None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:50.061150 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922ecbe-32b6-4c85-9bbb-150f925926df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:50.077790 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1d8cc-729d-4222-8246-768d1c063f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:50.078990 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1d8cc-729d-4222-8246-768d1c063f61 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:50.079480 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1d8cc-729d-4222-8246-768d1c063f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:50.080018 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1d8cc-729d-4222-8246-768d1c063f61 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:50.093492 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1d8cc-729d-4222-8246-768d1c063f61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:51:50.102846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-73d1d8cc-729d-4222-8246-768d1c063f61 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:51:50.102846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:51:50.102846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:51:50.102846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:51:50.102846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:51:50.102846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:51:50.102846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:51:50.102846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:51:50.102846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:51:50.102846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:51:50.102846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:51:50.102846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:51:50.102846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:51:50.102846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:51:50.102846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:51:50.102846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:51:50.103760 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:51:50.103760 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:51:50.103760 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:51:50.103760 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:51:50.103760 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:51:50.103760 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:51:50.103760 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:51:50.103760 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:51:50.103760 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:51:50.103760 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:51:50.103760 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:51:50.103760 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:51:50.103760 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:51:50.103760 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:51:50.103760 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:51:50.103760 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:51:50.105282 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:51:50.105282 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:51:50.105282 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:51:50.105282 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:51:50.105282 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:51:50.105282 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:51:50.105282 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:51:50.105282 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:51:50.105282 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:51:50.105282 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:51:50.105282 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:51:50.105282 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:51:50.112573 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 94/190] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 21:51:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:51:50.114320 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1d8cc-729d-4222-8246-768d1c063f61 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:50.143947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922ecbe-32b6-4c85-9bbb-150f925926df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:50.145494 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922ecbe-32b6-4c85-9bbb-150f925926df None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:50.211008 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:50.229524 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:50.244002 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1d8cc-729d-4222-8246-768d1c063f61 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:50.271793 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 97/191] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:51:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:51:50.272799 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922ecbe-32b6-4c85-9bbb-150f925926df None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:50.297730 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fea4d-449a-4d8a-acd9-ee96b5ebf272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:50.299551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fea4d-449a-4d8a-acd9-ee96b5ebf272 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:50.300030 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fea4d-449a-4d8a-acd9-ee96b5ebf272 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:50.300578 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fea4d-449a-4d8a-acd9-ee96b5ebf272 None admin] PATH_INFO: `/v3/projects/066c3bcd7d4d4cd9ac4093ccb3add8e4` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:50.302550 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056fea4d-449a-4d8a-acd9-ee96b5ebf272 None admin] RBAC: Authorizing `identity:get_project(project_id=066c3bcd7d4d4cd9ac4093ccb3add8e4)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:50.305144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056fea4d-449a-4d8a-acd9-ee96b5ebf272 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:50.309077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 95/192] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:51:50 2022] GET /identity/v3/projects/066c3bcd7d4d4cd9ac4093ccb3add8e4 => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:50.313571 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fea4d-449a-4d8a-acd9-ee96b5ebf272 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:50.438547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922ecbe-32b6-4c85-9bbb-150f925926df None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:50.476366 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fea4d-449a-4d8a-acd9-ee96b5ebf272 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:50.515669 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b49fbc-d232-468e-9985-419c402486e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:50.516359 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b49fbc-d232-468e-9985-419c402486e3 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:50.516662 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b49fbc-d232-468e-9985-419c402486e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:50.516937 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b49fbc-d232-468e-9985-419c402486e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:50.517695 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b49fbc-d232-468e-9985-419c402486e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:50.517995 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b49fbc-d232-468e-9985-419c402486e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:50.519395 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b49fbc-d232-468e-9985-419c402486e3 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:50.535110 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 98/193] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:51:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:50.535749 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b49fbc-d232-468e-9985-419c402486e3 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:50.547849 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ac4fd-4ab6-44c5-8e16-3da0d557ad73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:50.548752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ac4fd-4ab6-44c5-8e16-3da0d557ad73 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:50.549037 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ac4fd-4ab6-44c5-8e16-3da0d557ad73 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:50.549314 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ac4fd-4ab6-44c5-8e16-3da0d557ad73 None admin] PATH_INFO: `/v3/projects/87ea432faccb40e590632800fcca178a` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:50.550589 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ac4fd-4ab6-44c5-8e16-3da0d557ad73 None admin] RBAC: Authorizing `identity:get_project(project_id=87ea432faccb40e590632800fcca178a)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:50.552053 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ac4fd-4ab6-44c5-8e16-3da0d557ad73 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:50.554069 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 96/194] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:51:50 2022] GET /identity/v3/projects/87ea432faccb40e590632800fcca178a => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:50.554838 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ac4fd-4ab6-44c5-8e16-3da0d557ad73 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:50.579302 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:50.605605 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:50.690502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ac4fd-4ab6-44c5-8e16-3da0d557ad73 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:50.736137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4d6d1-d9df-40c4-93dc-bca3c033edeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:50.737130 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4d6d1-d9df-40c4-93dc-bca3c033edeb None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:50.737415 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4d6d1-d9df-40c4-93dc-bca3c033edeb None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:50.737691 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4d6d1-d9df-40c4-93dc-bca3c033edeb None admin] PATH_INFO: `/v3/users/1abf9cd855464cd184ef76e37d368839` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:50.739164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4d6d1-d9df-40c4-93dc-bca3c033edeb None admin] RBAC: Authorizing `identity:get_user(user_id=1abf9cd855464cd184ef76e37d368839)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:50.740767 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4d6d1-d9df-40c4-93dc-bca3c033edeb None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:50.742663 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 97/195] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:51:50 2022] GET /identity/v3/users/1abf9cd855464cd184ef76e37d368839 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:50.743269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4d6d1-d9df-40c4-93dc-bca3c033edeb None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:50.836799 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:50.840492 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b49fbc-d232-468e-9985-419c402486e3 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:50.855542 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4d6d1-d9df-40c4-93dc-bca3c033edeb None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:50.892101 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b470b9f-b2d4-43a6-85d3-6b95e3752b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:50.892823 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b470b9f-b2d4-43a6-85d3-6b95e3752b8b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:50.893157 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b470b9f-b2d4-43a6-85d3-6b95e3752b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:50.893443 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b470b9f-b2d4-43a6-85d3-6b95e3752b8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:50.894297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b470b9f-b2d4-43a6-85d3-6b95e3752b8b None admin] RBAC: Adding query filter params (role.id=04369f3c13174671a298fcd8175998d8, scope.project.id=87ea432faccb40e590632800fcca178a, user.id=1abf9cd855464cd184ef76e37d368839) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:50.894616 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b470b9f-b2d4-43a6-85d3-6b95e3752b8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:50.896126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b470b9f-b2d4-43a6-85d3-6b95e3752b8b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:50.902248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 98/196] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:51:50 2022] GET /identity/v3/role_assignments?user.id=1abf9cd855464cd184ef76e37d368839&scope.project.id=87ea432faccb40e590632800fcca178a&role.id=04369f3c13174671a298fcd8175998d8 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:50.903093 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b470b9f-b2d4-43a6-85d3-6b95e3752b8b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:51.023212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b470b9f-b2d4-43a6-85d3-6b95e3752b8b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:51.029585 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c315b60-7f84-46c5-b479-8c647f63439a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:51.030845 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c315b60-7f84-46c5-b479-8c647f63439a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:51.031413 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c315b60-7f84-46c5-b479-8c647f63439a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:51.032041 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c315b60-7f84-46c5-b479-8c647f63439a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:51.033777 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c315b60-7f84-46c5-b479-8c647f63439a None admin] RBAC: Adding query filter params (role.id=4749055b54a542b29f57155df3756136, scope.project.id=066c3bcd7d4d4cd9ac4093ccb3add8e4, user.id=8adc91e3b100408bb77c02ef2a959cd1) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:51.034444 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c315b60-7f84-46c5-b479-8c647f63439a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:51.037281 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c315b60-7f84-46c5-b479-8c647f63439a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:51.053745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 99/197] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:51:50 2022] GET /identity/v3/role_assignments?user.id=8adc91e3b100408bb77c02ef2a959cd1&scope.project.id=066c3bcd7d4d4cd9ac4093ccb3add8e4&role.id=4749055b54a542b29f57155df3756136 => generated 608 bytes in 518 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:51.055160 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a83e5-a8cf-4a90-8a9c-34dd9fffee5f None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:51.055456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a83e5-a8cf-4a90-8a9c-34dd9fffee5f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:51.055740 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a83e5-a8cf-4a90-8a9c-34dd9fffee5f None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:51.057665 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 100/198] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:51.066152 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdaf74-25cb-4aab-b56d-c2b43e6fe405 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:51.066816 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdaf74-25cb-4aab-b56d-c2b43e6fe405 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:51.069140 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdaf74-25cb-4aab-b56d-c2b43e6fe405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:51.090239 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72b94c-95bb-44b9-8563-7f7e208f6524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:51.091193 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72b94c-95bb-44b9-8563-7f7e208f6524 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:51.091622 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72b94c-95bb-44b9-8563-7f7e208f6524 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:51.092070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72b94c-95bb-44b9-8563-7f7e208f6524 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:51.109797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-21fdaf74-25cb-4aab-b56d-c2b43e6fe405 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:51.111334 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-21fdaf74-25cb-4aab-b56d-c2b43e6fe405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:51.136152 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:51.262080 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72b94c-95bb-44b9-8563-7f7e208f6524 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:51.263795 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72b94c-95bb-44b9-8563-7f7e208f6524 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:51.286960 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 101/199] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:51.332378 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdaf74-25cb-4aab-b56d-c2b43e6fe405 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:51.389708 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:51.420724 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 99/200] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:51:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:51:51.431906 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72b94c-95bb-44b9-8563-7f7e208f6524 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:51.514581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:51.559459 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdaf74-25cb-4aab-b56d-c2b43e6fe405 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:51.626342 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926ff98-4c5f-44c1-892d-7a0fd7167f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:51.627158 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926ff98-4c5f-44c1-892d-7a0fd7167f9c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:51.627441 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926ff98-4c5f-44c1-892d-7a0fd7167f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:51.627717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926ff98-4c5f-44c1-892d-7a0fd7167f9c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:51.632329 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72b94c-95bb-44b9-8563-7f7e208f6524 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:51.659552 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926ff98-4c5f-44c1-892d-7a0fd7167f9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:51:51.671209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-2926ff98-4c5f-44c1-892d-7a0fd7167f9c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:51:51.671209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:51:51.671209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:51:51.671209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:51:51.671209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:51:51.671209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:51:51.671209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:51:51.671209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:51:51.671209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:51:51.671209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:51:51.671209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:51:51.671209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:51:51.671209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:51:51.671209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:51:51.671209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:51:51.671209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:51:51.672125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:51:51.672125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:51:51.672125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:51:51.672125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:51:51.672125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:51:51.672125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:51:51.672125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:51:51.672125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:51:51.672125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:51:51.672125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:51:51.672125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:51:51.672125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:51:51.672125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:51:51.672125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:51:51.672125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:51:51.672125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:51:51.672924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:51:51.672924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:51:51.672924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:51:51.672924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:51:51.672924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:51:51.672924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:51:51.672924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:51:51.672924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:51:51.672924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:51:51.672924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:51:51.672924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:51:51.672924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:51:51.680466 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 102/201] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:51:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:51:51.686835 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926ff98-4c5f-44c1-892d-7a0fd7167f9c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:51.723968 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79456fad-5b4c-47f4-8a82-56fd8a9fc3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:51.724904 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79456fad-5b4c-47f4-8a82-56fd8a9fc3fe None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:51.725245 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79456fad-5b4c-47f4-8a82-56fd8a9fc3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:51.725521 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79456fad-5b4c-47f4-8a82-56fd8a9fc3fe None admin] PATH_INFO: `/v3/projects/87ea432faccb40e590632800fcca178a` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:51.726773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79456fad-5b4c-47f4-8a82-56fd8a9fc3fe None admin] RBAC: Authorizing `identity:get_project(project_id=87ea432faccb40e590632800fcca178a)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:51.728232 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79456fad-5b4c-47f4-8a82-56fd8a9fc3fe None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:51.731499 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 100/202] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:51:51 2022] GET /identity/v3/projects/87ea432faccb40e590632800fcca178a => generated 302 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:51.742126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79456fad-5b4c-47f4-8a82-56fd8a9fc3fe None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:51.853806 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:51.881332 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926ff98-4c5f-44c1-892d-7a0fd7167f9c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:51.946334 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79456fad-5b4c-47f4-8a82-56fd8a9fc3fe None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:51.959858 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4428ff-7d96-4adc-8f32-7d5e16da5bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:51.960584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4428ff-7d96-4adc-8f32-7d5e16da5bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:51.960900 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4428ff-7d96-4adc-8f32-7d5e16da5bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:51.961205 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4428ff-7d96-4adc-8f32-7d5e16da5bf3 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:51.962001 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4428ff-7d96-4adc-8f32-7d5e16da5bf3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:51.962326 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4428ff-7d96-4adc-8f32-7d5e16da5bf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:51.964592 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4428ff-7d96-4adc-8f32-7d5e16da5bf3 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:51.976591 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:51.983708 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 103/203] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 21:51:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:51:51.990276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4428ff-7d96-4adc-8f32-7d5e16da5bf3 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:52.018936 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512f669-4553-4559-ab1f-20b70b89cce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:52.019655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512f669-4553-4559-ab1f-20b70b89cce2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:52.019941 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512f669-4553-4559-ab1f-20b70b89cce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:52.020216 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512f669-4553-4559-ab1f-20b70b89cce2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:52.021096 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512f669-4553-4559-ab1f-20b70b89cce2 None admin] RBAC: Adding query filter params (role.id=3fb2a96d6ee74a7dbd046488f5ec322b, scope.project.id=87ea432faccb40e590632800fcca178a, user.id=1abf9cd855464cd184ef76e37d368839) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:52.021409 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512f669-4553-4559-ab1f-20b70b89cce2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:52.023149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512f669-4553-4559-ab1f-20b70b89cce2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:52.030614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 101/204] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:51:51 2022] GET /identity/v3/role_assignments?user.id=1abf9cd855464cd184ef76e37d368839&scope.project.id=87ea432faccb40e590632800fcca178a&role.id=3fb2a96d6ee74a7dbd046488f5ec322b => generated 259 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:51:52.178357 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4428ff-7d96-4adc-8f32-7d5e16da5bf3 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:52.226223 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4fbd0-be49-4e91-91b0-118cabc8d47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:52.227140 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4fbd0-be49-4e91-91b0-118cabc8d47e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:52.227416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4fbd0-be49-4e91-91b0-118cabc8d47e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:52.227685 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4fbd0-be49-4e91-91b0-118cabc8d47e None admin] PATH_INFO: `/v3/users/a65e0f21ef414ea29cd8c9c60a623330` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:52.229583 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf4fbd0-be49-4e91-91b0-118cabc8d47e None admin] RBAC: Authorizing `identity:get_user(user_id=a65e0f21ef414ea29cd8c9c60a623330)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:52.231086 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf4fbd0-be49-4e91-91b0-118cabc8d47e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:52.232831 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 104/205] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:51:51 2022] GET /identity/v3/users/a65e0f21ef414ea29cd8c9c60a623330 => generated 289 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:52.238419 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512f669-4553-4559-ab1f-20b70b89cce2 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:52.390873 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512f669-4553-4559-ab1f-20b70b89cce2 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:52.451361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83c1dd-aecb-494d-b0cf-8b36ed2a6255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:52.452070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83c1dd-aecb-494d-b0cf-8b36ed2a6255 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:52.452354 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83c1dd-aecb-494d-b0cf-8b36ed2a6255 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:52.452657 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83c1dd-aecb-494d-b0cf-8b36ed2a6255 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:52.523850 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:52.553600 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83c1dd-aecb-494d-b0cf-8b36ed2a6255 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:52.555190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83c1dd-aecb-494d-b0cf-8b36ed2a6255 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:52.689426 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 102/206] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:51:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:51:52.694576 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4fbd0-be49-4e91-91b0-118cabc8d47e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:52.730519 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:52.847649 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4fbd0-be49-4e91-91b0-118cabc8d47e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:52.888722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aacb972-c29b-4b02-99e8-a266e6dd9a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:52.889620 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacb972-c29b-4b02-99e8-a266e6dd9a26 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:52.889905 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacb972-c29b-4b02-99e8-a266e6dd9a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:52.890182 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacb972-c29b-4b02-99e8-a266e6dd9a26 None admin] PATH_INFO: `/v3/projects/eeea527f528b47d882789251a2058689` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:52.891522 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aacb972-c29b-4b02-99e8-a266e6dd9a26 None admin] RBAC: Authorizing `identity:get_project(project_id=eeea527f528b47d882789251a2058689)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:52.893031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aacb972-c29b-4b02-99e8-a266e6dd9a26 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:52.895407 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 105/207] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:51:52 2022] GET /identity/v3/projects/eeea527f528b47d882789251a2058689 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:52.901000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83c1dd-aecb-494d-b0cf-8b36ed2a6255 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:53.040246 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:53.079281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83c1dd-aecb-494d-b0cf-8b36ed2a6255 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:53.132677 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21fa87-80b6-4ae8-a283-1c5116e9d903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:53.133816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21fa87-80b6-4ae8-a283-1c5116e9d903 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:53.133816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21fa87-80b6-4ae8-a283-1c5116e9d903 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:53.134380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21fa87-80b6-4ae8-a283-1c5116e9d903 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:53.134929 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21fa87-80b6-4ae8-a283-1c5116e9d903 None admin] RBAC: Adding query filter params (role.id=c6035635160b420194220cbe44e1abb9, scope.project.id=eeea527f528b47d882789251a2058689, user.id=a65e0f21ef414ea29cd8c9c60a623330) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:53.135284 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21fa87-80b6-4ae8-a283-1c5116e9d903 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:53.136784 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21fa87-80b6-4ae8-a283-1c5116e9d903 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:53.149712 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 103/208] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:51:52 2022] GET /identity/v3/role_assignments?user.id=a65e0f21ef414ea29cd8c9c60a623330&scope.project.id=eeea527f528b47d882789251a2058689&role.id=c6035635160b420194220cbe44e1abb9 => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:53.350221 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0afb8-bad8-4469-ad03-15d1e535cf8a None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:53.350721 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0afb8-bad8-4469-ad03-15d1e535cf8a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:53.350721 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0afb8-bad8-4469-ad03-15d1e535cf8a None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:53.352311 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 106/209] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:53.371794 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880371d-f47e-41a9-bc2a-e11074e94f1a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:53.371794 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880371d-f47e-41a9-bc2a-e11074e94f1a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:53.371794 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880371d-f47e-41a9-bc2a-e11074e94f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:53.390362 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-7880371d-f47e-41a9-bc2a-e11074e94f1a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:53.391764 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7880371d-f47e-41a9-bc2a-e11074e94f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:53.485305 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 104/210] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:53.493356 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80177766-a879-47ed-867a-af10a6e439d5 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:53.493772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80177766-a879-47ed-867a-af10a6e439d5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:53.494159 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80177766-a879-47ed-867a-af10a6e439d5 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:53.500238 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 107/211] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:53.501907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8d06b-b366-4f52-9793-942b2d4a994f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:53.502203 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8d06b-b366-4f52-9793-942b2d4a994f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:53.502483 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8d06b-b366-4f52-9793-942b2d4a994f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:53.512934 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80177766-a879-47ed-867a-af10a6e439d5 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:53.524098 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-b3d8d06b-b366-4f52-9793-942b2d4a994f None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:53.525366 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b3d8d06b-b366-4f52-9793-942b2d4a994f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:53.605929 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:53.612560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 105/212] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:51:53.637954 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:53.649056 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8d06b-b366-4f52-9793-942b2d4a994f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:53.675443 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80177766-a879-47ed-867a-af10a6e439d5 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:53.716677 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44793c9-b2fc-4a0b-a22e-d4d38e0cde52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:53.717508 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44793c9-b2fc-4a0b-a22e-d4d38e0cde52 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:53.717798 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44793c9-b2fc-4a0b-a22e-d4d38e0cde52 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:53.718077 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44793c9-b2fc-4a0b-a22e-d4d38e0cde52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:53.720248 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44793c9-b2fc-4a0b-a22e-d4d38e0cde52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:53.722284 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44793c9-b2fc-4a0b-a22e-d4d38e0cde52 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:53.727300 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 108/213] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:51:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:53.730864 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44793c9-b2fc-4a0b-a22e-d4d38e0cde52 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:53.799982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8d06b-b366-4f52-9793-942b2d4a994f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:53.839799 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fd3ae-f519-43c3-84a3-d9d86bd2a21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:53.840728 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fd3ae-f519-43c3-84a3-d9d86bd2a21c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:53.841010 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fd3ae-f519-43c3-84a3-d9d86bd2a21c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:53.841300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fd3ae-f519-43c3-84a3-d9d86bd2a21c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:53.852443 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fd3ae-f519-43c3-84a3-d9d86bd2a21c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:51:53.861168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-208fd3ae-f519-43c3-84a3-d9d86bd2a21c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:51:53.861168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:51:53.861168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:51:53.861168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:51:53.861168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:51:53.861168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:51:53.861168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:51:53.861168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:51:53.861168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:51:53.861168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:51:53.861168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:51:53.861168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:51:53.861168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:51:53.861168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:51:53.861168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:51:53.861168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:51:53.862035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:51:53.862035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:51:53.862035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:51:53.862035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:51:53.862035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:51:53.862035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:51:53.862035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:51:53.862035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:51:53.862035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:51:53.862035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:51:53.862035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:51:53.862035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:51:53.862035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:51:53.862035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:51:53.862035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:51:53.862035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:51:53.862814 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:51:53.862814 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:51:53.862814 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:51:53.862814 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:51:53.862814 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:51:53.862814 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:51:53.862814 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:51:53.862814 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:51:53.862814 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:51:53.862814 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:51:53.862814 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:51:53.862814 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:51:53.862814 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 106/214] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:51:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:51:53.864215 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777eff7-d449-4abc-a24c-50f6c967af73 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:53.864215 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777eff7-d449-4abc-a24c-50f6c967af73 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:53.864371 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777eff7-d449-4abc-a24c-50f6c967af73 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:53.865632 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 107/215] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:53.871660 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777eff7-d449-4abc-a24c-50f6c967af73 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:53.878321 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44793c9-b2fc-4a0b-a22e-d4d38e0cde52 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:53.919580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffd2ce-0f9e-44f6-a9e3-569d05c84b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:53.920788 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffd2ce-0f9e-44f6-a9e3-569d05c84b11 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:53.921228 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffd2ce-0f9e-44f6-a9e3-569d05c84b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:53.921512 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffd2ce-0f9e-44f6-a9e3-569d05c84b11 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:53.922228 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ffd2ce-0f9e-44f6-a9e3-569d05c84b11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:53.923669 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ffd2ce-0f9e-44f6-a9e3-569d05c84b11 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:53.947356 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 109/216] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 21:51:53 2022] POST /identity/v3/users => generated 297 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:51:53.948017 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:53.949012 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde5dc4-cf78-477d-81c4-c38b65f6ce60 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:53.949303 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde5dc4-cf78-477d-81c4-c38b65f6ce60 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:53.949560 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde5dc4-cf78-477d-81c4-c38b65f6ce60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:53.968495 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0fde5dc4-cf78-477d-81c4-c38b65f6ce60 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:53.969796 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0fde5dc4-cf78-477d-81c4-c38b65f6ce60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:53.972307 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:54.026507 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777eff7-d449-4abc-a24c-50f6c967af73 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:54.066783 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49eceb9-d88b-4b45-80fc-9b89817b9a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:54.067494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49eceb9-d88b-4b45-80fc-9b89817b9a5f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:54.067781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49eceb9-d88b-4b45-80fc-9b89817b9a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:54.068026 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49eceb9-d88b-4b45-80fc-9b89817b9a5f None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:54.068850 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49eceb9-d88b-4b45-80fc-9b89817b9a5f None admin] RBAC: Adding query filter params (name=member) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:54.069156 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49eceb9-d88b-4b45-80fc-9b89817b9a5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:54.070650 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49eceb9-d88b-4b45-80fc-9b89817b9a5f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:54.073904 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 110/217] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:54.098945 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 108/218] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 21:51:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:54.100378 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde5dc4-cf78-477d-81c4-c38b65f6ce60 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:54.104127 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49eceb9-d88b-4b45-80fc-9b89817b9a5f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:54.234021 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde5dc4-cf78-477d-81c4-c38b65f6ce60 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:54.242828 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49eceb9-d88b-4b45-80fc-9b89817b9a5f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:54.275447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:54.289528 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2df68-8dca-4963-a282-80e38c6d1816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:54.290349 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2df68-8dca-4963-a282-80e38c6d1816 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:54.299764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2df68-8dca-4963-a282-80e38c6d1816 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:54.299764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2df68-8dca-4963-a282-80e38c6d1816 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:54.301119 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:54.302246 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cc488-3456-4a89-937f-c5dfc1414fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:54.303156 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cc488-3456-4a89-937f-c5dfc1414fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:54.303442 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cc488-3456-4a89-937f-c5dfc1414fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:54.303721 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cc488-3456-4a89-937f-c5dfc1414fb5 None admin] PATH_INFO: `/v3/users/7be00449a9c84f38b2d6c2fd13c1feb3` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:54.305273 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2df68-8dca-4963-a282-80e38c6d1816 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:51:54.316189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-a8d2df68-8dca-4963-a282-80e38c6d1816 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:51:54.316189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:51:54.316189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:51:54.316189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:51:54.316189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:51:54.316189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:51:54.316189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:51:54.316189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:51:54.316189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:51:54.316189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:51:54.316189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:51:54.316189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:51:54.316189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:51:54.316189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:51:54.316189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:51:54.316189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:51:54.317218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:51:54.317218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:51:54.317218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:51:54.317218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:51:54.317218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:51:54.317218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:51:54.317218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:51:54.317218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:51:54.317218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:51:54.317218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:51:54.317218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:51:54.317218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:51:54.317218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:51:54.317218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:51:54.317218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:51:54.317218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:51:54.317971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:51:54.317971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:51:54.317971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:51:54.317971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:51:54.317971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:51:54.317971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:51:54.317971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:51:54.317971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:51:54.317971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:51:54.317971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:51:54.317971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:51:54.317971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:51:54.317971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 111/219] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:51:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:51:54.324650 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2df68-8dca-4963-a282-80e38c6d1816 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:54.326837 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cc488-3456-4a89-937f-c5dfc1414fb5 None admin] RBAC: Authorizing `identity:get_user(user_id=7be00449a9c84f38b2d6c2fd13c1feb3)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:54.328579 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cc488-3456-4a89-937f-c5dfc1414fb5 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:54.333258 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 109/220] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:51:54 2022] GET /identity/v3/users/7be00449a9c84f38b2d6c2fd13c1feb3 => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:51:54.345518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cc488-3456-4a89-937f-c5dfc1414fb5 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:54.466109 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2df68-8dca-4963-a282-80e38c6d1816 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:54.487750 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cc488-3456-4a89-937f-c5dfc1414fb5 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:54.507988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e9e22-02d7-4646-8c64-1528180eb973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:54.509048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e9e22-02d7-4646-8c64-1528180eb973 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:54.509505 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e9e22-02d7-4646-8c64-1528180eb973 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:54.509949 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e9e22-02d7-4646-8c64-1528180eb973 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:54.511567 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e9e22-02d7-4646-8c64-1528180eb973 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:54.512049 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e9e22-02d7-4646-8c64-1528180eb973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:54.513667 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e9e22-02d7-4646-8c64-1528180eb973 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:54.523280 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 112/221] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:51:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:54.534073 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e9e22-02d7-4646-8c64-1528180eb973 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:54.543886 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cefc6a-fdf5-420d-8923-2555e70c10c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:54.544069 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cefc6a-fdf5-420d-8923-2555e70c10c3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:54.544308 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cefc6a-fdf5-420d-8923-2555e70c10c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:54.544615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cefc6a-fdf5-420d-8923-2555e70c10c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:54.611854 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:54.649845 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cefc6a-fdf5-420d-8923-2555e70c10c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:54.651918 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cefc6a-fdf5-420d-8923-2555e70c10c3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:54.661740 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:54.758397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e9e22-02d7-4646-8c64-1528180eb973 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:54.822594 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6df34c-2fd7-416d-8794-e1936673b3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:54.824050 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6df34c-2fd7-416d-8794-e1936673b3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:54.824611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6df34c-2fd7-416d-8794-e1936673b3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:54.825106 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6df34c-2fd7-416d-8794-e1936673b3f3 None admin] PATH_INFO: `/v3/users/1abf9cd855464cd184ef76e37d368839` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:54.826885 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6df34c-2fd7-416d-8794-e1936673b3f3 None admin] RBAC: Authorizing `identity:get_user(user_id=1abf9cd855464cd184ef76e37d368839)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:54.828736 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6df34c-2fd7-416d-8794-e1936673b3f3 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:54.830946 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 113/222] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:51:54 2022] GET /identity/v3/users/1abf9cd855464cd184ef76e37d368839 => generated 283 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:51:54.832491 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0fba3-258c-48b4-9577-62f650997f07 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:54.832848 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 110/223] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:51:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:51:54.833212 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0fba3-258c-48b4-9577-62f650997f07 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:54.833495 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0fba3-258c-48b4-9577-62f650997f07 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:54.835022 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 114/224] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:54.838783 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cefc6a-fdf5-420d-8923-2555e70c10c3 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:54.841373 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b27afe-60a9-4b3b-b231-a635f4c755cb None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:54.841659 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b27afe-60a9-4b3b-b231-a635f4c755cb None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:54.841936 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b27afe-60a9-4b3b-b231-a635f4c755cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:54.860036 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-20b27afe-60a9-4b3b-b231-a635f4c755cb None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:54.861251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-20b27afe-60a9-4b3b-b231-a635f4c755cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:54.937013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:54.944583 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 115/225] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:51:54.945285 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b27afe-60a9-4b3b-b231-a635f4c755cb None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:54.958443 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cefc6a-fdf5-420d-8923-2555e70c10c3 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:55.000111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114ae08-a25d-420e-bc91-1846a00b8f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:55.001393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114ae08-a25d-420e-bc91-1846a00b8f14 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:55.001884 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114ae08-a25d-420e-bc91-1846a00b8f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:55.002359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114ae08-a25d-420e-bc91-1846a00b8f14 None admin] PATH_INFO: `/v3/projects/87ea432faccb40e590632800fcca178a` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:55.003777 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114ae08-a25d-420e-bc91-1846a00b8f14 None admin] RBAC: Authorizing `identity:get_project(project_id=87ea432faccb40e590632800fcca178a)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:55.005477 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114ae08-a25d-420e-bc91-1846a00b8f14 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:55.007680 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 111/226] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:51:54 2022] GET /identity/v3/projects/87ea432faccb40e590632800fcca178a => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:55.008751 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114ae08-a25d-420e-bc91-1846a00b8f14 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:55.023106 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:55.080588 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b27afe-60a9-4b3b-b231-a635f4c755cb None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:55.124048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3effb-5162-4b34-a185-e663d1d5578c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:55.124983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3effb-5162-4b34-a185-e663d1d5578c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:55.125269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3effb-5162-4b34-a185-e663d1d5578c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:55.125550 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3effb-5162-4b34-a185-e663d1d5578c None admin] PATH_INFO: `/v3/projects/87ea432faccb40e590632800fcca178a` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:55.126871 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3effb-5162-4b34-a185-e663d1d5578c None admin] RBAC: Authorizing `identity:get_project(project_id=87ea432faccb40e590632800fcca178a)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:55.128626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3effb-5162-4b34-a185-e663d1d5578c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:55.130693 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 116/227] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:51:54 2022] GET /identity/v3/projects/87ea432faccb40e590632800fcca178a => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:55.136174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3effb-5162-4b34-a185-e663d1d5578c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:55.143805 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114ae08-a25d-420e-bc91-1846a00b8f14 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:55.181530 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318446da-aae9-4e69-b65c-9a642572ea22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:55.182889 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318446da-aae9-4e69-b65c-9a642572ea22 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:55.183377 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318446da-aae9-4e69-b65c-9a642572ea22 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:55.183859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318446da-aae9-4e69-b65c-9a642572ea22 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:55.195227 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318446da-aae9-4e69-b65c-9a642572ea22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:51:55.205243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-318446da-aae9-4e69-b65c-9a642572ea22 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:51:55.205243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:51:55.205243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:51:55.205243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:51:55.205243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:51:55.205243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:51:55.205243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:51:55.205243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:51:55.205243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:51:55.205243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:51:55.205243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:51:55.205243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:51:55.205243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:51:55.205243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:51:55.205243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:51:55.205243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:51:55.206137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:51:55.206137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:51:55.206137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:51:55.206137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:51:55.206137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:51:55.206137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:51:55.206137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:51:55.206137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:51:55.206137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:51:55.206137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:51:55.206137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:51:55.206137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:51:55.206137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:51:55.206137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:51:55.206137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:51:55.206137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:51:55.206882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:51:55.206882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:51:55.206882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:51:55.206882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:51:55.206882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:51:55.206882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:51:55.206882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:51:55.206882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:51:55.206882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:51:55.206882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:51:55.206882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:51:55.206882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:51:55.209397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 112/228] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 21:51:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:51:55.210353 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318446da-aae9-4e69-b65c-9a642572ea22 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:55.223508 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:55.262686 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3effb-5162-4b34-a185-e663d1d5578c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:55.294219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:55.305317 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735605e6-ecb9-47b8-ba32-b6e7ed5ef591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:55.306194 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735605e6-ecb9-47b8-ba32-b6e7ed5ef591 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:55.306653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735605e6-ecb9-47b8-ba32-b6e7ed5ef591 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:55.307120 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735605e6-ecb9-47b8-ba32-b6e7ed5ef591 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:55.308116 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735605e6-ecb9-47b8-ba32-b6e7ed5ef591 None admin] RBAC: Adding query filter params (role.id=4749055b54a542b29f57155df3756136, scope.project.id=87ea432faccb40e590632800fcca178a, user.id=7be00449a9c84f38b2d6c2fd13c1feb3) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:55.308694 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735605e6-ecb9-47b8-ba32-b6e7ed5ef591 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:55.310405 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735605e6-ecb9-47b8-ba32-b6e7ed5ef591 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:55.317025 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 117/229] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:51:55 2022] GET /identity/v3/role_assignments?user.id=7be00449a9c84f38b2d6c2fd13c1feb3&scope.project.id=87ea432faccb40e590632800fcca178a&role.id=4749055b54a542b29f57155df3756136 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:55.325580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735605e6-ecb9-47b8-ba32-b6e7ed5ef591 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:55.326081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318446da-aae9-4e69-b65c-9a642572ea22 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:55.394128 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bd4af-2437-40ce-ad39-06b9bb953d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:55.395139 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bd4af-2437-40ce-ad39-06b9bb953d60 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:55.395490 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bd4af-2437-40ce-ad39-06b9bb953d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:55.396063 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bd4af-2437-40ce-ad39-06b9bb953d60 None admin] PATH_INFO: `/v3/projects/87ea432faccb40e590632800fcca178a/users/1abf9cd855464cd184ef76e37d368839/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:55.411371 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8bd4af-2437-40ce-ad39-06b9bb953d60 None admin] RBAC: Authorizing `identity:create_grant(project_id=87ea432faccb40e590632800fcca178a, user_id=1abf9cd855464cd184ef76e37d368839, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:55.413693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8bd4af-2437-40ce-ad39-06b9bb953d60 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:55.441144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 113/230] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 21:51:55 2022] PUT /identity/v3/projects/87ea432faccb40e590632800fcca178a/users/1abf9cd855464cd184ef76e37d368839/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:51:55.522431 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735605e6-ecb9-47b8-ba32-b6e7ed5ef591 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:55.575011 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b98b09-147b-440f-b1cb-d3064ff14306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:55.575705 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b98b09-147b-440f-b1cb-d3064ff14306 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:55.575994 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b98b09-147b-440f-b1cb-d3064ff14306 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:55.576274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b98b09-147b-440f-b1cb-d3064ff14306 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:55.577084 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b98b09-147b-440f-b1cb-d3064ff14306 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:55.577391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b98b09-147b-440f-b1cb-d3064ff14306 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:55.578810 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b98b09-147b-440f-b1cb-d3064ff14306 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:55.588580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 118/231] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:51:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:55.604228 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bd4af-2437-40ce-ad39-06b9bb953d60 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:55.723002 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:55.761719 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bd4af-2437-40ce-ad39-06b9bb953d60 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:55.800221 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e31338-b135-4325-9141-71fe3e449058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:55.801500 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e31338-b135-4325-9141-71fe3e449058 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:55.802009 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e31338-b135-4325-9141-71fe3e449058 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:55.802488 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e31338-b135-4325-9141-71fe3e449058 None admin] PATH_INFO: `/v3/users/1abf9cd855464cd184ef76e37d368839` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:55.803901 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e31338-b135-4325-9141-71fe3e449058 None admin] RBAC: Authorizing `identity:get_user(user_id=1abf9cd855464cd184ef76e37d368839)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:55.805616 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e31338-b135-4325-9141-71fe3e449058 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:55.808424 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 114/232] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:51:55 2022] GET /identity/v3/users/1abf9cd855464cd184ef76e37d368839 => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:55.814385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b98b09-147b-440f-b1cb-d3064ff14306 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:55.879577 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:55.949542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b98b09-147b-440f-b1cb-d3064ff14306 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:55.991934 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f6e0a-928d-4db1-8e95-a15a2b8ff487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:55.992829 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f6e0a-928d-4db1-8e95-a15a2b8ff487 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:55.993115 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f6e0a-928d-4db1-8e95-a15a2b8ff487 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:55.993391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f6e0a-928d-4db1-8e95-a15a2b8ff487 None admin] PATH_INFO: `/v3/projects/87ea432faccb40e590632800fcca178a` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:55.994693 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f6e0a-928d-4db1-8e95-a15a2b8ff487 None admin] RBAC: Authorizing `identity:get_project(project_id=87ea432faccb40e590632800fcca178a)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:55.996167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f6e0a-928d-4db1-8e95-a15a2b8ff487 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:55.998306 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 119/233] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:51:55 2022] GET /identity/v3/projects/87ea432faccb40e590632800fcca178a => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:56.005457 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e31338-b135-4325-9141-71fe3e449058 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:56.133210 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e31338-b135-4325-9141-71fe3e449058 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:56.169861 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2541d-c843-4d72-8b14-7124891cabe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:56.170778 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2541d-c843-4d72-8b14-7124891cabe6 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:56.171068 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2541d-c843-4d72-8b14-7124891cabe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:56.171353 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2541d-c843-4d72-8b14-7124891cabe6 None admin] PATH_INFO: `/v3/projects/87ea432faccb40e590632800fcca178a/users/1abf9cd855464cd184ef76e37d368839/roles/3fb2a96d6ee74a7dbd046488f5ec322b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:56.173860 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2541d-c843-4d72-8b14-7124891cabe6 None admin] RBAC: Authorizing `identity:create_grant(project_id=87ea432faccb40e590632800fcca178a, user_id=1abf9cd855464cd184ef76e37d368839, role_id=3fb2a96d6ee74a7dbd046488f5ec322b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:56.175356 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2541d-c843-4d72-8b14-7124891cabe6 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:56.179013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:56.200350 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 115/234] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 21:51:56 2022] PUT /identity/v3/projects/87ea432faccb40e590632800fcca178a/users/1abf9cd855464cd184ef76e37d368839/roles/3fb2a96d6ee74a7dbd046488f5ec322b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:51:56.821974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6bc09-addf-4a21-9b7c-5cbb28706f28 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:56.823701 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6bc09-addf-4a21-9b7c-5cbb28706f28 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:56.824188 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6bc09-addf-4a21-9b7c-5cbb28706f28 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:56.826067 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 120/235] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:56.831969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c0f95-bd6a-449b-b1e0-3a4185d20777 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:56.832571 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c0f95-bd6a-449b-b1e0-3a4185d20777 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:56.833046 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c0f95-bd6a-449b-b1e0-3a4185d20777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:56.850588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-990c0f95-bd6a-449b-b1e0-3a4185d20777 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:56.852083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-990c0f95-bd6a-449b-b1e0-3a4185d20777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:56.957212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 116/236] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:56.992856 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6bc09-addf-4a21-9b7c-5cbb28706f28 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:57.158158 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6bc09-addf-4a21-9b7c-5cbb28706f28 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:57.188791 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:57.208622 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc55df-fa80-4a9e-bd6d-011a99800bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:57.209437 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc55df-fa80-4a9e-bd6d-011a99800bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:57.209726 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc55df-fa80-4a9e-bd6d-011a99800bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:57.210007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc55df-fa80-4a9e-bd6d-011a99800bc7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:57.228776 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc55df-fa80-4a9e-bd6d-011a99800bc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:51:57.240986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-51bc55df-fa80-4a9e-bd6d-011a99800bc7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:51:57.240986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:51:57.240986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:51:57.240986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:51:57.240986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:51:57.240986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:51:57.240986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:51:57.240986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:51:57.240986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:51:57.240986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:51:57.240986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:51:57.240986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:51:57.240986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:51:57.240986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:51:57.240986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:51:57.240986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:51:57.241884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:51:57.241884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:51:57.241884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:51:57.241884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:51:57.241884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:51:57.241884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:51:57.241884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:51:57.241884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:51:57.241884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:51:57.241884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:51:57.241884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:51:57.241884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:51:57.241884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:51:57.241884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:51:57.241884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:51:57.241884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:51:57.242646 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:51:57.242646 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:51:57.242646 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:51:57.242646 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:51:57.242646 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:51:57.242646 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:51:57.242646 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:51:57.242646 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:51:57.242646 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:51:57.242646 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:51:57.242646 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:51:57.242646 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:51:57.242646 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 121/237] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:51:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:51:57.250148 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c0f95-bd6a-449b-b1e0-3a4185d20777 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:57.315789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab311c-5545-4f57-baed-2e531006a1a1 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:57.316193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab311c-5545-4f57-baed-2e531006a1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:57.316524 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab311c-5545-4f57-baed-2e531006a1a1 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:57.318577 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 122/238] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:51:57.325134 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317c936-45b5-4789-9543-15dccdfda1f4 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:57.325539 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317c936-45b5-4789-9543-15dccdfda1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:57.325938 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317c936-45b5-4789-9543-15dccdfda1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:57.362563 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c317c936-45b5-4789-9543-15dccdfda1f4 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:57.369140 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c317c936-45b5-4789-9543-15dccdfda1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:57.427481 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c0f95-bd6a-449b-b1e0-3a4185d20777 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:57.472432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:57.493280 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd7cec-c14e-406c-b413-ff3c97ae0a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:57.493972 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd7cec-c14e-406c-b413-ff3c97ae0a71 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:57.494258 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd7cec-c14e-406c-b413-ff3c97ae0a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:57.494921 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd7cec-c14e-406c-b413-ff3c97ae0a71 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:57.496155 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd7cec-c14e-406c-b413-ff3c97ae0a71 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:57.496491 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd7cec-c14e-406c-b413-ff3c97ae0a71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:57.497922 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd7cec-c14e-406c-b413-ff3c97ae0a71 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:57.511959 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 123/239] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:51:57.518734 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 117/240] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 21:51:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:57.524072 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317c936-45b5-4789-9543-15dccdfda1f4 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:57.598838 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd7cec-c14e-406c-b413-ff3c97ae0a71 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:57.668440 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317c936-45b5-4789-9543-15dccdfda1f4 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:57.704137 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb7fda-09a4-4f76-8aca-dbd0a2ebf097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:57.705218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb7fda-09a4-4f76-8aca-dbd0a2ebf097 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:57.705518 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb7fda-09a4-4f76-8aca-dbd0a2ebf097 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:57.705791 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb7fda-09a4-4f76-8aca-dbd0a2ebf097 None admin] PATH_INFO: `/v3/users/920dceaf58604c97b520e3aea58e1d42` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:57.720913 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:57.723186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb7fda-09a4-4f76-8aca-dbd0a2ebf097 None admin] RBAC: Authorizing `identity:get_user(user_id=920dceaf58604c97b520e3aea58e1d42)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:57.724898 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb7fda-09a4-4f76-8aca-dbd0a2ebf097 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:57.727382 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 124/241] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:51:57 2022] GET /identity/v3/users/920dceaf58604c97b520e3aea58e1d42 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:57.738149 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb7fda-09a4-4f76-8aca-dbd0a2ebf097 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:57.875624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd7cec-c14e-406c-b413-ff3c97ae0a71 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:57.916092 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb7fda-09a4-4f76-8aca-dbd0a2ebf097 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:57.960172 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889765c2-f1d3-4afd-a7bd-239a7229d3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:57.961390 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889765c2-f1d3-4afd-a7bd-239a7229d3cc None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:57.961874 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889765c2-f1d3-4afd-a7bd-239a7229d3cc None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:57.962349 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889765c2-f1d3-4afd-a7bd-239a7229d3cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:57.965367 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889765c2-f1d3-4afd-a7bd-239a7229d3cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:57.967006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889765c2-f1d3-4afd-a7bd-239a7229d3cc None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:57.968797 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 118/242] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:51:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:51:57.974797 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889765c2-f1d3-4afd-a7bd-239a7229d3cc None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:57.981911 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0887b0-d6c3-4749-9c44-2a33e4ac6e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:57.982576 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0887b0-d6c3-4749-9c44-2a33e4ac6e1f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:57.982856 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0887b0-d6c3-4749-9c44-2a33e4ac6e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:57.983131 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0887b0-d6c3-4749-9c44-2a33e4ac6e1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:58.068798 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:58.099081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:58.142011 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0887b0-d6c3-4749-9c44-2a33e4ac6e1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:58.143596 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0887b0-d6c3-4749-9c44-2a33e4ac6e1f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:58.195925 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889765c2-f1d3-4afd-a7bd-239a7229d3cc None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:58.258864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1315940-4e4f-4de3-a5ca-9c206708d8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:58.261020 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1315940-4e4f-4de3-a5ca-9c206708d8f2 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:58.261556 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1315940-4e4f-4de3-a5ca-9c206708d8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:58.262005 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1315940-4e4f-4de3-a5ca-9c206708d8f2 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:58.262900 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1315940-4e4f-4de3-a5ca-9c206708d8f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:58.264710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1315940-4e4f-4de3-a5ca-9c206708d8f2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:58.290697 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 119/243] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 21:51:57 2022] POST /identity/v3/users => generated 293 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:51:58.292898 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c71074-ec58-4e1c-b5cc-f5667c7c12ab None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:58.293359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c71074-ec58-4e1c-b5cc-f5667c7c12ab None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:58.293786 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c71074-ec58-4e1c-b5cc-f5667c7c12ab None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:58.295385 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 120/244] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:58.301285 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649048a9-68ab-40c5-b248-a4bcb8e5a9dd None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:58.301805 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649048a9-68ab-40c5-b248-a4bcb8e5a9dd None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:58.302232 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649048a9-68ab-40c5-b248-a4bcb8e5a9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:58.328479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 125/245] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:51:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 21:51:58.333687 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0887b0-d6c3-4749-9c44-2a33e4ac6e1f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:58.343742 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-649048a9-68ab-40c5-b248-a4bcb8e5a9dd None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:58.345301 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-649048a9-68ab-40c5-b248-a4bcb8e5a9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:58.436162 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:58.462807 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 121/246] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:51:58.467626 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfbcbc-9ae2-4fe8-b917-01d6c14838fc None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:58.467626 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfbcbc-9ae2-4fe8-b917-01d6c14838fc None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:58.467626 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfbcbc-9ae2-4fe8-b917-01d6c14838fc None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:58.475822 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 122/247] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:58.475822 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4e126-29d1-4d0e-abdc-090823138d20 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:58.475822 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4e126-29d1-4d0e-abdc-090823138d20 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:58.475822 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4e126-29d1-4d0e-abdc-090823138d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:58.493695 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-91b4e126-29d1-4d0e-abdc-090823138d20 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:58.496024 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-91b4e126-29d1-4d0e-abdc-090823138d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:58.506617 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0887b0-d6c3-4749-9c44-2a33e4ac6e1f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:58.552049 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:58.553396 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041c2c3-4ef0-4e08-a71c-d3e9fcba8244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:58.553974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041c2c3-4ef0-4e08-a71c-d3e9fcba8244 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:58.560209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041c2c3-4ef0-4e08-a71c-d3e9fcba8244 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:58.560209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041c2c3-4ef0-4e08-a71c-d3e9fcba8244 None admin] PATH_INFO: `/v3/projects/87ea432faccb40e590632800fcca178a` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:58.560209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041c2c3-4ef0-4e08-a71c-d3e9fcba8244 None admin] RBAC: Authorizing `identity:get_project(project_id=87ea432faccb40e590632800fcca178a)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:58.560209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041c2c3-4ef0-4e08-a71c-d3e9fcba8244 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:58.560933 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 126/248] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:51:58 2022] GET /identity/v3/projects/87ea432faccb40e590632800fcca178a => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:51:58.566985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041c2c3-4ef0-4e08-a71c-d3e9fcba8244 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:58.604701 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 123/249] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:58.605583 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4e126-29d1-4d0e-abdc-090823138d20 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:58.721202 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041c2c3-4ef0-4e08-a71c-d3e9fcba8244 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:58.741560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4e126-29d1-4d0e-abdc-090823138d20 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:58.774113 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fba8b-f903-4f7a-80a1-589f1d758458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:58.774934 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fba8b-f903-4f7a-80a1-589f1d758458 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:58.775220 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fba8b-f903-4f7a-80a1-589f1d758458 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:58.775497 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fba8b-f903-4f7a-80a1-589f1d758458 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:58.779279 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:58.791522 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fba8b-f903-4f7a-80a1-589f1d758458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:51:58.792362 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4902dc-3502-4abd-ad9c-119842eab8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:58.793288 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4902dc-3502-4abd-ad9c-119842eab8d0 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:58.793767 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4902dc-3502-4abd-ad9c-119842eab8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:58.794235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4902dc-3502-4abd-ad9c-119842eab8d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:58.795267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4902dc-3502-4abd-ad9c-119842eab8d0 None admin] RBAC: Adding query filter params (role.id=c6035635160b420194220cbe44e1abb9, scope.project.id=87ea432faccb40e590632800fcca178a, user.id=920dceaf58604c97b520e3aea58e1d42) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:58.795791 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4902dc-3502-4abd-ad9c-119842eab8d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:58.797474 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4902dc-3502-4abd-ad9c-119842eab8d0 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:58.800274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-7c1fba8b-f903-4f7a-80a1-589f1d758458 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:51:58.800274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:51:58.800274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:51:58.800274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:51:58.800274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:51:58.800274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:51:58.800274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:51:58.800274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:51:58.800274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:51:58.800274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:51:58.800274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:51:58.800274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:51:58.800274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:51:58.800274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:51:58.800274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:51:58.800274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:51:58.801249 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:51:58.801249 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:51:58.801249 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:51:58.801249 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:51:58.801249 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:51:58.801249 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:51:58.801249 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:51:58.801249 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:51:58.801249 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:51:58.801249 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:51:58.801249 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:51:58.801249 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:51:58.801249 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:51:58.801249 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:51:58.801249 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:51:58.801249 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:51:58.802467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:51:58.802467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:51:58.802467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:51:58.802467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:51:58.802467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:51:58.802467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:51:58.802467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:51:58.802467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:51:58.802467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:51:58.802467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:51:58.802467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:51:58.802467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:51:58.802467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 127/250] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:51:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:51:58.802467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fba8b-f903-4f7a-80a1-589f1d758458 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:58.809458 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 124/251] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:51:58 2022] GET /identity/v3/role_assignments?user.id=920dceaf58604c97b520e3aea58e1d42&scope.project.id=87ea432faccb40e590632800fcca178a&role.id=c6035635160b420194220cbe44e1abb9 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:58.810720 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4902dc-3502-4abd-ad9c-119842eab8d0 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:58.881265 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:58.989889 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fba8b-f903-4f7a-80a1-589f1d758458 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:59.061065 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2420e-530b-4f45-958c-4bdae778b079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:59.062512 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2420e-530b-4f45-958c-4bdae778b079 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:59.063447 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2420e-530b-4f45-958c-4bdae778b079 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:59.064051 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2420e-530b-4f45-958c-4bdae778b079 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:59.070858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4902dc-3502-4abd-ad9c-119842eab8d0 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:59.098193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2420e-530b-4f45-958c-4bdae778b079 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:51:59.112719 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-39c2420e-530b-4f45-958c-4bdae778b079 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:51:59.112719 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:51:59.112719 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:51:59.112719 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:51:59.112719 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:51:59.112719 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:51:59.112719 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:51:59.112719 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:51:59.112719 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:51:59.112719 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:51:59.112719 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:51:59.112719 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:51:59.112719 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:51:59.112719 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:51:59.112719 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:51:59.112719 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:51:59.114111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:51:59.114111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:51:59.114111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:51:59.114111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:51:59.114111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:51:59.114111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:51:59.114111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:51:59.114111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:51:59.114111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:51:59.114111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:51:59.114111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:51:59.114111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:51:59.114111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:51:59.114111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:51:59.114111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:51:59.114111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:51:59.114970 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:51:59.114970 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:51:59.114970 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:51:59.114970 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:51:59.114970 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:51:59.114970 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:51:59.114970 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:51:59.114970 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:51:59.114970 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:51:59.114970 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:51:59.114970 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:51:59.114970 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:51:59.117858 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 128/252] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:51:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:51:59.126932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2420e-530b-4f45-958c-4bdae778b079 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:59.153145 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f92ab-9783-4f1a-8070-e8cd2a799646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:59.154166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f92ab-9783-4f1a-8070-e8cd2a799646 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:59.154607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f92ab-9783-4f1a-8070-e8cd2a799646 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:59.155035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f92ab-9783-4f1a-8070-e8cd2a799646 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:59.156054 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f92ab-9783-4f1a-8070-e8cd2a799646 None admin] RBAC: Adding query filter params (name=member) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:59.156575 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f92ab-9783-4f1a-8070-e8cd2a799646 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:59.158172 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f92ab-9783-4f1a-8070-e8cd2a799646 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:59.178463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 125/253] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 21:51:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:59.193554 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f92ab-9783-4f1a-8070-e8cd2a799646 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:59.200946 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:59.305135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2420e-530b-4f45-958c-4bdae778b079 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:59.391901 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:59.397175 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f92ab-9783-4f1a-8070-e8cd2a799646 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:59.417720 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820f17b-7071-4cf3-a369-1dfd3050d962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:59.418790 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820f17b-7071-4cf3-a369-1dfd3050d962 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:59.419274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820f17b-7071-4cf3-a369-1dfd3050d962 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:59.419771 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820f17b-7071-4cf3-a369-1dfd3050d962 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:59.420795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820f17b-7071-4cf3-a369-1dfd3050d962 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:51:59.421507 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820f17b-7071-4cf3-a369-1dfd3050d962 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:59.423569 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820f17b-7071-4cf3-a369-1dfd3050d962 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:59.447525 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 129/254] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:51:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:59.449955 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6924a0b-9af9-4fa8-9755-8ad518346a50 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:59.451625 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6924a0b-9af9-4fa8-9755-8ad518346a50 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:59.452134 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6924a0b-9af9-4fa8-9755-8ad518346a50 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:59.453741 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 130/255] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:51:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:51:59.461664 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6924a0b-9af9-4fa8-9755-8ad518346a50 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:59.494030 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1733a66-0758-49e1-8656-fbe5e8200176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:59.495798 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1733a66-0758-49e1-8656-fbe5e8200176 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:59.495798 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1733a66-0758-49e1-8656-fbe5e8200176 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:59.496131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1733a66-0758-49e1-8656-fbe5e8200176 None admin] PATH_INFO: `/v3/users/7be00449a9c84f38b2d6c2fd13c1feb3` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:59.497409 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1733a66-0758-49e1-8656-fbe5e8200176 None admin] RBAC: Authorizing `identity:get_user(user_id=7be00449a9c84f38b2d6c2fd13c1feb3)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:59.498868 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1733a66-0758-49e1-8656-fbe5e8200176 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:59.500904 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 126/256] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:51:59 2022] GET /identity/v3/users/7be00449a9c84f38b2d6c2fd13c1feb3 => generated 297 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:59.502109 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62a57d-69e6-493d-a0d4-7580e67da51e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:59.502393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62a57d-69e6-493d-a0d4-7580e67da51e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:59.508003 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62a57d-69e6-493d-a0d4-7580e67da51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:59.530582 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8a62a57d-69e6-493d-a0d4-7580e67da51e None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:51:59.533210 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8a62a57d-69e6-493d-a0d4-7580e67da51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:51:59.656350 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 127/257] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:51:59.657228 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62a57d-69e6-493d-a0d4-7580e67da51e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:59.663047 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6924a0b-9af9-4fa8-9755-8ad518346a50 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:59.682730 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:59.703076 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425345b-713e-47ba-9b95-1cadf6d06265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:59.703958 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425345b-713e-47ba-9b95-1cadf6d06265 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:59.704237 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425345b-713e-47ba-9b95-1cadf6d06265 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:59.704559 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425345b-713e-47ba-9b95-1cadf6d06265 None admin] PATH_INFO: `/v3/users/1abf9cd855464cd184ef76e37d368839` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:59.705761 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425345b-713e-47ba-9b95-1cadf6d06265 None admin] RBAC: Authorizing `identity:get_user(user_id=1abf9cd855464cd184ef76e37d368839)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:59.707206 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425345b-713e-47ba-9b95-1cadf6d06265 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:59.709192 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 131/258] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:51:59 2022] GET /identity/v3/users/1abf9cd855464cd184ef76e37d368839 => generated 283 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:59.710036 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425345b-713e-47ba-9b95-1cadf6d06265 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:59.823477 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62a57d-69e6-493d-a0d4-7580e67da51e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:51:59.849497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:51:59.869006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c2038-0631-497b-9e07-2dd4a6422949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:51:59.869910 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c2038-0631-497b-9e07-2dd4a6422949 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:51:59.870188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c2038-0631-497b-9e07-2dd4a6422949 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:51:59.870456 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c2038-0631-497b-9e07-2dd4a6422949 None admin] PATH_INFO: `/v3/projects/87ea432faccb40e590632800fcca178a` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:51:59.871658 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c2038-0631-497b-9e07-2dd4a6422949 None admin] RBAC: Authorizing `identity:get_project(project_id=87ea432faccb40e590632800fcca178a)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:51:59.873134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c2038-0631-497b-9e07-2dd4a6422949 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:51:59.874833 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 128/259] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:51:59 2022] GET /identity/v3/projects/87ea432faccb40e590632800fcca178a => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:51:59.887210 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c2038-0631-497b-9e07-2dd4a6422949 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:51:59.948958 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425345b-713e-47ba-9b95-1cadf6d06265 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:00.017178 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b8a93-2032-4674-b3bb-6ebcbbd45a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:00.017998 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b8a93-2032-4674-b3bb-6ebcbbd45a17 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:00.018279 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b8a93-2032-4674-b3bb-6ebcbbd45a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:00.018550 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b8a93-2032-4674-b3bb-6ebcbbd45a17 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:00.057630 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b8a93-2032-4674-b3bb-6ebcbbd45a17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:00.072427 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-e01b8a93-2032-4674-b3bb-6ebcbbd45a17 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:52:00.072427 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:00.072427 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:00.072427 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:00.072427 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:00.072427 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:00.072427 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:00.072427 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:00.072427 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:00.072427 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:00.072427 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:00.072427 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:00.072427 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:00.072427 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:00.072427 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:00.072427 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:00.073961 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:00.073961 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:00.073961 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:00.073961 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:00.073961 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:00.073961 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:00.073961 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:00.073961 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:00.073961 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:00.073961 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:00.073961 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:00.073961 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:00.073961 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:00.073961 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:00.073961 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:00.073961 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:00.074727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:00.074727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:00.074727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:00.074727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:00.074727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:00.074727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:00.074727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:00.074727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:00.074727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:00.074727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:00.074727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:52:00.074727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:00.075311 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c2038-0631-497b-9e07-2dd4a6422949 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:00.077357 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 132/260] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 21:51:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:00.078419 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b8a93-2032-4674-b3bb-6ebcbbd45a17 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:00.110308 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8dbe1b-65de-42a3-a8af-6aaac7726e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:00.113000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dbe1b-65de-42a3-a8af-6aaac7726e32 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:00.113497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dbe1b-65de-42a3-a8af-6aaac7726e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:00.115214 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dbe1b-65de-42a3-a8af-6aaac7726e32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:00.154732 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:00.206065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:00.222925 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b8a93-2032-4674-b3bb-6ebcbbd45a17 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:00.269788 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8dbe1b-65de-42a3-a8af-6aaac7726e32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:00.270763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5329a-1637-45ea-99a8-ea2eb6fada04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:00.271273 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8dbe1b-65de-42a3-a8af-6aaac7726e32 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:00.272106 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5329a-1637-45ea-99a8-ea2eb6fada04 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:00.272647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5329a-1637-45ea-99a8-ea2eb6fada04 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:00.273124 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5329a-1637-45ea-99a8-ea2eb6fada04 None admin] PATH_INFO: `/v3/projects/87ea432faccb40e590632800fcca178a/users/7be00449a9c84f38b2d6c2fd13c1feb3/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:00.277839 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5329a-1637-45ea-99a8-ea2eb6fada04 None admin] RBAC: Authorizing `identity:create_grant(project_id=87ea432faccb40e590632800fcca178a, user_id=7be00449a9c84f38b2d6c2fd13c1feb3, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:00.279572 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5329a-1637-45ea-99a8-ea2eb6fada04 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:00.303100 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 133/261] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 21:52:00 2022] PUT /identity/v3/projects/87ea432faccb40e590632800fcca178a/users/7be00449a9c84f38b2d6c2fd13c1feb3/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:52:00.304395 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5329a-1637-45ea-99a8-ea2eb6fada04 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:00.455528 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 129/262] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:51:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:52:00.461378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8dbe1b-65de-42a3-a8af-6aaac7726e32 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:00.494293 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5329a-1637-45ea-99a8-ea2eb6fada04 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:00.512656 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:00.583982 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e03b1-5544-4f6b-b3ad-8af08a97d70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:00.584708 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e03b1-5544-4f6b-b3ad-8af08a97d70b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:00.584992 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e03b1-5544-4f6b-b3ad-8af08a97d70b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:00.585266 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e03b1-5544-4f6b-b3ad-8af08a97d70b None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:00.586037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e03b1-5544-4f6b-b3ad-8af08a97d70b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:00.586341 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e03b1-5544-4f6b-b3ad-8af08a97d70b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:00.587731 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e03b1-5544-4f6b-b3ad-8af08a97d70b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:00.608122 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 134/263] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:52:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:00.614416 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:00.615848 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e03b1-5544-4f6b-b3ad-8af08a97d70b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:00.695888 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8dbe1b-65de-42a3-a8af-6aaac7726e32 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:00.770269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d81cf-37a3-4544-a36f-9f20acf3371f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:00.771419 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d81cf-37a3-4544-a36f-9f20acf3371f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:00.771703 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d81cf-37a3-4544-a36f-9f20acf3371f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:00.771978 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d81cf-37a3-4544-a36f-9f20acf3371f None admin] PATH_INFO: `/v3/projects/87ea432faccb40e590632800fcca178a` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:00.773822 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d81cf-37a3-4544-a36f-9f20acf3371f None admin] RBAC: Authorizing `identity:get_project(project_id=87ea432faccb40e590632800fcca178a)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:00.775483 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d81cf-37a3-4544-a36f-9f20acf3371f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:00.778128 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 130/264] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:52:00 2022] GET /identity/v3/projects/87ea432faccb40e590632800fcca178a => generated 302 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:52:00.783829 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d81cf-37a3-4544-a36f-9f20acf3371f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:00.870711 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e03b1-5544-4f6b-b3ad-8af08a97d70b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:00.912884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f36e2-3c72-44a6-8b95-e2c1b3430e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:00.914143 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f36e2-3c72-44a6-8b95-e2c1b3430e36 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:00.914704 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f36e2-3c72-44a6-8b95-e2c1b3430e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:00.916214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f36e2-3c72-44a6-8b95-e2c1b3430e36 None admin] PATH_INFO: `/v3/users/1abf9cd855464cd184ef76e37d368839` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:00.919046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f36e2-3c72-44a6-8b95-e2c1b3430e36 None admin] RBAC: Authorizing `identity:get_user(user_id=1abf9cd855464cd184ef76e37d368839)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:00.921123 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f36e2-3c72-44a6-8b95-e2c1b3430e36 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:00.924831 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 135/265] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:52:00 2022] GET /identity/v3/users/1abf9cd855464cd184ef76e37d368839 => generated 283 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:52:00.931759 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f36e2-3c72-44a6-8b95-e2c1b3430e36 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:00.987071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d81cf-37a3-4544-a36f-9f20acf3371f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:00.999977 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:01.083635 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:01.100416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f36e2-3c72-44a6-8b95-e2c1b3430e36 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:01.105159 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c751cd-ced4-4d33-99be-c0e494ee40dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:01.105838 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c751cd-ced4-4d33-99be-c0e494ee40dd None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:01.106124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c751cd-ced4-4d33-99be-c0e494ee40dd None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:01.106402 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c751cd-ced4-4d33-99be-c0e494ee40dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:01.107248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c751cd-ced4-4d33-99be-c0e494ee40dd None admin] RBAC: Adding query filter params (role.id=04369f3c13174671a298fcd8175998d8, scope.project.id=87ea432faccb40e590632800fcca178a, user.id=1abf9cd855464cd184ef76e37d368839) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:01.107557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c751cd-ced4-4d33-99be-c0e494ee40dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:01.109056 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c751cd-ced4-4d33-99be-c0e494ee40dd None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:01.118940 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 131/266] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:52:00 2022] GET /identity/v3/role_assignments?user.id=1abf9cd855464cd184ef76e37d368839&scope.project.id=87ea432faccb40e590632800fcca178a&role.id=04369f3c13174671a298fcd8175998d8 => generated 608 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:52:01.168136 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef22723-8b95-4b86-aa00-85a0f84aabf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:01.168847 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef22723-8b95-4b86-aa00-85a0f84aabf5 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:01.169136 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef22723-8b95-4b86-aa00-85a0f84aabf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:01.169415 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef22723-8b95-4b86-aa00-85a0f84aabf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:01.237962 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac59a8a-5b93-4cb7-b7c0-53b8e59d2c97 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:01.238642 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac59a8a-5b93-4cb7-b7c0-53b8e59d2c97 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:01.239372 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac59a8a-5b93-4cb7-b7c0-53b8e59d2c97 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:01.241101 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 132/267] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:52:01.247580 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2012c-9254-4104-bcc8-5d8443022c64 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:01.248186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2012c-9254-4104-bcc8-5d8443022c64 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:01.248723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2012c-9254-4104-bcc8-5d8443022c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:01.276467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef22723-8b95-4b86-aa00-85a0f84aabf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:01.278308 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef22723-8b95-4b86-aa00-85a0f84aabf5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:01.278645 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4fd2012c-9254-4104-bcc8-5d8443022c64 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:01.280227 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4fd2012c-9254-4104-bcc8-5d8443022c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:01.317683 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:01.443617 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 133/268] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:52:01.452892 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 136/269] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:52:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:52:01.458079 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2012c-9254-4104-bcc8-5d8443022c64 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:01.483343 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef22723-8b95-4b86-aa00-85a0f84aabf5 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:01.589456 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2012c-9254-4104-bcc8-5d8443022c64 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:01.626547 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:01.643160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c6d30-1fb4-4840-b9d8-0ff2a4c6d11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:01.644388 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c6d30-1fb4-4840-b9d8-0ff2a4c6d11e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:01.644927 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c6d30-1fb4-4840-b9d8-0ff2a4c6d11e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:01.645393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c6d30-1fb4-4840-b9d8-0ff2a4c6d11e None admin] PATH_INFO: `/v3/projects/87ea432faccb40e590632800fcca178a` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:01.646939 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c6d30-1fb4-4840-b9d8-0ff2a4c6d11e None admin] RBAC: Authorizing `identity:get_project(project_id=87ea432faccb40e590632800fcca178a)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:01.648765 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c6d30-1fb4-4840-b9d8-0ff2a4c6d11e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:01.651328 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 134/270] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:52:01 2022] GET /identity/v3/projects/87ea432faccb40e590632800fcca178a => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:01.653291 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55098d-e1ec-4755-a0ae-c0959b99f215 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:01.653831 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55098d-e1ec-4755-a0ae-c0959b99f215 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:01.654317 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55098d-e1ec-4755-a0ae-c0959b99f215 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:01.656026 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 135/271] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:01.661337 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55098d-e1ec-4755-a0ae-c0959b99f215 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:01.663657 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef22723-8b95-4b86-aa00-85a0f84aabf5 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:01.717491 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b6620-71da-43da-8cf2-8024623128ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:01.718308 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b6620-71da-43da-8cf2-8024623128ae None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:01.718714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b6620-71da-43da-8cf2-8024623128ae None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:01.718992 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b6620-71da-43da-8cf2-8024623128ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:01.724055 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:01.734344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b6620-71da-43da-8cf2-8024623128ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:01.742575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-366b6620-71da-43da-8cf2-8024623128ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:52:01.742575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:01.742575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:01.742575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:01.742575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:01.742575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:01.742575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:01.742575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:01.742575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:01.742575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:01.742575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:01.742575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:01.742575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:01.742575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:01.742575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:01.742575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:01.743439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:01.743439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:01.743439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:01.743439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:01.743439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:01.743439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:01.743439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:01.743439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:01.743439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:01.743439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:01.743439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:01.743439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:01.743439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:01.743439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:01.743439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:01.743439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:01.744193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:01.744193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:01.744193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:01.744193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:01.744193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:01.744193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:01.744193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:01.744193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:01.744193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:01.744193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:01.744193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:52:01.744193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:01.746984 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 137/272] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:52:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:52:01.748358 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e404e-3a60-481a-bf20-faa0ab3f5d00 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:01.754630 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e404e-3a60-481a-bf20-faa0ab3f5d00 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:01.754974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e404e-3a60-481a-bf20-faa0ab3f5d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:01.774842 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-5a8e404e-3a60-481a-bf20-faa0ab3f5d00 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:01.777488 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5a8e404e-3a60-481a-bf20-faa0ab3f5d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:01.804679 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55098d-e1ec-4755-a0ae-c0959b99f215 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:01.844124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633df12b-711a-4c83-8f42-9e00d1909fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:01.844821 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633df12b-711a-4c83-8f42-9e00d1909fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:01.845106 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633df12b-711a-4c83-8f42-9e00d1909fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:01.845383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633df12b-711a-4c83-8f42-9e00d1909fd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:01.846452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633df12b-711a-4c83-8f42-9e00d1909fd6 None admin] RBAC: Adding query filter params (role.id=3fb2a96d6ee74a7dbd046488f5ec322b, scope.project.id=87ea432faccb40e590632800fcca178a, user.id=1abf9cd855464cd184ef76e37d368839) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:01.846955 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633df12b-711a-4c83-8f42-9e00d1909fd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:01.848414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633df12b-711a-4c83-8f42-9e00d1909fd6 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:01.856431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 136/274] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:52:01 2022] GET /identity/v3/role_assignments?user.id=1abf9cd855464cd184ef76e37d368839&scope.project.id=87ea432faccb40e590632800fcca178a&role.id=3fb2a96d6ee74a7dbd046488f5ec322b => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:01.856775 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 138/274] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:01.857458 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633df12b-711a-4c83-8f42-9e00d1909fd6 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:01.880357 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e404e-3a60-481a-bf20-faa0ab3f5d00 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:01.931273 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:01.983723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633df12b-711a-4c83-8f42-9e00d1909fd6 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:02.005070 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e404e-3a60-481a-bf20-faa0ab3f5d00 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:02.037217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:02.041875 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29e224-e5b0-4195-b0e5-0b58e63cf386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:02.042911 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29e224-e5b0-4195-b0e5-0b58e63cf386 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:02.043263 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29e224-e5b0-4195-b0e5-0b58e63cf386 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:02.043548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29e224-e5b0-4195-b0e5-0b58e63cf386 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:02.044337 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29e224-e5b0-4195-b0e5-0b58e63cf386 None admin] RBAC: Adding query filter params (name=member) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:02.044678 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29e224-e5b0-4195-b0e5-0b58e63cf386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:02.046123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29e224-e5b0-4195-b0e5-0b58e63cf386 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:02.047289 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc50aa-d21d-413e-9815-34335d180ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:02.048499 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc50aa-d21d-413e-9815-34335d180ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:02.049038 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc50aa-d21d-413e-9815-34335d180ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:02.049501 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc50aa-d21d-413e-9815-34335d180ed7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:02.050993 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc50aa-d21d-413e-9815-34335d180ed7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:02.053045 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc50aa-d21d-413e-9815-34335d180ed7 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:02.060190 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 139/275] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:52:02.061933 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc50aa-d21d-413e-9815-34335d180ed7 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:02.070672 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 137/276] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 21:52:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:02.077489 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29e224-e5b0-4195-b0e5-0b58e63cf386 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:02.196297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29e224-e5b0-4195-b0e5-0b58e63cf386 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:02.227156 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:02.248882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a311cf5-9017-43c3-a448-5d9bcf4adead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:02.249777 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a311cf5-9017-43c3-a448-5d9bcf4adead None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:02.250253 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a311cf5-9017-43c3-a448-5d9bcf4adead None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:02.250692 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a311cf5-9017-43c3-a448-5d9bcf4adead None admin] PATH_INFO: `/v3/users/8da79b5277694a5dbfc8a996b7b18eb1` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:02.258172 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc50aa-d21d-413e-9815-34335d180ed7 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:02.270838 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a311cf5-9017-43c3-a448-5d9bcf4adead None admin] RBAC: Authorizing `identity:get_user(user_id=8da79b5277694a5dbfc8a996b7b18eb1)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:02.272676 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a311cf5-9017-43c3-a448-5d9bcf4adead None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:02.275395 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 138/277] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:52:02 2022] GET /identity/v3/users/8da79b5277694a5dbfc8a996b7b18eb1 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:02.278049 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f176c-18bb-4aac-b948-3a96a93ecc3f None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:02.278524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f176c-18bb-4aac-b948-3a96a93ecc3f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:02.278934 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f176c-18bb-4aac-b948-3a96a93ecc3f None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:02.280541 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 139/278] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:02.282515 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f176c-18bb-4aac-b948-3a96a93ecc3f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:02.311840 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ec679-f69d-4ba9-802d-26b544e73e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:02.312667 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ec679-f69d-4ba9-802d-26b544e73e0f None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:02.312956 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ec679-f69d-4ba9-802d-26b544e73e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:02.313241 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ec679-f69d-4ba9-802d-26b544e73e0f None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:02.313970 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ec679-f69d-4ba9-802d-26b544e73e0f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:02.315446 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ec679-f69d-4ba9-802d-26b544e73e0f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:02.348614 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 140/279] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 21:52:02 2022] POST /identity/v3/users => generated 293 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:52:02.350068 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf449427-ba80-462d-9d9c-9de8ce3d7fcb None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:02.350399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf449427-ba80-462d-9d9c-9de8ce3d7fcb None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:02.350685 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf449427-ba80-462d-9d9c-9de8ce3d7fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:02.380361 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-bf449427-ba80-462d-9d9c-9de8ce3d7fcb None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:02.381486 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-bf449427-ba80-462d-9d9c-9de8ce3d7fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:02.441269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f176c-18bb-4aac-b948-3a96a93ecc3f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:02.460331 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:02.481571 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532b301-c992-4851-b5bb-aaa405d9af5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:02.482287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532b301-c992-4851-b5bb-aaa405d9af5e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:02.482565 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532b301-c992-4851-b5bb-aaa405d9af5e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:02.482888 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532b301-c992-4851-b5bb-aaa405d9af5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:02.483745 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532b301-c992-4851-b5bb-aaa405d9af5e None admin] RBAC: Adding query filter params (role.id=4749055b54a542b29f57155df3756136, user.id=8da79b5277694a5dbfc8a996b7b18eb1, scope.system=all) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:02.484056 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532b301-c992-4851-b5bb-aaa405d9af5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:02.485599 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532b301-c992-4851-b5bb-aaa405d9af5e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:02.496526 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 140/280] 10.222.0.35 () {56 vars in 1308 bytes} [Thu May 19 21:52:02 2022] GET /identity/v3/role_assignments?user.id=8da79b5277694a5dbfc8a996b7b18eb1&scope.system=all&role.id=4749055b54a542b29f57155df3756136 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:52:02.498289 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 141/281] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:02.521405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532b301-c992-4851-b5bb-aaa405d9af5e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:02.574842 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:02.653305 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532b301-c992-4851-b5bb-aaa405d9af5e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:02.695722 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8eef0c-ad4c-4a2d-b383-3ecc80080573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:02.696570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8eef0c-ad4c-4a2d-b383-3ecc80080573 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:02.696855 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8eef0c-ad4c-4a2d-b383-3ecc80080573 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:02.697126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8eef0c-ad4c-4a2d-b383-3ecc80080573 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:02.710526 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8eef0c-ad4c-4a2d-b383-3ecc80080573 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:02.718703 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-3f8eef0c-ad4c-4a2d-b383-3ecc80080573 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:52:02.718703 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:02.718703 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:02.718703 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:02.718703 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:02.718703 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:02.718703 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:02.718703 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:02.718703 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:02.718703 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:02.718703 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:02.718703 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:02.718703 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:02.718703 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:02.718703 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:02.718703 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:02.719575 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:02.719575 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:02.719575 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:02.719575 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:02.719575 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:02.719575 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:02.719575 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:02.719575 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:02.719575 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:02.719575 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:02.719575 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:02.719575 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:02.719575 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:02.719575 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:02.719575 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:02.719575 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:02.720379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:02.720379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:02.720379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:02.720379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:02.720379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:02.720379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:02.720379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:02.720379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:02.720379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:02.720379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:02.720379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:52:02.720379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:02.720379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 141/282] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:52:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:02.726002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf449427-ba80-462d-9d9c-9de8ce3d7fcb None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:02.851175 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf449427-ba80-462d-9d9c-9de8ce3d7fcb None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:02.889505 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc78bc-9c1d-4d2d-b87c-9978d05aa326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:02.890185 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc78bc-9c1d-4d2d-b87c-9978d05aa326 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:02.890468 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc78bc-9c1d-4d2d-b87c-9978d05aa326 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:02.890743 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc78bc-9c1d-4d2d-b87c-9978d05aa326 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:02.891505 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc78bc-9c1d-4d2d-b87c-9978d05aa326 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:02.891809 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc78bc-9c1d-4d2d-b87c-9978d05aa326 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:02.893234 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc78bc-9c1d-4d2d-b87c-9978d05aa326 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:02.911969 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 142/283] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 21:52:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:02.920517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8eef0c-ad4c-4a2d-b383-3ecc80080573 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:03.041964 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8eef0c-ad4c-4a2d-b383-3ecc80080573 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:03.044710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:03.103481 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef7db7-ea90-47e2-a1e3-62aea3b17552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:03.104827 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef7db7-ea90-47e2-a1e3-62aea3b17552 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:03.105122 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef7db7-ea90-47e2-a1e3-62aea3b17552 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:03.105401 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef7db7-ea90-47e2-a1e3-62aea3b17552 None admin] PATH_INFO: `/v3/users/920dceaf58604c97b520e3aea58e1d42` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:03.106684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef7db7-ea90-47e2-a1e3-62aea3b17552 None admin] RBAC: Authorizing `identity:get_user(user_id=920dceaf58604c97b520e3aea58e1d42)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:03.108234 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef7db7-ea90-47e2-a1e3-62aea3b17552 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:03.110004 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 142/284] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:52:02 2022] GET /identity/v3/users/920dceaf58604c97b520e3aea58e1d42 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:03.116165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc78bc-9c1d-4d2d-b87c-9978d05aa326 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:03.196960 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:03.250296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc78bc-9c1d-4d2d-b87c-9978d05aa326 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:03.295355 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e2ab8-fc27-4ee1-86b9-a52cc76a6d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:03.296152 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e2ab8-fc27-4ee1-86b9-a52cc76a6d05 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:03.296523 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e2ab8-fc27-4ee1-86b9-a52cc76a6d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:03.296939 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e2ab8-fc27-4ee1-86b9-a52cc76a6d05 None admin] PATH_INFO: `/v3/projects/87ea432faccb40e590632800fcca178a` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:03.298236 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e2ab8-fc27-4ee1-86b9-a52cc76a6d05 None admin] RBAC: Authorizing `identity:get_project(project_id=87ea432faccb40e590632800fcca178a)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:03.299712 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e2ab8-fc27-4ee1-86b9-a52cc76a6d05 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:03.304536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 143/285] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:52:03 2022] GET /identity/v3/projects/87ea432faccb40e590632800fcca178a => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:03.308187 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef7db7-ea90-47e2-a1e3-62aea3b17552 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:03.432451 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef7db7-ea90-47e2-a1e3-62aea3b17552 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:03.468389 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321d30c-c66e-455b-82de-a485779b2694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:03.469385 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321d30c-c66e-455b-82de-a485779b2694 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:03.469672 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321d30c-c66e-455b-82de-a485779b2694 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:03.469946 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321d30c-c66e-455b-82de-a485779b2694 None admin] PATH_INFO: `/v3/projects/87ea432faccb40e590632800fcca178a/users/920dceaf58604c97b520e3aea58e1d42/roles/c6035635160b420194220cbe44e1abb9` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:03.472109 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321d30c-c66e-455b-82de-a485779b2694 None admin] RBAC: Authorizing `identity:create_grant(project_id=87ea432faccb40e590632800fcca178a, user_id=920dceaf58604c97b520e3aea58e1d42, role_id=c6035635160b420194220cbe44e1abb9)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:03.473649 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321d30c-c66e-455b-82de-a485779b2694 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:03.498259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 143/286] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 21:52:03 2022] PUT /identity/v3/projects/87ea432faccb40e590632800fcca178a/users/920dceaf58604c97b520e3aea58e1d42/roles/c6035635160b420194220cbe44e1abb9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:52:03.734970 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0813df2-d9a4-49ad-b87d-889f4bd5e014 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:03.735371 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0813df2-d9a4-49ad-b87d-889f4bd5e014 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:03.735580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0813df2-d9a4-49ad-b87d-889f4bd5e014 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:03.737379 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 144/287] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:03.743222 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68b6dc-8801-4ce5-901f-a6ea184ba947 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:03.743523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68b6dc-8801-4ce5-901f-a6ea184ba947 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:03.743787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68b6dc-8801-4ce5-901f-a6ea184ba947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:03.765630 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-aa68b6dc-8801-4ce5-901f-a6ea184ba947 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:03.766851 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-aa68b6dc-8801-4ce5-901f-a6ea184ba947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:03.805943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:03.870479 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 144/288] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:03.899087 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0813df2-d9a4-49ad-b87d-889f4bd5e014 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:04.022452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0813df2-d9a4-49ad-b87d-889f4bd5e014 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:04.044795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:04.082075 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f65ce-cbed-4d17-ab38-c98385d98fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:04.082890 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f65ce-cbed-4d17-ab38-c98385d98fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:04.083172 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f65ce-cbed-4d17-ab38-c98385d98fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:04.083446 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f65ce-cbed-4d17-ab38-c98385d98fa2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:04.099916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f65ce-cbed-4d17-ab38-c98385d98fa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:04.108007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-606f65ce-cbed-4d17-ab38-c98385d98fa2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:52:04.108007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:04.108007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:04.108007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:04.108007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:04.108007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:04.108007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:04.108007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:04.108007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:04.108007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:04.108007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:04.108007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:04.108007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:04.108007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:04.108007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:04.108007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:04.108997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:04.108997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:04.108997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:04.108997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:04.108997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:04.108997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:04.108997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:04.108997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:04.108997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:04.108997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:04.108997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:04.108997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:04.108997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:04.108997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:04.108997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:04.108997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:04.109777 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:04.109777 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:04.109777 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:04.109777 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:04.109777 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:04.109777 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:04.109777 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:04.109777 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:04.109777 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:04.109777 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:04.109777 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:52:04.109777 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:04.117412 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 145/289] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:52:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:04.123739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68b6dc-8801-4ce5-901f-a6ea184ba947 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:04.271190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68b6dc-8801-4ce5-901f-a6ea184ba947 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:04.313757 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636cba1-f29d-416b-a7b4-8304b4642ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:04.314360 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636cba1-f29d-416b-a7b4-8304b4642ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:04.314641 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636cba1-f29d-416b-a7b4-8304b4642ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:04.314914 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636cba1-f29d-416b-a7b4-8304b4642ca1 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:04.315674 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636cba1-f29d-416b-a7b4-8304b4642ca1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:04.315979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636cba1-f29d-416b-a7b4-8304b4642ca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:04.317386 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636cba1-f29d-416b-a7b4-8304b4642ca1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:04.327123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 145/290] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 21:52:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:04.333486 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f65ce-cbed-4d17-ab38-c98385d98fa2 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:04.489411 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f65ce-cbed-4d17-ab38-c98385d98fa2 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:04.527243 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7edac-f4b0-4e49-97b4-bfdb2293339e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:04.528124 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7edac-f4b0-4e49-97b4-bfdb2293339e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:04.528419 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7edac-f4b0-4e49-97b4-bfdb2293339e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:04.528702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7edac-f4b0-4e49-97b4-bfdb2293339e None admin] PATH_INFO: `/v3/users/7be00449a9c84f38b2d6c2fd13c1feb3` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:04.529912 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7edac-f4b0-4e49-97b4-bfdb2293339e None admin] RBAC: Authorizing `identity:get_user(user_id=7be00449a9c84f38b2d6c2fd13c1feb3)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:04.531352 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7edac-f4b0-4e49-97b4-bfdb2293339e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:04.533313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 146/291] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:52:04 2022] GET /identity/v3/users/7be00449a9c84f38b2d6c2fd13c1feb3 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:04.539047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636cba1-f29d-416b-a7b4-8304b4642ca1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:04.579595 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:04.705578 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636cba1-f29d-416b-a7b4-8304b4642ca1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:04.760947 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81160e83-69cd-4f21-ad33-fd2433e2d373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:04.761983 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81160e83-69cd-4f21-ad33-fd2433e2d373 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:04.762473 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81160e83-69cd-4f21-ad33-fd2433e2d373 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:04.763059 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81160e83-69cd-4f21-ad33-fd2433e2d373 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:04.857153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81160e83-69cd-4f21-ad33-fd2433e2d373 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:04.858945 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81160e83-69cd-4f21-ad33-fd2433e2d373 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:04.885679 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:04.974619 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 146/292] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:52:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:52:04.985700 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7edac-f4b0-4e49-97b4-bfdb2293339e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:05.062799 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:05.159393 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7edac-f4b0-4e49-97b4-bfdb2293339e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:05.204841 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecd081-2fcd-4e8d-ac1f-b348820bec81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:05.205712 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecd081-2fcd-4e8d-ac1f-b348820bec81 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:05.205993 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecd081-2fcd-4e8d-ac1f-b348820bec81 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:05.206269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecd081-2fcd-4e8d-ac1f-b348820bec81 None admin] PATH_INFO: `/v3/projects/87ea432faccb40e590632800fcca178a` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:05.209134 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fecd081-2fcd-4e8d-ac1f-b348820bec81 None admin] RBAC: Authorizing `identity:get_project(project_id=87ea432faccb40e590632800fcca178a)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:05.210603 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fecd081-2fcd-4e8d-ac1f-b348820bec81 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:05.212653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 147/293] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:52:04 2022] GET /identity/v3/projects/87ea432faccb40e590632800fcca178a => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:05.218306 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81160e83-69cd-4f21-ad33-fd2433e2d373 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:05.340431 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ce2f8-7525-4f49-8eb1-5aa9e38f4e05 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:05.340926 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ce2f8-7525-4f49-8eb1-5aa9e38f4e05 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:05.340998 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ce2f8-7525-4f49-8eb1-5aa9e38f4e05 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:05.342356 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 148/294] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:52:05.349253 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98640073-25bc-42ca-9aa6-1b830fe1dabe None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:05.349914 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98640073-25bc-42ca-9aa6-1b830fe1dabe None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:05.350388 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98640073-25bc-42ca-9aa6-1b830fe1dabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:05.370947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-98640073-25bc-42ca-9aa6-1b830fe1dabe None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:05.372800 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-98640073-25bc-42ca-9aa6-1b830fe1dabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:05.434572 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81160e83-69cd-4f21-ad33-fd2433e2d373 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:05.457088 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 149/295] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:52:05.467927 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4713f71-abe5-42a0-8b5d-d67004e56b11 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:05.468217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4713f71-abe5-42a0-8b5d-d67004e56b11 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:05.468535 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4713f71-abe5-42a0-8b5d-d67004e56b11 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:05.470253 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 150/296] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:52:05.475293 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5a020-5c75-42ec-abb7-3c93d0097d3f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:05.475574 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5a020-5c75-42ec-abb7-3c93d0097d3f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:05.475851 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5a020-5c75-42ec-abb7-3c93d0097d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:05.497374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-91c5a020-5c75-42ec-abb7-3c93d0097d3f None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:05.499171 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-91c5a020-5c75-42ec-abb7-3c93d0097d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:05.500764 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:05.509167 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b5706-af1d-4f9e-b0e7-4244ac934fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:05.511251 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b5706-af1d-4f9e-b0e7-4244ac934fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:05.511801 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b5706-af1d-4f9e-b0e7-4244ac934fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:05.512273 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b5706-af1d-4f9e-b0e7-4244ac934fe2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:05.514169 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b5706-af1d-4f9e-b0e7-4244ac934fe2 None admin] RBAC: Adding query filter params (role.id=4749055b54a542b29f57155df3756136, scope.project.id=87ea432faccb40e590632800fcca178a, user.id=7be00449a9c84f38b2d6c2fd13c1feb3) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:05.514739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b5706-af1d-4f9e-b0e7-4244ac934fe2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:05.516686 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b5706-af1d-4f9e-b0e7-4244ac934fe2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:05.525179 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 147/297] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:52:05 2022] GET /identity/v3/role_assignments?user.id=7be00449a9c84f38b2d6c2fd13c1feb3&scope.project.id=87ea432faccb40e590632800fcca178a&role.id=4749055b54a542b29f57155df3756136 => generated 608 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:05.526659 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b5706-af1d-4f9e-b0e7-4244ac934fe2 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:05.537826 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:05.591260 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 151/298] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:52:05.622050 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5a020-5c75-42ec-abb7-3c93d0097d3f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:05.683685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b5706-af1d-4f9e-b0e7-4244ac934fe2 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:05.748759 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f5c65-d04a-48ac-a33c-7314faeb39ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:05.749498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f5c65-d04a-48ac-a33c-7314faeb39ee None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:05.751800 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f5c65-d04a-48ac-a33c-7314faeb39ee None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:05.752124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f5c65-d04a-48ac-a33c-7314faeb39ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:05.781359 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5a020-5c75-42ec-abb7-3c93d0097d3f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:05.783857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f5c65-d04a-48ac-a33c-7314faeb39ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:05.798893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-815f5c65-d04a-48ac-a33c-7314faeb39ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:52:05.798893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:05.798893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:05.798893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:05.798893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:05.798893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:05.798893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:05.798893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:05.798893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:05.798893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:05.798893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:05.798893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:05.798893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:05.798893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:05.798893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:05.798893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:05.799857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:05.799857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:05.799857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:05.799857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:05.799857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:05.799857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:05.799857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:05.799857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:05.799857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:05.799857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:05.799857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:05.799857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:05.799857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:05.799857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:05.799857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:05.799857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:05.800670 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:05.800670 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:05.800670 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:05.800670 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:05.800670 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:05.800670 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:05.800670 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:05.800670 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:05.800670 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:05.800670 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:05.800670 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:52:05.800670 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:05.804858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 148/299] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:52:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:05.808842 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f5c65-d04a-48ac-a33c-7314faeb39ee None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:05.875224 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2d37a-7a0f-4a2b-85eb-da33be8f58c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:05.876065 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2d37a-7a0f-4a2b-85eb-da33be8f58c1 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:05.876508 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2d37a-7a0f-4a2b-85eb-da33be8f58c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:05.876793 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2d37a-7a0f-4a2b-85eb-da33be8f58c1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:05.892872 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2d37a-7a0f-4a2b-85eb-da33be8f58c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:05.894211 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:05.906435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-d5b2d37a-7a0f-4a2b-85eb-da33be8f58c1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:52:05.906435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:05.906435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:05.906435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:05.906435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:05.906435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:05.906435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:05.906435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:05.906435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:05.906435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:05.906435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:05.906435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:05.906435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:05.906435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:05.906435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:05.906435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:05.907383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:05.907383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:05.907383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:05.907383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:05.907383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:05.907383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:05.907383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:05.907383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:05.907383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:05.907383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:05.907383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:05.907383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:05.907383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:05.907383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:05.907383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:05.907383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:05.908710 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:05.908710 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:05.908710 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:05.908710 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:05.908710 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:05.908710 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:05.908710 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:05.908710 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:05.908710 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:05.908710 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:05.908710 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:52:05.908710 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:05.908710 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 152/300] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:52:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:05.913778 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2d37a-7a0f-4a2b-85eb-da33be8f58c1 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:05.958189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:05.971949 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f5c65-d04a-48ac-a33c-7314faeb39ee None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:06.014877 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e2f25-63ed-4a71-87be-46cd5a0e48b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:06.015474 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e2f25-63ed-4a71-87be-46cd5a0e48b4 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:06.015906 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e2f25-63ed-4a71-87be-46cd5a0e48b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:06.016090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e2f25-63ed-4a71-87be-46cd5a0e48b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:06.016848 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e2f25-63ed-4a71-87be-46cd5a0e48b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:06.017159 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e2f25-63ed-4a71-87be-46cd5a0e48b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:06.019350 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e2f25-63ed-4a71-87be-46cd5a0e48b4 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:06.037018 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 149/301] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 21:52:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:06.042444 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba43e7-46ed-47f6-b749-815b47c01742 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:06.042444 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba43e7-46ed-47f6-b749-815b47c01742 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:06.042444 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba43e7-46ed-47f6-b749-815b47c01742 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:06.042444 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 150/302] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:06.045692 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba43e7-46ed-47f6-b749-815b47c01742 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:06.055741 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2d37a-7a0f-4a2b-85eb-da33be8f58c1 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:06.102311 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29b04e-c17f-45d8-b58f-f6919417fbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:06.103450 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29b04e-c17f-45d8-b58f-f6919417fbc6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:06.103796 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29b04e-c17f-45d8-b58f-f6919417fbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:06.104532 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29b04e-c17f-45d8-b58f-f6919417fbc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:06.105374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29b04e-c17f-45d8-b58f-f6919417fbc6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:06.105687 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29b04e-c17f-45d8-b58f-f6919417fbc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:06.107092 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29b04e-c17f-45d8-b58f-f6919417fbc6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:06.121029 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 153/303] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 21:52:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:52:06.121029 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437bf22-6e29-4c20-87e4-2107f1ad84e0 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:06.121029 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437bf22-6e29-4c20-87e4-2107f1ad84e0 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:06.121029 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437bf22-6e29-4c20-87e4-2107f1ad84e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:06.147054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8437bf22-6e29-4c20-87e4-2107f1ad84e0 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:06.148542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8437bf22-6e29-4c20-87e4-2107f1ad84e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:06.186258 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba43e7-46ed-47f6-b749-815b47c01742 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:06.201660 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:06.232902 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07719267-af62-4e28-a42f-00d2843bdf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:06.234115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07719267-af62-4e28-a42f-00d2843bdf42 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:06.234510 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07719267-af62-4e28-a42f-00d2843bdf42 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:06.235170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07719267-af62-4e28-a42f-00d2843bdf42 None admin] PATH_INFO: `/v3/users/8da79b5277694a5dbfc8a996b7b18eb1` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:06.236671 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07719267-af62-4e28-a42f-00d2843bdf42 None admin] RBAC: Authorizing `identity:get_user(user_id=8da79b5277694a5dbfc8a996b7b18eb1)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:06.238502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07719267-af62-4e28-a42f-00d2843bdf42 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:06.241658 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 151/304] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:52:06 2022] GET /identity/v3/users/8da79b5277694a5dbfc8a996b7b18eb1 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:06.242543 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07719267-af62-4e28-a42f-00d2843bdf42 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:06.267014 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 154/305] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:06.268626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437bf22-6e29-4c20-87e4-2107f1ad84e0 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:06.295713 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:06.396876 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07719267-af62-4e28-a42f-00d2843bdf42 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:06.400340 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437bf22-6e29-4c20-87e4-2107f1ad84e0 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:06.433871 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6fa4d4-d2ec-4293-b84f-59eb5cb37632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:06.434863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fa4d4-d2ec-4293-b84f-59eb5cb37632 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:06.435145 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fa4d4-d2ec-4293-b84f-59eb5cb37632 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:06.435420 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fa4d4-d2ec-4293-b84f-59eb5cb37632 None admin] PATH_INFO: `/v3/users/5e6549a19fae4fe6a947597df7056406` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:06.439626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5370d-77c8-48ac-aa8b-a788199c2794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:06.440575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5370d-77c8-48ac-aa8b-a788199c2794 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:06.440862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5370d-77c8-48ac-aa8b-a788199c2794 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:06.441149 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5370d-77c8-48ac-aa8b-a788199c2794 None admin] PATH_INFO: `/v3/system/users/8da79b5277694a5dbfc8a996b7b18eb1/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:06.442743 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5370d-77c8-48ac-aa8b-a788199c2794 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8da79b5277694a5dbfc8a996b7b18eb1, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:06.444165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5370d-77c8-48ac-aa8b-a788199c2794 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:06.454070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6fa4d4-d2ec-4293-b84f-59eb5cb37632 None admin] RBAC: Authorizing `identity:get_user(user_id=5e6549a19fae4fe6a947597df7056406)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:06.462784 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 155/306] 10.222.0.35 () {58 vars in 1334 bytes} [Thu May 19 21:52:06 2022] PUT /identity/v3/system/users/8da79b5277694a5dbfc8a996b7b18eb1/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:52:06.462784 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5370d-77c8-48ac-aa8b-a788199c2794 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:06.463034 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6fa4d4-d2ec-4293-b84f-59eb5cb37632 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:06.463034 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 152/307] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:52:06 2022] GET /identity/v3/users/5e6549a19fae4fe6a947597df7056406 => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:06.463034 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad8e80-aa9b-48c0-9a89-ed1186d03c7c None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:06.463034 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad8e80-aa9b-48c0-9a89-ed1186d03c7c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:06.463034 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad8e80-aa9b-48c0-9a89-ed1186d03c7c None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:06.463034 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 153/308] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:06.469255 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586a509-f8f3-4b5d-86f5-085bd95f921e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:06.469255 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586a509-f8f3-4b5d-86f5-085bd95f921e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:06.469255 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586a509-f8f3-4b5d-86f5-085bd95f921e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:06.504394 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8586a509-f8f3-4b5d-86f5-085bd95f921e None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:06.505738 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8586a509-f8f3-4b5d-86f5-085bd95f921e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:06.537847 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:06.582950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:06.600929 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 154/309] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:52:06.603529 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586a509-f8f3-4b5d-86f5-085bd95f921e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:06.628163 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5370d-77c8-48ac-aa8b-a788199c2794 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:06.674908 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdaaec-07a8-4255-a04b-4fa4e168471a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:06.675721 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdaaec-07a8-4255-a04b-4fa4e168471a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:06.676016 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdaaec-07a8-4255-a04b-4fa4e168471a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:06.676285 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdaaec-07a8-4255-a04b-4fa4e168471a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:06.677803 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffdaaec-07a8-4255-a04b-4fa4e168471a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:06.679326 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffdaaec-07a8-4255-a04b-4fa4e168471a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:06.681020 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 156/310] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:06.682640 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdaaec-07a8-4255-a04b-4fa4e168471a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:06.738679 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586a509-f8f3-4b5d-86f5-085bd95f921e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:06.779087 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2795b0c-de24-4192-8515-216def48181f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:06.779758 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2795b0c-de24-4192-8515-216def48181f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:06.780045 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2795b0c-de24-4192-8515-216def48181f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:06.780324 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2795b0c-de24-4192-8515-216def48181f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:06.781193 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2795b0c-de24-4192-8515-216def48181f None admin] RBAC: Adding query filter params (role.id=c6035635160b420194220cbe44e1abb9, user.id=5e6549a19fae4fe6a947597df7056406, scope.system=all) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:06.781946 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2795b0c-de24-4192-8515-216def48181f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:06.783694 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2795b0c-de24-4192-8515-216def48181f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:06.794595 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 155/311] 10.222.0.35 () {56 vars in 1308 bytes} [Thu May 19 21:52:06 2022] GET /identity/v3/role_assignments?user.id=5e6549a19fae4fe6a947597df7056406&scope.system=all&role.id=c6035635160b420194220cbe44e1abb9 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:06.795835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2795b0c-de24-4192-8515-216def48181f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:06.804635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdaaec-07a8-4255-a04b-4fa4e168471a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:06.840426 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:06.861291 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68c61b-65a5-41b4-ad12-9fbe617029ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:06.862441 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68c61b-65a5-41b4-ad12-9fbe617029ab None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:06.862894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68c61b-65a5-41b4-ad12-9fbe617029ab None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:06.864291 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68c61b-65a5-41b4-ad12-9fbe617029ab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:06.882898 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68c61b-65a5-41b4-ad12-9fbe617029ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:06.895531 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-cf68c61b-65a5-41b4-ad12-9fbe617029ab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:52:06.895531 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:06.895531 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:06.895531 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:06.895531 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:06.895531 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:06.895531 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:06.895531 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:06.895531 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:06.895531 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:06.895531 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:06.895531 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:06.895531 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:06.895531 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:06.895531 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:06.895531 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:06.896764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:06.896764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:06.896764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:06.896764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:06.896764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:06.896764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:06.896764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:06.896764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:06.896764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:06.896764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:06.896764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:06.896764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:06.896764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:06.896764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:06.896764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:06.896764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:06.897727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:06.897727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:06.897727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:06.897727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:06.897727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:06.897727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:06.897727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:06.897727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:06.897727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:06.897727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:06.897727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:52:06.897727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:06.898450 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 157/312] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:52:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:06.906180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68c61b-65a5-41b4-ad12-9fbe617029ab None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:06.924738 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:06.942406 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2795b0c-de24-4192-8515-216def48181f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:06.988939 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e928d-71bd-448f-a2e2-555c10370be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:06.990039 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e928d-71bd-448f-a2e2-555c10370be5 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:06.990432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e928d-71bd-448f-a2e2-555c10370be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:06.990815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e928d-71bd-448f-a2e2-555c10370be5 None admin] PATH_INFO: `/v3/groups` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:06.991642 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e928d-71bd-448f-a2e2-555c10370be5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:06.993276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e928d-71bd-448f-a2e2-555c10370be5 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:07.018092 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 156/313] 10.222.0.35 () {60 vars in 1134 bytes} [Thu May 19 21:52:06 2022] POST /identity/v3/groups => generated 229 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:52:07.035725 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68c61b-65a5-41b4-ad12-9fbe617029ab None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:07.080167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3bcda-455b-4ebf-a338-aa71c1344108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:07.080927 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3bcda-455b-4ebf-a338-aa71c1344108 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:07.081217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3bcda-455b-4ebf-a338-aa71c1344108 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:07.081495 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3bcda-455b-4ebf-a338-aa71c1344108 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:07.082285 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3bcda-455b-4ebf-a338-aa71c1344108 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:07.082593 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3bcda-455b-4ebf-a338-aa71c1344108 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:07.084055 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3bcda-455b-4ebf-a338-aa71c1344108 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:07.095055 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 158/314] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 21:52:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:07.100925 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e928d-71bd-448f-a2e2-555c10370be5 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:07.213713 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:07.237057 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e928d-71bd-448f-a2e2-555c10370be5 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:07.276747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94f50d-a1dd-4b37-9777-34a116bf401c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:07.277944 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94f50d-a1dd-4b37-9777-34a116bf401c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:07.278379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94f50d-a1dd-4b37-9777-34a116bf401c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:07.278792 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94f50d-a1dd-4b37-9777-34a116bf401c None admin] PATH_INFO: `/v3/users/920dceaf58604c97b520e3aea58e1d42` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:07.280280 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94f50d-a1dd-4b37-9777-34a116bf401c None admin] RBAC: Authorizing `identity:get_user(user_id=920dceaf58604c97b520e3aea58e1d42)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:07.282224 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94f50d-a1dd-4b37-9777-34a116bf401c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:07.284346 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 157/315] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:52:07 2022] GET /identity/v3/users/920dceaf58604c97b520e3aea58e1d42 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:07.290082 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3bcda-455b-4ebf-a338-aa71c1344108 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:07.385967 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:07.418849 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3bcda-455b-4ebf-a338-aa71c1344108 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:07.460060 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93472c-724d-46e9-88af-f03594cb2753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:07.460750 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93472c-724d-46e9-88af-f03594cb2753 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:07.461036 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93472c-724d-46e9-88af-f03594cb2753 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:07.461314 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93472c-724d-46e9-88af-f03594cb2753 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:07.535201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93472c-724d-46e9-88af-f03594cb2753 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:07.536726 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93472c-724d-46e9-88af-f03594cb2753 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:07.621843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:07.650600 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 159/316] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:52:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:52:07.655726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94f50d-a1dd-4b37-9777-34a116bf401c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:07.767806 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94f50d-a1dd-4b37-9777-34a116bf401c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:07.803018 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394cf61-bab5-44b6-9f42-b30496ec37ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:07.803901 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394cf61-bab5-44b6-9f42-b30496ec37ce None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:07.804190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394cf61-bab5-44b6-9f42-b30496ec37ce None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:07.804496 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394cf61-bab5-44b6-9f42-b30496ec37ce None admin] PATH_INFO: `/v3/projects/87ea432faccb40e590632800fcca178a` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:07.805733 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394cf61-bab5-44b6-9f42-b30496ec37ce None admin] RBAC: Authorizing `identity:get_project(project_id=87ea432faccb40e590632800fcca178a)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:07.808090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394cf61-bab5-44b6-9f42-b30496ec37ce None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:07.809903 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 158/317] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:52:07 2022] GET /identity/v3/projects/87ea432faccb40e590632800fcca178a => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:07.815528 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93472c-724d-46e9-88af-f03594cb2753 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:07.930973 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93472c-724d-46e9-88af-f03594cb2753 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:07.975002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30760b-98f5-4213-8999-682c850c2bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:07.976203 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30760b-98f5-4213-8999-682c850c2bfa None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:07.976521 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30760b-98f5-4213-8999-682c850c2bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:07.976854 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30760b-98f5-4213-8999-682c850c2bfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:07.977795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30760b-98f5-4213-8999-682c850c2bfa None admin] RBAC: Adding query filter params (role.id=c6035635160b420194220cbe44e1abb9, scope.project.id=87ea432faccb40e590632800fcca178a, user.id=920dceaf58604c97b520e3aea58e1d42) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:07.978187 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30760b-98f5-4213-8999-682c850c2bfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:07.980209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30760b-98f5-4213-8999-682c850c2bfa None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:07.986862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 160/318] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:52:07 2022] GET /identity/v3/role_assignments?user.id=920dceaf58604c97b520e3aea58e1d42&scope.project.id=87ea432faccb40e590632800fcca178a&role.id=c6035635160b420194220cbe44e1abb9 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:08.833604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44cd9b-08db-4ca3-bcfd-e8959c901143 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:08.834123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44cd9b-08db-4ca3-bcfd-e8959c901143 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:08.834197 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44cd9b-08db-4ca3-bcfd-e8959c901143 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:08.835717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 159/319] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:08.841430 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f507a26-49ef-4c8e-830c-f665adf2c55a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:08.841929 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f507a26-49ef-4c8e-830c-f665adf2c55a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:08.841999 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f507a26-49ef-4c8e-830c-f665adf2c55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:08.859432 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-9f507a26-49ef-4c8e-830c-f665adf2c55a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:08.860636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9f507a26-49ef-4c8e-830c-f665adf2c55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:08.894104 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:08.935325 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 161/320] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:08.958798 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44cd9b-08db-4ca3-bcfd-e8959c901143 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:08.988389 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:09.072162 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44cd9b-08db-4ca3-bcfd-e8959c901143 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:09.116781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fed4e2-40aa-4bc9-bdf6-0222c7c0797f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:09.117523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fed4e2-40aa-4bc9-bdf6-0222c7c0797f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:09.117804 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fed4e2-40aa-4bc9-bdf6-0222c7c0797f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:09.118077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fed4e2-40aa-4bc9-bdf6-0222c7c0797f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:09.130382 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fed4e2-40aa-4bc9-bdf6-0222c7c0797f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:09.138297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-03fed4e2-40aa-4bc9-bdf6-0222c7c0797f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:52:09.138297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:09.138297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:09.138297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:09.138297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:09.138297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:09.138297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:09.138297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:09.138297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:09.138297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:09.138297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:09.138297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:09.138297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:09.138297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:09.138297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:09.138297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:09.139124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:09.139124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:09.139124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:09.139124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:09.139124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:09.139124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:09.139124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:09.139124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:09.139124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:09.139124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:09.139124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:09.139124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:09.139124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:09.139124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:09.139124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:09.139124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:09.140013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:09.140013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:09.140013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:09.140013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:09.140013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:09.140013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:09.140013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:09.140013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:09.140013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:09.140013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:09.140013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:52:09.140013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:09.140013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 160/321] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:52:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:09.145409 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f507a26-49ef-4c8e-830c-f665adf2c55a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:09.261463 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f507a26-49ef-4c8e-830c-f665adf2c55a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:09.292438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd1828-0751-4702-82d8-3546ebdbfe5f None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:09.292751 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd1828-0751-4702-82d8-3546ebdbfe5f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:09.293034 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd1828-0751-4702-82d8-3546ebdbfe5f None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:09.294441 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 161/322] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:09.299878 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64227ffe-9935-4f96-9549-68a0a5839321 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:09.300330 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64227ffe-9935-4f96-9549-68a0a5839321 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:09.300477 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64227ffe-9935-4f96-9549-68a0a5839321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:09.301937 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882183b-48a3-4f7b-b9f7-7a0609c03e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:09.302630 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882183b-48a3-4f7b-b9f7-7a0609c03e29 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:09.303096 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882183b-48a3-4f7b-b9f7-7a0609c03e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:09.303267 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882183b-48a3-4f7b-b9f7-7a0609c03e29 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:09.304543 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882183b-48a3-4f7b-b9f7-7a0609c03e29 None admin] RBAC: Adding query filter params (name=member) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:09.304543 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882183b-48a3-4f7b-b9f7-7a0609c03e29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:09.305857 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882183b-48a3-4f7b-b9f7-7a0609c03e29 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:09.320756 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 162/323] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 21:52:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:09.320938 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-64227ffe-9935-4f96-9549-68a0a5839321 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:09.321471 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882183b-48a3-4f7b-b9f7-7a0609c03e29 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:09.321958 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-64227ffe-9935-4f96-9549-68a0a5839321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:09.355313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:09.409342 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 162/324] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:09.432699 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64227ffe-9935-4f96-9549-68a0a5839321 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:09.450098 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:09.450384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882183b-48a3-4f7b-b9f7-7a0609c03e29 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:09.489443 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339fcf6-f35f-4be9-adf7-376c93619ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:09.490267 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339fcf6-f35f-4be9-adf7-376c93619ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:09.490562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339fcf6-f35f-4be9-adf7-376c93619ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:09.490843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339fcf6-f35f-4be9-adf7-376c93619ae5 None admin] PATH_INFO: `/v3/users/8da79b5277694a5dbfc8a996b7b18eb1` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:09.492051 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339fcf6-f35f-4be9-adf7-376c93619ae5 None admin] RBAC: Authorizing `identity:get_user(user_id=8da79b5277694a5dbfc8a996b7b18eb1)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:09.493541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339fcf6-f35f-4be9-adf7-376c93619ae5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:09.495917 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 163/325] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:52:09 2022] GET /identity/v3/users/8da79b5277694a5dbfc8a996b7b18eb1 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:52:09.501416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339fcf6-f35f-4be9-adf7-376c93619ae5 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:09.553620 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64227ffe-9935-4f96-9549-68a0a5839321 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:09.597646 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90038a-1850-40ec-90bf-e2b255235cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:09.598451 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90038a-1850-40ec-90bf-e2b255235cfd None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:09.598731 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90038a-1850-40ec-90bf-e2b255235cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:09.599008 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90038a-1850-40ec-90bf-e2b255235cfd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:09.608064 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:09.610176 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90038a-1850-40ec-90bf-e2b255235cfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:09.615819 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339fcf6-f35f-4be9-adf7-376c93619ae5 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:09.618380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-1d90038a-1850-40ec-90bf-e2b255235cfd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:52:09.618380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:09.618380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:09.618380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:09.618380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:09.618380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:09.618380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:09.618380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:09.618380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:09.618380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:09.618380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:09.618380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:09.618380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:09.618380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:09.618380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:09.618380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:09.620383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:09.620383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:09.620383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:09.620383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:09.620383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:09.620383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:09.620383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:09.620383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:09.620383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:09.620383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:09.620383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:09.620383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:09.620383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:09.620383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:09.620383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:09.620383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:09.621320 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:09.621320 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:09.621320 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:09.621320 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:09.621320 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:09.621320 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:09.621320 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:09.621320 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:09.621320 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:09.621320 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:09.621320 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:52:09.621320 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:09.621320 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 163/326] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:52:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:52:09.621999 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abea9e-391d-4b83-a88c-db56b99d1a4c None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:09.622282 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abea9e-391d-4b83-a88c-db56b99d1a4c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:09.622555 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abea9e-391d-4b83-a88c-db56b99d1a4c None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:09.624003 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 164/327] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:09.632661 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abea9e-391d-4b83-a88c-db56b99d1a4c None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:09.654227 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae94fd5-f248-4738-a504-958caa7a19da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:09.654893 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae94fd5-f248-4738-a504-958caa7a19da None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:09.655177 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae94fd5-f248-4738-a504-958caa7a19da None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:09.655454 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae94fd5-f248-4738-a504-958caa7a19da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:09.656287 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae94fd5-f248-4738-a504-958caa7a19da None admin] RBAC: Adding query filter params (role.id=4749055b54a542b29f57155df3756136, user.id=8da79b5277694a5dbfc8a996b7b18eb1, scope.system=all) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:09.656624 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae94fd5-f248-4738-a504-958caa7a19da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:09.658077 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae94fd5-f248-4738-a504-958caa7a19da None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:09.671463 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 164/328] 10.222.0.35 () {56 vars in 1308 bytes} [Thu May 19 21:52:09 2022] GET /identity/v3/role_assignments?user.id=8da79b5277694a5dbfc8a996b7b18eb1&scope.system=all&role.id=4749055b54a542b29f57155df3756136 => generated 510 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:52:09.678409 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f84d21-d902-4d8f-bf55-7f90a5f1f604 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:09.678759 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f84d21-d902-4d8f-bf55-7f90a5f1f604 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:09.678982 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f84d21-d902-4d8f-bf55-7f90a5f1f604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:09.698346 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-26f84d21-d902-4d8f-bf55-7f90a5f1f604 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:09.699866 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-26f84d21-d902-4d8f-bf55-7f90a5f1f604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:09.717174 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:09.752189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abea9e-391d-4b83-a88c-db56b99d1a4c None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:09.780541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 165/329] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:09.795575 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0e234-1a1d-4a3e-b852-b8e20014f904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:09.796267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0e234-1a1d-4a3e-b852-b8e20014f904 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:09.796582 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0e234-1a1d-4a3e-b852-b8e20014f904 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:09.796863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0e234-1a1d-4a3e-b852-b8e20014f904 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:09.797631 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0e234-1a1d-4a3e-b852-b8e20014f904 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:09.797943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0e234-1a1d-4a3e-b852-b8e20014f904 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:09.799366 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0e234-1a1d-4a3e-b852-b8e20014f904 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:09.804464 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f84d21-d902-4d8f-bf55-7f90a5f1f604 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:09.814321 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 165/330] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 21:52:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:09.815495 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0e234-1a1d-4a3e-b852-b8e20014f904 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:09.913424 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:09.936334 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f84d21-d902-4d8f-bf55-7f90a5f1f604 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:09.943036 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0e234-1a1d-4a3e-b852-b8e20014f904 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:09.971264 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e05537-d598-4b47-936a-816565b37b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:09.972053 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e05537-d598-4b47-936a-816565b37b5f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:09.972330 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e05537-d598-4b47-936a-816565b37b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:09.972626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e05537-d598-4b47-936a-816565b37b5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:09.973779 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e05537-d598-4b47-936a-816565b37b5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:09.975203 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e05537-d598-4b47-936a-816565b37b5f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:09.976853 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 166/331] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:52:09.977325 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d41978-33d2-4184-b7cd-65eaa9b704f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:09.978200 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d41978-33d2-4184-b7cd-65eaa9b704f1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:09.978487 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d41978-33d2-4184-b7cd-65eaa9b704f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:09.979333 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d41978-33d2-4184-b7cd-65eaa9b704f1 None admin] PATH_INFO: `/v3/users/5e6549a19fae4fe6a947597df7056406` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:09.980911 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d41978-33d2-4184-b7cd-65eaa9b704f1 None admin] RBAC: Authorizing `identity:get_user(user_id=5e6549a19fae4fe6a947597df7056406)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:09.982402 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d41978-33d2-4184-b7cd-65eaa9b704f1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:09.983514 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e05537-d598-4b47-936a-816565b37b5f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:09.984140 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 166/332] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:52:09 2022] GET /identity/v3/users/5e6549a19fae4fe6a947597df7056406 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:52:09.990094 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d41978-33d2-4184-b7cd-65eaa9b704f1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:09.993891 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:10.087387 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e05537-d598-4b47-936a-816565b37b5f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:10.112699 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d41978-33d2-4184-b7cd-65eaa9b704f1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:10.123812 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc0c9f-3285-4b9b-a005-c8ef3b67cdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:10.124523 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc0c9f-3285-4b9b-a005-c8ef3b67cdf7 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:10.124810 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc0c9f-3285-4b9b-a005-c8ef3b67cdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:10.125085 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc0c9f-3285-4b9b-a005-c8ef3b67cdf7 None admin] PATH_INFO: `/v3/groups` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:10.125775 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc0c9f-3285-4b9b-a005-c8ef3b67cdf7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:10.127218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc0c9f-3285-4b9b-a005-c8ef3b67cdf7 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:10.143360 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 167/333] 10.222.0.35 () {60 vars in 1134 bytes} [Thu May 19 21:52:09 2022] POST /identity/v3/groups => generated 226 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:52:10.154697 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc6ba0-745f-482c-b7dd-22f404500b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:10.155597 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc6ba0-745f-482c-b7dd-22f404500b7e None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:10.155881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc6ba0-745f-482c-b7dd-22f404500b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:10.156156 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc6ba0-745f-482c-b7dd-22f404500b7e None admin] PATH_INFO: `/v3/system/users/5e6549a19fae4fe6a947597df7056406/roles/c6035635160b420194220cbe44e1abb9` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:10.157785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc6ba0-745f-482c-b7dd-22f404500b7e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5e6549a19fae4fe6a947597df7056406, role_id=c6035635160b420194220cbe44e1abb9)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:10.159209 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc6ba0-745f-482c-b7dd-22f404500b7e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:10.169429 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 167/334] 10.222.0.35 () {58 vars in 1334 bytes} [Thu May 19 21:52:09 2022] PUT /identity/v3/system/users/5e6549a19fae4fe6a947597df7056406/roles/c6035635160b420194220cbe44e1abb9 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:52:12.754569 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df26cdd-29d6-4642-b962-be631d5c8664 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:12.755135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df26cdd-29d6-4642-b962-be631d5c8664 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:12.755135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df26cdd-29d6-4642-b962-be631d5c8664 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:12.757018 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 168/335] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:12.769415 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612efdc3-fc11-4fc1-9d5e-215c0e5b95b9 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:12.769900 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612efdc3-fc11-4fc1-9d5e-215c0e5b95b9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:12.770000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612efdc3-fc11-4fc1-9d5e-215c0e5b95b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:12.797502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-612efdc3-fc11-4fc1-9d5e-215c0e5b95b9 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:12.798721 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-612efdc3-fc11-4fc1-9d5e-215c0e5b95b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:12.891953 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:12.898830 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 168/336] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:12.939796 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df26cdd-29d6-4642-b962-be631d5c8664 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:12.959067 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:13.077701 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df26cdd-29d6-4642-b962-be631d5c8664 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:13.122329 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0745f8-8dd8-498a-baff-6819d6a3f30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:13.123159 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0745f8-8dd8-498a-baff-6819d6a3f30d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:13.123518 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0745f8-8dd8-498a-baff-6819d6a3f30d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:13.123803 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0745f8-8dd8-498a-baff-6819d6a3f30d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:13.137871 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0745f8-8dd8-498a-baff-6819d6a3f30d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:13.146002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-fd0745f8-8dd8-498a-baff-6819d6a3f30d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:52:13.146002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:13.146002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:13.146002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:13.146002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:13.146002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:13.146002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:13.146002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:13.146002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:13.146002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:13.146002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:13.146002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:13.146002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:13.146002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:13.146002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:13.146002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:13.146894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:13.146894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:13.146894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:13.146894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:13.146894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:13.146894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:13.146894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:13.146894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:13.146894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:13.146894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:13.146894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:13.146894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:13.146894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:13.146894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:13.146894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:13.146894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:13.147666 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:13.147666 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:13.147666 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:13.147666 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:13.147666 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:13.147666 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:13.147666 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:13.147666 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:13.147666 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:13.147666 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:13.147666 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 21:52:13.147666 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:13.149798 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 169/337] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:52:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:13.155628 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612efdc3-fc11-4fc1-9d5e-215c0e5b95b9 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:13.287224 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612efdc3-fc11-4fc1-9d5e-215c0e5b95b9 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:13.362230 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab91ca-49ef-456c-9193-8a94e22df36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:13.362841 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab91ca-49ef-456c-9193-8a94e22df36d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:13.363132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab91ca-49ef-456c-9193-8a94e22df36d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:13.363407 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab91ca-49ef-456c-9193-8a94e22df36d None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:13.364456 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab91ca-49ef-456c-9193-8a94e22df36d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:13.364870 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab91ca-49ef-456c-9193-8a94e22df36d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:13.366553 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab91ca-49ef-456c-9193-8a94e22df36d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:13.382124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 169/338] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 21:52:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:13.388171 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0745f8-8dd8-498a-baff-6819d6a3f30d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:13.484682 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:13.522761 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0745f8-8dd8-498a-baff-6819d6a3f30d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:13.566154 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5b61f-cc6f-4048-8c89-43552f9c83cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:13.567039 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5b61f-cc6f-4048-8c89-43552f9c83cf None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:13.567320 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5b61f-cc6f-4048-8c89-43552f9c83cf None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:13.567594 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5b61f-cc6f-4048-8c89-43552f9c83cf None admin] PATH_INFO: `/v3/users/5e6549a19fae4fe6a947597df7056406` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:13.571070 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5b61f-cc6f-4048-8c89-43552f9c83cf None admin] RBAC: Authorizing `identity:get_user(user_id=5e6549a19fae4fe6a947597df7056406)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:13.573281 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5b61f-cc6f-4048-8c89-43552f9c83cf None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:13.575422 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 170/339] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:52:13 2022] GET /identity/v3/users/5e6549a19fae4fe6a947597df7056406 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:13.580926 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab91ca-49ef-456c-9193-8a94e22df36d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:13.658901 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37857e-e8e3-49d5-af4f-94738b2d4f5d None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:13.659082 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37857e-e8e3-49d5-af4f-94738b2d4f5d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:13.659444 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37857e-e8e3-49d5-af4f-94738b2d4f5d None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:13.661865 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 171/340] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:13.668076 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e47016-76a0-40cf-bded-d203b53fae7e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:13.668635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e47016-76a0-40cf-bded-d203b53fae7e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:13.669062 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e47016-76a0-40cf-bded-d203b53fae7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:13.671374 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:13.699017 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c9e47016-76a0-40cf-bded-d203b53fae7e None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:13.700675 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c9e47016-76a0-40cf-bded-d203b53fae7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:13.754373 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab91ca-49ef-456c-9193-8a94e22df36d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:13.787431 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 172/341] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:52:13.789527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf1352-c9db-44b0-ac66-63ecb6f6074f None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:13.789962 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf1352-c9db-44b0-ac66-63ecb6f6074f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:13.790383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf1352-c9db-44b0-ac66-63ecb6f6074f None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:13.792546 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 173/342] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:13.793928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d2be4-3639-4bdd-af73-ca72b274272b None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:13.794358 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d2be4-3639-4bdd-af73-ca72b274272b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:13.803289 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d2be4-3639-4bdd-af73-ca72b274272b None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:13.804263 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222c5ef-49f3-46a4-adc9-15153d7c28a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:13.804975 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222c5ef-49f3-46a4-adc9-15153d7c28a1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:13.805256 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222c5ef-49f3-46a4-adc9-15153d7c28a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:13.805528 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222c5ef-49f3-46a4-adc9-15153d7c28a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:13.806174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 174/343] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:13 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:13.807290 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222c5ef-49f3-46a4-adc9-15153d7c28a1 None admin] RBAC: Adding query filter params (role.id=c6035635160b420194220cbe44e1abb9, user.id=5e6549a19fae4fe6a947597df7056406, scope.system=all) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:13.807650 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222c5ef-49f3-46a4-adc9-15153d7c28a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:13.808713 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0364af-0895-4ee2-93f1-75e432616f9d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:13.809142 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0364af-0895-4ee2-93f1-75e432616f9d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:13.809559 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0364af-0895-4ee2-93f1-75e432616f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:13.810492 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222c5ef-49f3-46a4-adc9-15153d7c28a1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:13.825453 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 170/344] 10.222.0.35 () {56 vars in 1308 bytes} [Thu May 19 21:52:13 2022] GET /identity/v3/role_assignments?user.id=5e6549a19fae4fe6a947597df7056406&scope.system=all&role.id=c6035635160b420194220cbe44e1abb9 => generated 510 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:13.826859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae64cbb-37a7-4fc3-834e-92f8465cac9a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:13.827175 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae64cbb-37a7-4fc3-834e-92f8465cac9a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:13.827418 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae64cbb-37a7-4fc3-834e-92f8465cac9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:13.835282 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7d0364af-0895-4ee2-93f1-75e432616f9d None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:13.836854 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7d0364af-0895-4ee2-93f1-75e432616f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:13.846047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-9ae64cbb-37a7-4fc3-834e-92f8465cac9a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:13.847681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9ae64cbb-37a7-4fc3-834e-92f8465cac9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:13.927243 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:13.934877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 175/345] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:13.938084 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 171/346] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:13.939178 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0364af-0895-4ee2-93f1-75e432616f9d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:13.963920 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae64cbb-37a7-4fc3-834e-92f8465cac9a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:14.022729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:14.091008 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae64cbb-37a7-4fc3-834e-92f8465cac9a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:14.106990 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0364af-0895-4ee2-93f1-75e432616f9d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:14.130729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a365a-7603-4c95-a2fc-f2f31bab1cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:14.131861 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a365a-7603-4c95-a2fc-f2f31bab1cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:14.132280 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a365a-7603-4c95-a2fc-f2f31bab1cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:14.132728 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a365a-7603-4c95-a2fc-f2f31bab1cc7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:14.144329 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a365a-7603-4c95-a2fc-f2f31bab1cc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:14.148078 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fc42f-ffe8-4973-a9ed-53d425051d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:14.148913 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fc42f-ffe8-4973-a9ed-53d425051d9b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:14.149202 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fc42f-ffe8-4973-a9ed-53d425051d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:14.149479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fc42f-ffe8-4973-a9ed-53d425051d9b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:14.154090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-c57a365a-7603-4c95-a2fc-f2f31bab1cc7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:52:14.154090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:14.154090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:14.154090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:14.154090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:14.154090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:14.154090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:14.154090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:14.154090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:14.154090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:14.154090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:14.154090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:14.154090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:14.154090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:14.154090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:14.154090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:14.155114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:14.155114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:14.155114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:14.155114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:14.155114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:14.155114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:14.155114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:14.155114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:14.155114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:14.155114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:14.155114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:14.155114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:14.155114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:14.155114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:14.155114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:14.155114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:14.156066 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:14.156066 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:14.156066 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:14.156066 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:14.156066 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:14.156066 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:14.156066 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:14.156066 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:14.156066 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:14.156066 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:14.156066 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:52:14.156066 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:14.158276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 172/347] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:52:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:14.159760 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a365a-7603-4c95-a2fc-f2f31bab1cc7 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:14.174054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fc42f-ffe8-4973-a9ed-53d425051d9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:14.184932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-740fc42f-ffe8-4973-a9ed-53d425051d9b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:52:14.184932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:14.184932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:14.184932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:14.184932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:14.184932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:14.184932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:14.184932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:14.184932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:14.184932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:14.184932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:14.184932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:14.184932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:14.184932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:14.184932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:14.184932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:14.185863 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:14.185863 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:14.185863 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:14.185863 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:14.185863 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:14.185863 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:14.185863 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:14.185863 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:14.185863 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:14.185863 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:14.185863 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:14.185863 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:14.185863 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:14.185863 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:14.185863 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:14.185863 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:14.186632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:14.186632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:14.186632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:14.186632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:14.186632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:14.186632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:14.186632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:14.186632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:14.186632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:14.186632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:14.186632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:52:14.186632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:14.189358 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 176/348] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:52:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:14.190853 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fc42f-ffe8-4973-a9ed-53d425051d9b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:14.278322 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:14.294843 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a365a-7603-4c95-a2fc-f2f31bab1cc7 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:14.304955 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:14.348000 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fc42f-ffe8-4973-a9ed-53d425051d9b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:14.360597 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf04735-5cd5-4dd8-b0e8-e21db8813f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:14.361994 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf04735-5cd5-4dd8-b0e8-e21db8813f2e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:14.362456 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf04735-5cd5-4dd8-b0e8-e21db8813f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:14.363149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf04735-5cd5-4dd8-b0e8-e21db8813f2e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:14.385819 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf04735-5cd5-4dd8-b0e8-e21db8813f2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:14.398467 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-8bf04735-5cd5-4dd8-b0e8-e21db8813f2e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:52:14.398467 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:14.398467 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:14.398467 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:14.398467 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:14.398467 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:14.398467 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:14.398467 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:14.398467 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:14.398467 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:14.398467 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:14.398467 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:14.398467 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:14.398467 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:14.398467 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:14.398467 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:14.399381 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:14.399381 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:14.399381 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:14.399381 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:14.399381 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:14.399381 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:14.399381 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:14.399381 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:14.399381 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:14.399381 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:14.399381 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:14.399381 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:14.399381 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:14.399381 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:14.399381 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:14.399381 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:14.400137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:14.400137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:14.400137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:14.400137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:14.400137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:14.400137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:14.400137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:14.400137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:14.400137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:14.400137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:14.400137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:52:14.400137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:14.400137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 173/349] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 21:52:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:14.400137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf04735-5cd5-4dd8-b0e8-e21db8813f2e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:14.403801 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba42d0-ea4e-4018-b1c9-3d9db2eb1756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:14.404524 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba42d0-ea4e-4018-b1c9-3d9db2eb1756 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:14.404808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba42d0-ea4e-4018-b1c9-3d9db2eb1756 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:14.405108 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba42d0-ea4e-4018-b1c9-3d9db2eb1756 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:14.405861 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba42d0-ea4e-4018-b1c9-3d9db2eb1756 None admin] RBAC: Adding query filter params (name=member) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:14.406165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba42d0-ea4e-4018-b1c9-3d9db2eb1756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:14.407591 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba42d0-ea4e-4018-b1c9-3d9db2eb1756 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:14.431088 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 177/350] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 21:52:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:14.432597 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba42d0-ea4e-4018-b1c9-3d9db2eb1756 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:14.549411 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba42d0-ea4e-4018-b1c9-3d9db2eb1756 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:14.553489 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf04735-5cd5-4dd8-b0e8-e21db8813f2e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:14.586329 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714b43d-c7e5-44d6-a2d6-6edad6170158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:14.587391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714b43d-c7e5-44d6-a2d6-6edad6170158 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:14.587890 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714b43d-c7e5-44d6-a2d6-6edad6170158 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:14.588997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714b43d-c7e5-44d6-a2d6-6edad6170158 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:14.590288 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:14.590833 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714b43d-c7e5-44d6-a2d6-6edad6170158 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:14.591355 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714b43d-c7e5-44d6-a2d6-6edad6170158 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:14.593771 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714b43d-c7e5-44d6-a2d6-6edad6170158 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:14.599186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469bbc1-68d6-4b89-a64b-cb9052d0f02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:14.599874 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469bbc1-68d6-4b89-a64b-cb9052d0f02e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:14.600186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469bbc1-68d6-4b89-a64b-cb9052d0f02e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:14.600503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469bbc1-68d6-4b89-a64b-cb9052d0f02e None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:14.601270 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469bbc1-68d6-4b89-a64b-cb9052d0f02e None admin] RBAC: Adding query filter params (name=member) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:14.602088 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469bbc1-68d6-4b89-a64b-cb9052d0f02e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:14.602994 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469bbc1-68d6-4b89-a64b-cb9052d0f02e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:14.606834 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 178/351] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:52:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:14.607954 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714b43d-c7e5-44d6-a2d6-6edad6170158 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:14.613260 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 174/352] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 21:52:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:14.614514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469bbc1-68d6-4b89-a64b-cb9052d0f02e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:14.652305 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:14.736912 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469bbc1-68d6-4b89-a64b-cb9052d0f02e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:14.752223 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714b43d-c7e5-44d6-a2d6-6edad6170158 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:14.787375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f6cf9-58f4-4920-a18f-573ca2c9c3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:14.788260 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f6cf9-58f4-4920-a18f-573ca2c9c3ff None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:14.788666 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f6cf9-58f4-4920-a18f-573ca2c9c3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:14.789248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f6cf9-58f4-4920-a18f-573ca2c9c3ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:14.797301 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67e6d7-d389-4f2c-92b2-16e3cd97d753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:14.798548 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67e6d7-d389-4f2c-92b2-16e3cd97d753 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:14.798980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67e6d7-d389-4f2c-92b2-16e3cd97d753 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:14.799407 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67e6d7-d389-4f2c-92b2-16e3cd97d753 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:14.865465 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:14.886688 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff67e6d7-d389-4f2c-92b2-16e3cd97d753 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:14.888199 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff67e6d7-d389-4f2c-92b2-16e3cd97d753 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:14.890202 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f6cf9-58f4-4920-a18f-573ca2c9c3ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:14.890736 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f6cf9-58f4-4920-a18f-573ca2c9c3ff None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:14.932584 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:15.031254 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 175/353] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:52:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:52:15.032458 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f6cf9-58f4-4920-a18f-573ca2c9c3ff None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:15.038702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 179/354] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:52:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:52:15.040233 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b11355-2c3b-440b-8f4a-42d6d7615a32 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:15.040562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b11355-2c3b-440b-8f4a-42d6d7615a32 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:15.040845 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b11355-2c3b-440b-8f4a-42d6d7615a32 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:15.042769 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 180/355] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:15.044856 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b11355-2c3b-440b-8f4a-42d6d7615a32 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:15.167432 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:15.172374 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f6cf9-58f4-4920-a18f-573ca2c9c3ff None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:15.195275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b11355-2c3b-440b-8f4a-42d6d7615a32 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:15.207840 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:15.215482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236342e-ae2d-4085-801d-1afe005f7ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:15.216154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236342e-ae2d-4085-801d-1afe005f7ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:15.216492 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236342e-ae2d-4085-801d-1afe005f7ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:15.216781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236342e-ae2d-4085-801d-1afe005f7ed6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:15.238552 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d74bf1-24be-484e-9930-0dd3feba81e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:15.239679 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d74bf1-24be-484e-9930-0dd3feba81e8 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:15.239951 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d74bf1-24be-484e-9930-0dd3feba81e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:15.240214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d74bf1-24be-484e-9930-0dd3feba81e8 None admin] PATH_INFO: `/v3/projects/eeea527f528b47d882789251a2058689` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:15.241930 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d74bf1-24be-484e-9930-0dd3feba81e8 None admin] RBAC: Authorizing `identity:get_project(project_id=eeea527f528b47d882789251a2058689)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:15.242863 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d74bf1-24be-484e-9930-0dd3feba81e8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:15.245977 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 181/356] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:52:15 2022] GET /identity/v3/projects/eeea527f528b47d882789251a2058689 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:15.245977 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d74bf1-24be-484e-9930-0dd3feba81e8 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:15.309131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236342e-ae2d-4085-801d-1afe005f7ed6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:15.310650 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236342e-ae2d-4085-801d-1afe005f7ed6 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:15.376224 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d74bf1-24be-484e-9930-0dd3feba81e8 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:15.423403 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf94b9-81e0-43f0-bcba-9c930a6fbeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:15.424219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf94b9-81e0-43f0-bcba-9c930a6fbeba None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:15.424553 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf94b9-81e0-43f0-bcba-9c930a6fbeba None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:15.424832 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf94b9-81e0-43f0-bcba-9c930a6fbeba None admin] PATH_INFO: `/v3/projects/eeea527f528b47d882789251a2058689` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:15.426082 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf94b9-81e0-43f0-bcba-9c930a6fbeba None admin] RBAC: Authorizing `identity:get_project(project_id=eeea527f528b47d882789251a2058689)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:15.427527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf94b9-81e0-43f0-bcba-9c930a6fbeba None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:15.429295 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 182/357] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:52:15 2022] GET /identity/v3/projects/eeea527f528b47d882789251a2058689 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:15.430478 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48e818-938a-474c-8420-24509bc892a1 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:15.430763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48e818-938a-474c-8420-24509bc892a1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:15.431034 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48e818-938a-474c-8420-24509bc892a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:15.448123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 176/358] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:52:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:52:15.450347 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e8546-b2cd-4455-9a63-8a5af538ae2d None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:15.450643 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e8546-b2cd-4455-9a63-8a5af538ae2d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:15.450920 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e8546-b2cd-4455-9a63-8a5af538ae2d None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:15.456507 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 177/359] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:15.456507 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e8546-b2cd-4455-9a63-8a5af538ae2d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:15.457633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-5f48e818-938a-474c-8420-24509bc892a1 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:15.458810 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5f48e818-938a-474c-8420-24509bc892a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:15.476713 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:15.493959 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:15.549147 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 183/360] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:15.550037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48e818-938a-474c-8420-24509bc892a1 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:15.587362 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e8546-b2cd-4455-9a63-8a5af538ae2d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:15.637549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808833c1-6e75-497c-8118-20408a7ba9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:15.638437 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808833c1-6e75-497c-8118-20408a7ba9ef None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:15.638717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808833c1-6e75-497c-8118-20408a7ba9ef None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:15.638987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808833c1-6e75-497c-8118-20408a7ba9ef None admin] PATH_INFO: `/v3/groups/d07a2f2021e44aa4b1fd33eab6a60898` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:15.646188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808833c1-6e75-497c-8118-20408a7ba9ef None admin] RBAC: Authorizing `identity:get_group(group_id=d07a2f2021e44aa4b1fd33eab6a60898)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:15.647680 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808833c1-6e75-497c-8118-20408a7ba9ef None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:15.650922 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 178/361] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 21:52:15 2022] GET /identity/v3/groups/d07a2f2021e44aa4b1fd33eab6a60898 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:15.650922 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808833c1-6e75-497c-8118-20408a7ba9ef None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:15.689792 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48e818-938a-474c-8420-24509bc892a1 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:15.729786 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb895a-37ef-4739-87c1-355a2205b9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:15.730722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb895a-37ef-4739-87c1-355a2205b9ae None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:15.731001 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb895a-37ef-4739-87c1-355a2205b9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:15.731271 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb895a-37ef-4739-87c1-355a2205b9ae None admin] PATH_INFO: `/v3/groups/d07a2f2021e44aa4b1fd33eab6a60898` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:15.732555 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb895a-37ef-4739-87c1-355a2205b9ae None admin] RBAC: Authorizing `identity:get_group(group_id=d07a2f2021e44aa4b1fd33eab6a60898)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:15.734044 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb895a-37ef-4739-87c1-355a2205b9ae None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:15.740829 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 184/362] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 21:52:15 2022] GET /identity/v3/groups/d07a2f2021e44aa4b1fd33eab6a60898 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:15.740829 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab05ef7-9944-4cea-9c75-bde4232ac758 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:15.740829 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab05ef7-9944-4cea-9c75-bde4232ac758 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:15.740829 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab05ef7-9944-4cea-9c75-bde4232ac758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:15.757696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7ab05ef7-9944-4cea-9c75-bde4232ac758 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:15.758915 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7ab05ef7-9944-4cea-9c75-bde4232ac758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:15.770183 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:15.777452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:15.788616 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808833c1-6e75-497c-8118-20408a7ba9ef None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:15.832024 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5380b-b484-444a-8736-f714ec0de83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:15.832985 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5380b-b484-444a-8736-f714ec0de83f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:15.833619 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5380b-b484-444a-8736-f714ec0de83f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:15.833724 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5380b-b484-444a-8736-f714ec0de83f None admin] PATH_INFO: `/v3/projects/87ea432faccb40e590632800fcca178a` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:15.834927 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5380b-b484-444a-8736-f714ec0de83f None admin] RBAC: Authorizing `identity:get_project(project_id=87ea432faccb40e590632800fcca178a)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:15.836497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5380b-b484-444a-8736-f714ec0de83f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:15.839228 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 179/363] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:52:15 2022] GET /identity/v3/projects/87ea432faccb40e590632800fcca178a => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:15.839786 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5380b-b484-444a-8736-f714ec0de83f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:15.844473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 185/364] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:15.844936 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab05ef7-9944-4cea-9c75-bde4232ac758 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:15.960171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5380b-b484-444a-8736-f714ec0de83f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:15.971940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab05ef7-9944-4cea-9c75-bde4232ac758 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:16.000067 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b1151-7bb4-4118-a35d-3653f91af19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:16.000927 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b1151-7bb4-4118-a35d-3653f91af19c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:16.001214 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b1151-7bb4-4118-a35d-3653f91af19c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:16.001494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b1151-7bb4-4118-a35d-3653f91af19c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:16.014980 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b1151-7bb4-4118-a35d-3653f91af19c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:16.021357 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e63fc1-0c4c-452d-8c88-c43ea576a4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:16.021357 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e63fc1-0c4c-452d-8c88-c43ea576a4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:16.021600 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e63fc1-0c4c-452d-8c88-c43ea576a4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:16.021851 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e63fc1-0c4c-452d-8c88-c43ea576a4f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:16.022694 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e63fc1-0c4c-452d-8c88-c43ea576a4f6 None admin] RBAC: Adding query filter params (group.id=d07a2f2021e44aa4b1fd33eab6a60898, role.id=3fb2a96d6ee74a7dbd046488f5ec322b, scope.project.id=eeea527f528b47d882789251a2058689) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:16.023003 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e63fc1-0c4c-452d-8c88-c43ea576a4f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:16.023563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-1b3b1151-7bb4-4118-a35d-3653f91af19c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:52:16.023563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:16.023563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:16.023563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:16.023563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:16.023563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:16.023563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:16.023563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:16.023563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:16.023563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:16.023563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:16.023563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:16.023563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:16.023563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:16.023563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:16.023563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:16.024395 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:16.024395 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:16.024395 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:16.024395 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:16.024395 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:16.024395 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:16.024395 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:16.024395 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:16.024395 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:16.024395 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:16.024395 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:16.024395 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:16.024395 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:16.024395 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:16.024395 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:16.024395 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:16.026134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:16.026134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:16.026134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:16.026134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:16.026134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:16.026134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:16.026134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:16.026134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:16.026134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:16.026134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:16.026134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:52:16.026134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:16.027083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e63fc1-0c4c-452d-8c88-c43ea576a4f6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:16.027179 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 180/365] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 21:52:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:16.027179 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b1151-7bb4-4118-a35d-3653f91af19c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:16.031675 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 186/366] 10.222.0.35 () {56 vars in 1376 bytes} [Thu May 19 21:52:15 2022] GET /identity/v3/role_assignments?group.id=d07a2f2021e44aa4b1fd33eab6a60898&scope.project.id=eeea527f528b47d882789251a2058689&role.id=3fb2a96d6ee74a7dbd046488f5ec322b => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:16.032892 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e63fc1-0c4c-452d-8c88-c43ea576a4f6 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:16.059245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:16.067622 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:16.184101 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b1151-7bb4-4118-a35d-3653f91af19c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:16.195496 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e63fc1-0c4c-452d-8c88-c43ea576a4f6 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:16.239494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fcf15-2f22-4165-b047-5a29b97e8aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:16.240090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fcf15-2f22-4165-b047-5a29b97e8aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:16.240382 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fcf15-2f22-4165-b047-5a29b97e8aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:16.240692 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fcf15-2f22-4165-b047-5a29b97e8aa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:16.241536 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fcf15-2f22-4165-b047-5a29b97e8aa3 None admin] RBAC: Adding query filter params (group.id=d07a2f2021e44aa4b1fd33eab6a60898, role.id=4749055b54a542b29f57155df3756136, scope.project.id=eeea527f528b47d882789251a2058689) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:16.241852 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fcf15-2f22-4165-b047-5a29b97e8aa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:16.243312 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fcf15-2f22-4165-b047-5a29b97e8aa3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:16.246229 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2291a1d-2eda-46a9-9801-eca93926dad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:16.247126 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2291a1d-2eda-46a9-9801-eca93926dad7 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:16.247412 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2291a1d-2eda-46a9-9801-eca93926dad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:16.247689 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2291a1d-2eda-46a9-9801-eca93926dad7 None admin] PATH_INFO: `/v3/groups/d07a2f2021e44aa4b1fd33eab6a60898` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:16.249861 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2291a1d-2eda-46a9-9801-eca93926dad7 None admin] RBAC: Authorizing `identity:get_group(group_id=d07a2f2021e44aa4b1fd33eab6a60898)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:16.250444 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 181/367] 10.222.0.35 () {56 vars in 1376 bytes} [Thu May 19 21:52:16 2022] GET /identity/v3/role_assignments?group.id=d07a2f2021e44aa4b1fd33eab6a60898&scope.project.id=eeea527f528b47d882789251a2058689&role.id=4749055b54a542b29f57155df3756136 => generated 260 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:16.251309 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fcf15-2f22-4165-b047-5a29b97e8aa3 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:16.251436 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2291a1d-2eda-46a9-9801-eca93926dad7 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:16.253574 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 187/368] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 21:52:16 2022] GET /identity/v3/groups/d07a2f2021e44aa4b1fd33eab6a60898 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:16.254371 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2291a1d-2eda-46a9-9801-eca93926dad7 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:16.388359 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:16.406086 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:16.423581 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2291a1d-2eda-46a9-9801-eca93926dad7 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:16.428125 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fcf15-2f22-4165-b047-5a29b97e8aa3 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:16.471424 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deaf42b-55f0-4143-9437-cc70815a455b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:16.472709 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deaf42b-55f0-4143-9437-cc70815a455b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:16.473197 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deaf42b-55f0-4143-9437-cc70815a455b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:16.473689 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deaf42b-55f0-4143-9437-cc70815a455b None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:16.474654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deaf42b-55f0-4143-9437-cc70815a455b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:16.475174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deaf42b-55f0-4143-9437-cc70815a455b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:16.476947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deaf42b-55f0-4143-9437-cc70815a455b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:16.481771 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713400a6-8567-4c3d-b802-26b7e1d17c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:16.482653 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713400a6-8567-4c3d-b802-26b7e1d17c60 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:16.482943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713400a6-8567-4c3d-b802-26b7e1d17c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:16.483221 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713400a6-8567-4c3d-b802-26b7e1d17c60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:16.497409 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 188/369] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:52:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:16.497409 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deaf42b-55f0-4143-9437-cc70815a455b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:16.497675 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713400a6-8567-4c3d-b802-26b7e1d17c60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:16.508304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-713400a6-8567-4c3d-b802-26b7e1d17c60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:52:16.508304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:16.508304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:16.508304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:16.508304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:16.508304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:16.508304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:16.508304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:16.508304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:16.508304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:16.508304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:16.508304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:16.508304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:16.508304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:16.508304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:16.508304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:16.509432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:16.509432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:16.509432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:16.509432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:16.509432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:16.509432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:16.509432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:16.509432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:16.509432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:16.509432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:16.509432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:16.509432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:16.509432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:16.509432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:16.509432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:16.509432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:16.510357 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:16.510357 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:16.510357 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:16.510357 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:16.510357 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:16.510357 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:16.510357 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:16.510357 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:16.510357 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:16.510357 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:16.510357 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:52:16.510357 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:16.516244 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 182/370] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:52:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:16.516244 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713400a6-8567-4c3d-b802-26b7e1d17c60 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:16.641417 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deaf42b-55f0-4143-9437-cc70815a455b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:16.654509 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713400a6-8567-4c3d-b802-26b7e1d17c60 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:16.690119 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2a338-8c95-4ad5-a482-ac4adc4fa06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:16.690913 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2a338-8c95-4ad5-a482-ac4adc4fa06c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:16.692064 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2a338-8c95-4ad5-a482-ac4adc4fa06c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:16.692194 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2a338-8c95-4ad5-a482-ac4adc4fa06c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:16.693502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2a338-8c95-4ad5-a482-ac4adc4fa06c None admin] RBAC: Adding query filter params (group.id=d07a2f2021e44aa4b1fd33eab6a60898, role.id=4749055b54a542b29f57155df3756136, scope.project.id=87ea432faccb40e590632800fcca178a) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:16.693896 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2a338-8c95-4ad5-a482-ac4adc4fa06c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:16.695899 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2a338-8c95-4ad5-a482-ac4adc4fa06c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:16.703136 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df930d-0a18-42b7-8965-1edda48fc00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:16.704118 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df930d-0a18-42b7-8965-1edda48fc00e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:16.704637 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df930d-0a18-42b7-8965-1edda48fc00e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:16.705112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df930d-0a18-42b7-8965-1edda48fc00e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:16.709216 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 189/371] 10.222.0.35 () {56 vars in 1376 bytes} [Thu May 19 21:52:16 2022] GET /identity/v3/role_assignments?group.id=d07a2f2021e44aa4b1fd33eab6a60898&scope.project.id=87ea432faccb40e590632800fcca178a&role.id=4749055b54a542b29f57155df3756136 => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:16.711397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2a338-8c95-4ad5-a482-ac4adc4fa06c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:16.728102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:16.772889 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:16.859084 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2a338-8c95-4ad5-a482-ac4adc4fa06c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:16.904354 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df930d-0a18-42b7-8965-1edda48fc00e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:16.905907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df930d-0a18-42b7-8965-1edda48fc00e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:16.924892 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec61f08-e9a5-41f3-9938-40fadd385260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:16.925947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec61f08-e9a5-41f3-9938-40fadd385260 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:16.926531 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec61f08-e9a5-41f3-9938-40fadd385260 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:16.927134 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec61f08-e9a5-41f3-9938-40fadd385260 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:16.928226 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec61f08-e9a5-41f3-9938-40fadd385260 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:16.928845 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec61f08-e9a5-41f3-9938-40fadd385260 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:16.930719 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec61f08-e9a5-41f3-9938-40fadd385260 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:16.954287 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 190/372] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:52:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:16.958250 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec61f08-e9a5-41f3-9938-40fadd385260 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:17.046299 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:17.105818 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec61f08-e9a5-41f3-9938-40fadd385260 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:17.124530 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 183/373] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:52:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:52:17.141276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df930d-0a18-42b7-8965-1edda48fc00e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:17.194281 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321682a-bf62-4910-adf2-7a5ad8796f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:17.194795 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:17.194958 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321682a-bf62-4910-adf2-7a5ad8796f23 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:17.195248 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321682a-bf62-4910-adf2-7a5ad8796f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:17.195528 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321682a-bf62-4910-adf2-7a5ad8796f23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:17.288003 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df930d-0a18-42b7-8965-1edda48fc00e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:17.349971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8321682a-bf62-4910-adf2-7a5ad8796f23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:17.351399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8321682a-bf62-4910-adf2-7a5ad8796f23 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:17.355951 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f52db4-8c04-4ac3-af9f-4e41fa391386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:17.356857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f52db4-8c04-4ac3-af9f-4e41fa391386 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:17.357137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f52db4-8c04-4ac3-af9f-4e41fa391386 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:17.357407 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f52db4-8c04-4ac3-af9f-4e41fa391386 None admin] PATH_INFO: `/v3/projects/87ea432faccb40e590632800fcca178a` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:17.358654 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f52db4-8c04-4ac3-af9f-4e41fa391386 None admin] RBAC: Authorizing `identity:get_project(project_id=87ea432faccb40e590632800fcca178a)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:17.360094 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f52db4-8c04-4ac3-af9f-4e41fa391386 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:17.363200 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 184/374] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:52:17 2022] GET /identity/v3/projects/87ea432faccb40e590632800fcca178a => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:17.372479 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f52db4-8c04-4ac3-af9f-4e41fa391386 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:17.500037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:17.566228 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f52db4-8c04-4ac3-af9f-4e41fa391386 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:17.578703 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 191/375] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:52:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:52:17.584220 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321682a-bf62-4910-adf2-7a5ad8796f23 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:17.596777 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:17.622291 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846a665-d74d-4d24-94ee-51f00538953e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:17.623076 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846a665-d74d-4d24-94ee-51f00538953e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:17.623356 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846a665-d74d-4d24-94ee-51f00538953e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:17.623638 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846a665-d74d-4d24-94ee-51f00538953e None admin] PATH_INFO: `/v3/groups/d07a2f2021e44aa4b1fd33eab6a60898` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:17.625136 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846a665-d74d-4d24-94ee-51f00538953e None admin] RBAC: Authorizing `identity:get_group(group_id=d07a2f2021e44aa4b1fd33eab6a60898)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:17.626343 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846a665-d74d-4d24-94ee-51f00538953e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:17.632462 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 185/376] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 21:52:17 2022] GET /identity/v3/groups/d07a2f2021e44aa4b1fd33eab6a60898 => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:17.641863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846a665-d74d-4d24-94ee-51f00538953e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:17.719999 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321682a-bf62-4910-adf2-7a5ad8796f23 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:17.758132 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a32fb3-e05f-4a59-9635-afb1126f6ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:17.759397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a32fb3-e05f-4a59-9635-afb1126f6ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:17.760626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a32fb3-e05f-4a59-9635-afb1126f6ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:17.761201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a32fb3-e05f-4a59-9635-afb1126f6ff4 None admin] PATH_INFO: `/v3/projects/64ecee0211ba477d8f867eb1b5f77c2e` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:17.762831 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a32fb3-e05f-4a59-9635-afb1126f6ff4 None admin] RBAC: Authorizing `identity:get_project(project_id=64ecee0211ba477d8f867eb1b5f77c2e)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:17.764549 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a32fb3-e05f-4a59-9635-afb1126f6ff4 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:17.770437 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 192/377] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:52:17 2022] GET /identity/v3/projects/64ecee0211ba477d8f867eb1b5f77c2e => generated 344 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:52:17.771353 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846a665-d74d-4d24-94ee-51f00538953e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:17.772827 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a32fb3-e05f-4a59-9635-afb1126f6ff4 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:17.809686 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:17.824502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccada4f-6c92-4cf6-8f92-f7354b23fe6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:17.825307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccada4f-6c92-4cf6-8f92-f7354b23fe6f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:17.825503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccada4f-6c92-4cf6-8f92-f7354b23fe6f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:17.825744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccada4f-6c92-4cf6-8f92-f7354b23fe6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:17.826628 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccada4f-6c92-4cf6-8f92-f7354b23fe6f None admin] RBAC: Adding query filter params (group.id=d07a2f2021e44aa4b1fd33eab6a60898, role.id=3fb2a96d6ee74a7dbd046488f5ec322b, scope.project.id=87ea432faccb40e590632800fcca178a) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:17.826901 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccada4f-6c92-4cf6-8f92-f7354b23fe6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:17.828355 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccada4f-6c92-4cf6-8f92-f7354b23fe6f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:17.840433 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 186/378] 10.222.0.35 () {56 vars in 1376 bytes} [Thu May 19 21:52:17 2022] GET /identity/v3/role_assignments?group.id=d07a2f2021e44aa4b1fd33eab6a60898&scope.project.id=87ea432faccb40e590632800fcca178a&role.id=3fb2a96d6ee74a7dbd046488f5ec322b => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:17.914037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a32fb3-e05f-4a59-9635-afb1126f6ff4 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:17.956325 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8dda8a-5a30-4d24-a686-7890629459ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:17.957584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dda8a-5a30-4d24-a686-7890629459ba None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:17.958065 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dda8a-5a30-4d24-a686-7890629459ba None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:17.958531 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dda8a-5a30-4d24-a686-7890629459ba None admin] PATH_INFO: `/v3/groups/e46ab79c89484fcca57bfc9d9548be28` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:17.966866 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8dda8a-5a30-4d24-a686-7890629459ba None admin] RBAC: Authorizing `identity:get_group(group_id=e46ab79c89484fcca57bfc9d9548be28)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:17.968899 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8dda8a-5a30-4d24-a686-7890629459ba None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:17.976050 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 193/379] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 21:52:17 2022] GET /identity/v3/groups/e46ab79c89484fcca57bfc9d9548be28 => generated 229 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:52:17.981596 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccada4f-6c92-4cf6-8f92-f7354b23fe6f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:18.064123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:18.136263 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccada4f-6c92-4cf6-8f92-f7354b23fe6f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:18.180307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c840b27-683c-486e-9713-f8fb8b65628c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:18.181053 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c840b27-683c-486e-9713-f8fb8b65628c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:18.181339 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c840b27-683c-486e-9713-f8fb8b65628c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:18.181618 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c840b27-683c-486e-9713-f8fb8b65628c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:18.182552 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c840b27-683c-486e-9713-f8fb8b65628c None admin] RBAC: Adding query filter params (group.id=e46ab79c89484fcca57bfc9d9548be28, role.id=04369f3c13174671a298fcd8175998d8, scope.project.id=64ecee0211ba477d8f867eb1b5f77c2e) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:18.182865 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c840b27-683c-486e-9713-f8fb8b65628c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:18.184348 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c840b27-683c-486e-9713-f8fb8b65628c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:18.191039 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 187/380] 10.222.0.35 () {56 vars in 1376 bytes} [Thu May 19 21:52:17 2022] GET /identity/v3/role_assignments?group.id=e46ab79c89484fcca57bfc9d9548be28&scope.project.id=64ecee0211ba477d8f867eb1b5f77c2e&role.id=04369f3c13174671a298fcd8175998d8 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:18.655058 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7caca1-4090-4002-abf9-bb9deee7bac4 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:18.655396 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7caca1-4090-4002-abf9-bb9deee7bac4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:18.655566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7caca1-4090-4002-abf9-bb9deee7bac4 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:18.657221 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 194/381] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:18.662950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621e34f-6bdc-4aa7-a528-6d3a8fbde068 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:18.663241 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621e34f-6bdc-4aa7-a528-6d3a8fbde068 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:18.663525 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621e34f-6bdc-4aa7-a528-6d3a8fbde068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:18.681373 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c621e34f-6bdc-4aa7-a528-6d3a8fbde068 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:18.682894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c621e34f-6bdc-4aa7-a528-6d3a8fbde068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:18.782070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 188/382] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:52:18.819638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7caca1-4090-4002-abf9-bb9deee7bac4 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:18.960224 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:18.966932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7caca1-4090-4002-abf9-bb9deee7bac4 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:19.037691 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454b146-6cd7-411c-8255-9833b6581916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:19.038519 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454b146-6cd7-411c-8255-9833b6581916 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:19.038806 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454b146-6cd7-411c-8255-9833b6581916 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:19.039086 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454b146-6cd7-411c-8255-9833b6581916 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:19.051227 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454b146-6cd7-411c-8255-9833b6581916 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:19.064008 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-9454b146-6cd7-411c-8255-9833b6581916 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:52:19.064008 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:19.064008 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:19.064008 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:19.064008 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:19.064008 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:19.064008 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:19.064008 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:19.064008 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:19.064008 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:19.064008 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:19.064008 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:19.064008 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:19.064008 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:19.064008 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:19.064008 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:19.064978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:19.064978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:19.064978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:19.064978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:19.064978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:19.064978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:19.064978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:19.064978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:19.064978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:19.064978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:19.064978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:19.064978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:19.064978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:19.064978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:19.064978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:19.064978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:19.065748 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:19.065748 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:19.065748 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:19.065748 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:19.065748 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:19.065748 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:19.065748 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:19.065748 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:19.065748 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:19.065748 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:19.065748 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:52:19.065748 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:19.068602 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 195/383] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 21:52:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:19.077515 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c621e34f-6bdc-4aa7-a528-6d3a8fbde068 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:19.154424 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:19.227206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c621e34f-6bdc-4aa7-a528-6d3a8fbde068 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:19.255937 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a81a13-0fcd-46f1-8131-1f02017cd9bd None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:19.256244 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a81a13-0fcd-46f1-8131-1f02017cd9bd None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:19.256528 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a81a13-0fcd-46f1-8131-1f02017cd9bd None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:19.258032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 196/384] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:52:19.264225 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4372a-e6cf-4552-8f56-0618bd707ab6 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:19.264605 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4372a-e6cf-4552-8f56-0618bd707ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:19.264818 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4372a-e6cf-4552-8f56-0618bd707ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:19.288175 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc6a18-549d-4213-85be-fac20486a433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:19.295172 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc6a18-549d-4213-85be-fac20486a433 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:19.295834 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc6a18-549d-4213-85be-fac20486a433 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:19.296319 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc6a18-549d-4213-85be-fac20486a433 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:19.297360 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc6a18-549d-4213-85be-fac20486a433 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:19.297894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc6a18-549d-4213-85be-fac20486a433 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:19.299542 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc6a18-549d-4213-85be-fac20486a433 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:19.301580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-45f4372a-e6cf-4552-8f56-0618bd707ab6 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:19.302998 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-45f4372a-e6cf-4552-8f56-0618bd707ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:19.310985 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 189/385] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:52:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:19.317350 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc6a18-549d-4213-85be-fac20486a433 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:19.425643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 197/386] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:52:19.449723 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4372a-e6cf-4552-8f56-0618bd707ab6 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:19.508501 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc6a18-549d-4213-85be-fac20486a433 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:19.510047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:19.546472 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc58c62-e374-49b6-bdc1-069f9bea9384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:19.546951 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc58c62-e374-49b6-bdc1-069f9bea9384 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:19.547230 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc58c62-e374-49b6-bdc1-069f9bea9384 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:19.547500 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc58c62-e374-49b6-bdc1-069f9bea9384 None admin] PATH_INFO: `/v3/groups/d07a2f2021e44aa4b1fd33eab6a60898` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:19.548710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc58c62-e374-49b6-bdc1-069f9bea9384 None admin] RBAC: Authorizing `identity:get_group(group_id=d07a2f2021e44aa4b1fd33eab6a60898)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:19.550354 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc58c62-e374-49b6-bdc1-069f9bea9384 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:19.552444 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 190/387] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 21:52:19 2022] GET /identity/v3/groups/d07a2f2021e44aa4b1fd33eab6a60898 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:19.561388 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc58c62-e374-49b6-bdc1-069f9bea9384 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:19.573925 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:19.587683 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4372a-e6cf-4552-8f56-0618bd707ab6 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:19.624722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fd6ac-ce45-4cd8-915d-d7b872e6171e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:19.625547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fd6ac-ce45-4cd8-915d-d7b872e6171e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:19.625827 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fd6ac-ce45-4cd8-915d-d7b872e6171e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:19.626099 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fd6ac-ce45-4cd8-915d-d7b872e6171e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:19.639923 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7fd6ac-ce45-4cd8-915d-d7b872e6171e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:19.648717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-fb7fd6ac-ce45-4cd8-915d-d7b872e6171e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:52:19.648717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:19.648717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:19.648717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:19.648717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:19.648717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:19.648717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:19.648717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:19.648717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:19.648717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:19.648717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:19.648717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:19.648717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:19.648717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:19.648717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:19.648717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:19.649647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:19.649647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:19.649647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:19.649647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:19.649647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:19.649647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:19.649647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:19.649647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:19.649647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:19.649647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:19.649647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:19.649647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:19.649647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:19.649647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:19.649647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:19.649647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:19.650395 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:19.650395 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:19.650395 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:19.650395 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:19.650395 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:19.650395 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:19.650395 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:19.650395 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:19.650395 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:19.650395 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:19.650395 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:52:19.650395 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:19.650395 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 198/388] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:52:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:52:19.651824 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0438fe7-2e02-45ff-9b0b-3cfca6d8312a None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:19.652216 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0438fe7-2e02-45ff-9b0b-3cfca6d8312a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:19.657294 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0438fe7-2e02-45ff-9b0b-3cfca6d8312a None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:19.659178 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 199/389] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:19.659977 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0438fe7-2e02-45ff-9b0b-3cfca6d8312a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:19.705096 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc58c62-e374-49b6-bdc1-069f9bea9384 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:19.742696 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca96361-819d-4546-8dc0-85a84fb6586f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:19.743930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca96361-819d-4546-8dc0-85a84fb6586f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:19.744958 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca96361-819d-4546-8dc0-85a84fb6586f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:19.745455 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca96361-819d-4546-8dc0-85a84fb6586f None admin] PATH_INFO: `/v3/projects/eeea527f528b47d882789251a2058689` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:19.746898 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca96361-819d-4546-8dc0-85a84fb6586f None admin] RBAC: Authorizing `identity:get_project(project_id=eeea527f528b47d882789251a2058689)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:19.748619 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca96361-819d-4546-8dc0-85a84fb6586f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:19.750833 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 191/390] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:52:19 2022] GET /identity/v3/projects/eeea527f528b47d882789251a2058689 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:19.752183 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c3ef3-d62c-4e90-ab1b-86e1085c19aa None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:19.752702 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c3ef3-d62c-4e90-ab1b-86e1085c19aa None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:19.753191 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c3ef3-d62c-4e90-ab1b-86e1085c19aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:19.772301 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-249c3ef3-d62c-4e90-ab1b-86e1085c19aa None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:19.773831 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-249c3ef3-d62c-4e90-ab1b-86e1085c19aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:19.791549 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0438fe7-2e02-45ff-9b0b-3cfca6d8312a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:19.810740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:19.838695 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd81ee1-8de6-4fe1-9b51-5a98ba942b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:19.839496 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd81ee1-8de6-4fe1-9b51-5a98ba942b6e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:19.839785 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd81ee1-8de6-4fe1-9b51-5a98ba942b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:19.840744 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd81ee1-8de6-4fe1-9b51-5a98ba942b6e None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:19.841559 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd81ee1-8de6-4fe1-9b51-5a98ba942b6e None admin] RBAC: Adding query filter params (name=member) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:19.842168 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd81ee1-8de6-4fe1-9b51-5a98ba942b6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:19.843815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd81ee1-8de6-4fe1-9b51-5a98ba942b6e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:19.855556 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 200/391] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 21:52:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:19.860166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 192/392] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:19.860935 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd81ee1-8de6-4fe1-9b51-5a98ba942b6e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:19.864949 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c3ef3-d62c-4e90-ab1b-86e1085c19aa None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:19.879554 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:19.994883 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd81ee1-8de6-4fe1-9b51-5a98ba942b6e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:20.011114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c3ef3-d62c-4e90-ab1b-86e1085c19aa None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:20.032107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bfcb3-0f8c-4d54-9055-208bd2cdd11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:20.032954 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bfcb3-0f8c-4d54-9055-208bd2cdd11d None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:20.033232 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bfcb3-0f8c-4d54-9055-208bd2cdd11d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:20.033598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bfcb3-0f8c-4d54-9055-208bd2cdd11d None admin] PATH_INFO: `/v3/projects/eeea527f528b47d882789251a2058689/groups/d07a2f2021e44aa4b1fd33eab6a60898/roles/3fb2a96d6ee74a7dbd046488f5ec322b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:20.035870 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8bfcb3-0f8c-4d54-9055-208bd2cdd11d None admin] RBAC: Authorizing `identity:create_grant(project_id=eeea527f528b47d882789251a2058689, group_id=d07a2f2021e44aa4b1fd33eab6a60898, role_id=3fb2a96d6ee74a7dbd046488f5ec322b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:20.037528 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8bfcb3-0f8c-4d54-9055-208bd2cdd11d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:20.052866 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003a044-6d09-402e-91ac-7e47385061b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:20.053936 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003a044-6d09-402e-91ac-7e47385061b5 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:20.054331 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003a044-6d09-402e-91ac-7e47385061b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:20.054704 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003a044-6d09-402e-91ac-7e47385061b5 None admin] PATH_INFO: `/v3/groups/d07a2f2021e44aa4b1fd33eab6a60898` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:20.055216 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 201/393] 10.222.0.35 () {58 vars in 1442 bytes} [Thu May 19 21:52:19 2022] PUT /identity/v3/projects/eeea527f528b47d882789251a2058689/groups/d07a2f2021e44aa4b1fd33eab6a60898/roles/3fb2a96d6ee74a7dbd046488f5ec322b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:52:20.056116 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bfcb3-0f8c-4d54-9055-208bd2cdd11d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:20.063184 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003a044-6d09-402e-91ac-7e47385061b5 None admin] RBAC: Authorizing `identity:get_group(group_id=d07a2f2021e44aa4b1fd33eab6a60898)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:20.063916 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003a044-6d09-402e-91ac-7e47385061b5 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:20.066105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 193/394] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 21:52:19 2022] GET /identity/v3/groups/d07a2f2021e44aa4b1fd33eab6a60898 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:20.081498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003a044-6d09-402e-91ac-7e47385061b5 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:20.164886 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:20.199098 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:20.210445 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bfcb3-0f8c-4d54-9055-208bd2cdd11d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:20.252955 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f438b-6791-490e-9b71-a7d62a2b9727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:20.253810 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f438b-6791-490e-9b71-a7d62a2b9727 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:20.254112 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f438b-6791-490e-9b71-a7d62a2b9727 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:20.254390 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f438b-6791-490e-9b71-a7d62a2b9727 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:20.270312 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f438b-6791-490e-9b71-a7d62a2b9727 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:20.283361 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-379f438b-6791-490e-9b71-a7d62a2b9727 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:52:20.283361 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:20.283361 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:20.283361 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:20.283361 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:20.283361 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:20.283361 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:20.283361 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:20.283361 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:20.283361 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:20.283361 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:20.283361 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:20.283361 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:20.283361 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:20.283361 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:20.283361 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:20.284275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:20.284275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:20.284275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:20.284275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:20.284275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:20.284275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:20.284275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:20.284275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:20.284275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:20.284275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:20.284275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:20.284275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:20.284275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:20.284275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:20.284275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:20.284275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:20.285173 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:20.285173 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:20.285173 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:20.285173 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:20.285173 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:20.285173 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:20.285173 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:20.285173 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:20.285173 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:20.285173 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:20.285173 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:52:20.285173 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:20.285173 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 202/395] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:52:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:20.292723 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f438b-6791-490e-9b71-a7d62a2b9727 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:20.369779 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003a044-6d09-402e-91ac-7e47385061b5 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:20.420239 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d996f-1b21-42df-abc0-915f211a5d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:20.421160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d996f-1b21-42df-abc0-915f211a5d5e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:20.421444 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d996f-1b21-42df-abc0-915f211a5d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:20.421718 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d996f-1b21-42df-abc0-915f211a5d5e None admin] PATH_INFO: `/v3/projects/eeea527f528b47d882789251a2058689` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:20.424106 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d996f-1b21-42df-abc0-915f211a5d5e None admin] RBAC: Authorizing `identity:get_project(project_id=eeea527f528b47d882789251a2058689)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:20.425621 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d996f-1b21-42df-abc0-915f211a5d5e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:20.432628 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 194/396] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:52:20 2022] GET /identity/v3/projects/eeea527f528b47d882789251a2058689 => generated 298 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:20.434330 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d996f-1b21-42df-abc0-915f211a5d5e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:20.450542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f438b-6791-490e-9b71-a7d62a2b9727 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:20.501181 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b14d10-c289-4458-875f-0f99c6ca4099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:20.502108 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b14d10-c289-4458-875f-0f99c6ca4099 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:20.502744 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b14d10-c289-4458-875f-0f99c6ca4099 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:20.503174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b14d10-c289-4458-875f-0f99c6ca4099 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:20.504095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b14d10-c289-4458-875f-0f99c6ca4099 None admin] RBAC: Adding query filter params (name=member) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:20.504590 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b14d10-c289-4458-875f-0f99c6ca4099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:20.506432 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b14d10-c289-4458-875f-0f99c6ca4099 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:20.522054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 203/397] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 21:52:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:20.522473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:20.529845 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1fb3e-4c9b-4540-80c8-ccad38fca9c8 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:20.530140 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1fb3e-4c9b-4540-80c8-ccad38fca9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:20.530420 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1fb3e-4c9b-4540-80c8-ccad38fca9c8 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:20.531922 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 204/398] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:52:20.534260 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1fb3e-4c9b-4540-80c8-ccad38fca9c8 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:20.596314 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d996f-1b21-42df-abc0-915f211a5d5e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:20.599875 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:20.646492 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63f485-b59b-4e63-adcb-395b5fba1cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:20.647773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63f485-b59b-4e63-adcb-395b5fba1cc0 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:20.648262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63f485-b59b-4e63-adcb-395b5fba1cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:20.648878 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63f485-b59b-4e63-adcb-395b5fba1cc0 None admin] PATH_INFO: `/v3/projects/eeea527f528b47d882789251a2058689/groups/d07a2f2021e44aa4b1fd33eab6a60898/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:20.649349 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1fb3e-4c9b-4540-80c8-ccad38fca9c8 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:20.652351 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63f485-b59b-4e63-adcb-395b5fba1cc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=eeea527f528b47d882789251a2058689, group_id=d07a2f2021e44aa4b1fd33eab6a60898, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:20.655019 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63f485-b59b-4e63-adcb-395b5fba1cc0 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:20.680435 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 195/399] 10.222.0.35 () {58 vars in 1442 bytes} [Thu May 19 21:52:20 2022] PUT /identity/v3/projects/eeea527f528b47d882789251a2058689/groups/d07a2f2021e44aa4b1fd33eab6a60898/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:52:20.680435 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9f989-618f-4b34-b672-e7f3e63c91cc None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:20.680435 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9f989-618f-4b34-b672-e7f3e63c91cc None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:20.680435 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9f989-618f-4b34-b672-e7f3e63c91cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:20.715281 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409ae56-82b3-40ee-a866-8ce6ac010aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:20.716250 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409ae56-82b3-40ee-a866-8ce6ac010aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:20.716563 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409ae56-82b3-40ee-a866-8ce6ac010aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:20.717196 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409ae56-82b3-40ee-a866-8ce6ac010aa7 None admin] PATH_INFO: `/v3/groups/d07a2f2021e44aa4b1fd33eab6a60898` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:20.719359 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409ae56-82b3-40ee-a866-8ce6ac010aa7 None admin] RBAC: Authorizing `identity:get_group(group_id=d07a2f2021e44aa4b1fd33eab6a60898)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:20.721121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8ae9f989-618f-4b34-b672-e7f3e63c91cc None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:20.722948 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409ae56-82b3-40ee-a866-8ce6ac010aa7 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:20.724589 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8ae9f989-618f-4b34-b672-e7f3e63c91cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:20.727362 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 205/400] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 21:52:20 2022] GET /identity/v3/groups/d07a2f2021e44aa4b1fd33eab6a60898 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:20.734773 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409ae56-82b3-40ee-a866-8ce6ac010aa7 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:20.868881 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:20.874350 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 196/401] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:20.911683 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9f989-618f-4b34-b672-e7f3e63c91cc None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:20.941134 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409ae56-82b3-40ee-a866-8ce6ac010aa7 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:20.990691 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196797c-908a-4f9a-baf8-4f873e0f0252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:20.991608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196797c-908a-4f9a-baf8-4f873e0f0252 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:20.991891 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196797c-908a-4f9a-baf8-4f873e0f0252 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:20.992167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196797c-908a-4f9a-baf8-4f873e0f0252 None admin] PATH_INFO: `/v3/projects/87ea432faccb40e590632800fcca178a` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:20.993918 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2196797c-908a-4f9a-baf8-4f873e0f0252 None admin] RBAC: Authorizing `identity:get_project(project_id=87ea432faccb40e590632800fcca178a)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:20.996551 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2196797c-908a-4f9a-baf8-4f873e0f0252 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:20.997799 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 206/402] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:52:20 2022] GET /identity/v3/projects/87ea432faccb40e590632800fcca178a => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:52:20.999055 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db63fa2-8651-4f60-873f-9c8c8074a37a None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:20.999336 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db63fa2-8651-4f60-873f-9c8c8074a37a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:20.999705 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db63fa2-8651-4f60-873f-9c8c8074a37a None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:21.001197 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 207/403] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:21.005289 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db63fa2-8651-4f60-873f-9c8c8074a37a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:21.050254 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:21.058041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9f989-618f-4b34-b672-e7f3e63c91cc None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:21.112118 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825936b2-ec5c-473f-a556-d4e37d84db43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:21.113091 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825936b2-ec5c-473f-a556-d4e37d84db43 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:21.113461 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825936b2-ec5c-473f-a556-d4e37d84db43 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:21.113807 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825936b2-ec5c-473f-a556-d4e37d84db43 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:21.128448 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db63fa2-8651-4f60-873f-9c8c8074a37a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:21.128918 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825936b2-ec5c-473f-a556-d4e37d84db43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:21.139548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-825936b2-ec5c-473f-a556-d4e37d84db43 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:52:21.139548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:21.139548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:21.139548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:21.139548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:21.139548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:21.139548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:21.139548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:21.139548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:21.139548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:21.139548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:21.139548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:21.139548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:21.139548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:21.139548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:21.139548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:21.140517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:21.140517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:21.140517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:21.140517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:21.140517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:21.140517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:21.140517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:21.140517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:21.140517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:21.140517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:21.140517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:21.140517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:21.140517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:21.140517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:21.140517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:21.140517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:21.141311 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:21.141311 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:21.141311 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:21.141311 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:21.141311 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:21.141311 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:21.141311 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:21.141311 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:21.141311 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:21.141311 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:21.141311 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:52:21.141311 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:21.144506 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 197/404] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 21:52:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:21.145992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf4f6b-a8ae-4197-a89e-8041a008a6e5 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:21.146278 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf4f6b-a8ae-4197-a89e-8041a008a6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:21.152430 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf4f6b-a8ae-4197-a89e-8041a008a6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:21.170350 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:21.172939 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e5bf4f6b-a8ae-4197-a89e-8041a008a6e5 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:21.175217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e5bf4f6b-a8ae-4197-a89e-8041a008a6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:21.178103 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282948c-3aef-482f-bc07-e883dbade42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:21.179134 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282948c-3aef-482f-bc07-e883dbade42f None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:21.179598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282948c-3aef-482f-bc07-e883dbade42f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:21.179969 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282948c-3aef-482f-bc07-e883dbade42f None admin] PATH_INFO: `/v3/projects/87ea432faccb40e590632800fcca178a/groups/d07a2f2021e44aa4b1fd33eab6a60898/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:21.182278 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282948c-3aef-482f-bc07-e883dbade42f None admin] RBAC: Authorizing `identity:create_grant(project_id=87ea432faccb40e590632800fcca178a, group_id=d07a2f2021e44aa4b1fd33eab6a60898, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:21.183913 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282948c-3aef-482f-bc07-e883dbade42f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:21.204597 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 208/405] 10.222.0.35 () {58 vars in 1442 bytes} [Thu May 19 21:52:21 2022] PUT /identity/v3/projects/87ea432faccb40e590632800fcca178a/groups/d07a2f2021e44aa4b1fd33eab6a60898/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:52:21.205764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282948c-3aef-482f-bc07-e883dbade42f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:21.271879 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 198/406] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:21.310502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf4f6b-a8ae-4197-a89e-8041a008a6e5 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:21.407287 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282948c-3aef-482f-bc07-e883dbade42f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:21.470711 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:21.487814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d65322-d846-4cda-ba9f-51049b13f4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:21.488603 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d65322-d846-4cda-ba9f-51049b13f4d4 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:21.488890 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d65322-d846-4cda-ba9f-51049b13f4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:21.489165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d65322-d846-4cda-ba9f-51049b13f4d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:21.490212 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d65322-d846-4cda-ba9f-51049b13f4d4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:21.490522 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d65322-d846-4cda-ba9f-51049b13f4d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:21.491976 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d65322-d846-4cda-ba9f-51049b13f4d4 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:21.501661 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf4f6b-a8ae-4197-a89e-8041a008a6e5 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:21.507742 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 209/407] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:52:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:21.514483 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d65322-d846-4cda-ba9f-51049b13f4d4 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:21.547100 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249604b-1870-4c6e-98b4-91c933683aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:21.548265 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249604b-1870-4c6e-98b4-91c933683aec None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:21.548798 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249604b-1870-4c6e-98b4-91c933683aec None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:21.549348 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249604b-1870-4c6e-98b4-91c933683aec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:21.574624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249604b-1870-4c6e-98b4-91c933683aec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:21.591383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-1249604b-1870-4c6e-98b4-91c933683aec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:52:21.591383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:21.591383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:21.591383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:21.591383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:21.591383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:21.591383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:21.591383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:21.591383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:21.591383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:21.591383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:21.591383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:21.591383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:21.591383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:21.591383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:21.591383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:21.592329 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:21.592329 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:21.592329 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:21.592329 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:21.592329 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:21.592329 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:21.592329 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:21.592329 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:21.592329 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:21.592329 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:21.592329 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:21.592329 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:21.592329 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:21.592329 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:21.592329 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:21.592329 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:21.593154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:21.593154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:21.593154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:21.593154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:21.593154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:21.593154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:21.593154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:21.593154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:21.593154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:21.593154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:21.593154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:52:21.593154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:21.593745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:21.595998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 199/408] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:52:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:52:21.601559 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249604b-1870-4c6e-98b4-91c933683aec None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:21.683057 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d65322-d846-4cda-ba9f-51049b13f4d4 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:21.746817 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82dcb6-7d29-4985-8abe-fc7aec60b0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:21.747527 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249604b-1870-4c6e-98b4-91c933683aec None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:21.747688 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82dcb6-7d29-4985-8abe-fc7aec60b0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:21.747966 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82dcb6-7d29-4985-8abe-fc7aec60b0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:21.748228 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82dcb6-7d29-4985-8abe-fc7aec60b0d3 None admin] PATH_INFO: `/v3/groups/d07a2f2021e44aa4b1fd33eab6a60898` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:21.755880 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82dcb6-7d29-4985-8abe-fc7aec60b0d3 None admin] RBAC: Authorizing `identity:get_group(group_id=d07a2f2021e44aa4b1fd33eab6a60898)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:21.758023 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82dcb6-7d29-4985-8abe-fc7aec60b0d3 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:21.777225 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 210/409] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 21:52:21 2022] GET /identity/v3/groups/d07a2f2021e44aa4b1fd33eab6a60898 => generated 226 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:52:21.778201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82dcb6-7d29-4985-8abe-fc7aec60b0d3 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:21.818325 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5d404-886f-46e1-96ec-0c69da932328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:21.821085 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5d404-886f-46e1-96ec-0c69da932328 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:21.822936 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5d404-886f-46e1-96ec-0c69da932328 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:21.823729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5d404-886f-46e1-96ec-0c69da932328 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:21.829469 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5d404-886f-46e1-96ec-0c69da932328 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:21.829786 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5d404-886f-46e1-96ec-0c69da932328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:21.831248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5d404-886f-46e1-96ec-0c69da932328 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:21.849401 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 200/410] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:52:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:52:21.857387 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5d404-886f-46e1-96ec-0c69da932328 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:21.870786 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:21.992032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82dcb6-7d29-4985-8abe-fc7aec60b0d3 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:22.014552 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:22.017090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5d404-886f-46e1-96ec-0c69da932328 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:22.030177 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c0bdf-fcf0-4e14-9bc7-61ae0a81d5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:22.031059 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c0bdf-fcf0-4e14-9bc7-61ae0a81d5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:22.031350 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c0bdf-fcf0-4e14-9bc7-61ae0a81d5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:22.031635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c0bdf-fcf0-4e14-9bc7-61ae0a81d5b0 None admin] PATH_INFO: `/v3/projects/87ea432faccb40e590632800fcca178a` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:22.033096 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c0bdf-fcf0-4e14-9bc7-61ae0a81d5b0 None admin] RBAC: Authorizing `identity:get_project(project_id=87ea432faccb40e590632800fcca178a)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:22.034860 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c0bdf-fcf0-4e14-9bc7-61ae0a81d5b0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:22.041650 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 211/411] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:52:21 2022] GET /identity/v3/projects/87ea432faccb40e590632800fcca178a => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:22.043122 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c0bdf-fcf0-4e14-9bc7-61ae0a81d5b0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:22.095610 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa7694-56c2-470a-a192-f408443d5a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:22.096590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa7694-56c2-470a-a192-f408443d5a45 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:22.096916 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa7694-56c2-470a-a192-f408443d5a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:22.097207 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa7694-56c2-470a-a192-f408443d5a45 None admin] PATH_INFO: `/v3/groups/e46ab79c89484fcca57bfc9d9548be28` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:22.098425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa7694-56c2-470a-a192-f408443d5a45 None admin] RBAC: Authorizing `identity:get_group(group_id=e46ab79c89484fcca57bfc9d9548be28)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:22.099882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa7694-56c2-470a-a192-f408443d5a45 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:22.101714 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 201/412] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 21:52:21 2022] GET /identity/v3/groups/e46ab79c89484fcca57bfc9d9548be28 => generated 229 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:22.107618 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa7694-56c2-470a-a192-f408443d5a45 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:22.253434 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:22.257367 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c0bdf-fcf0-4e14-9bc7-61ae0a81d5b0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:22.307797 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa7694-56c2-470a-a192-f408443d5a45 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:22.331901 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3dda3-7d75-4e0a-9de1-52c8f48d0122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:22.332819 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3dda3-7d75-4e0a-9de1-52c8f48d0122 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:22.333097 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3dda3-7d75-4e0a-9de1-52c8f48d0122 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:22.333456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3dda3-7d75-4e0a-9de1-52c8f48d0122 None admin] PATH_INFO: `/v3/projects/87ea432faccb40e590632800fcca178a/groups/d07a2f2021e44aa4b1fd33eab6a60898/roles/3fb2a96d6ee74a7dbd046488f5ec322b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:22.340236 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3dda3-7d75-4e0a-9de1-52c8f48d0122 None admin] RBAC: Authorizing `identity:create_grant(project_id=87ea432faccb40e590632800fcca178a, group_id=d07a2f2021e44aa4b1fd33eab6a60898, role_id=3fb2a96d6ee74a7dbd046488f5ec322b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:22.341943 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3dda3-7d75-4e0a-9de1-52c8f48d0122 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:22.368572 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 212/413] 10.222.0.35 () {58 vars in 1442 bytes} [Thu May 19 21:52:22 2022] PUT /identity/v3/projects/87ea432faccb40e590632800fcca178a/groups/d07a2f2021e44aa4b1fd33eab6a60898/roles/3fb2a96d6ee74a7dbd046488f5ec322b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:52:22.378304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c3949-2f57-40ec-bcba-71f462fd2847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:22.379368 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c3949-2f57-40ec-bcba-71f462fd2847 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:22.379715 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c3949-2f57-40ec-bcba-71f462fd2847 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:22.379988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c3949-2f57-40ec-bcba-71f462fd2847 None admin] PATH_INFO: `/v3/projects/64ecee0211ba477d8f867eb1b5f77c2e` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:22.381361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c3949-2f57-40ec-bcba-71f462fd2847 None admin] RBAC: Authorizing `identity:get_project(project_id=64ecee0211ba477d8f867eb1b5f77c2e)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:22.382903 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c3949-2f57-40ec-bcba-71f462fd2847 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:22.385896 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 202/414] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:52:22 2022] GET /identity/v3/projects/64ecee0211ba477d8f867eb1b5f77c2e => generated 344 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:22.391422 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3dda3-7d75-4e0a-9de1-52c8f48d0122 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:22.479115 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:22.568913 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3dda3-7d75-4e0a-9de1-52c8f48d0122 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:22.634555 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ea9c6-e06e-41ae-bffb-3cb2fa7e7b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:22.636103 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ea9c6-e06e-41ae-bffb-3cb2fa7e7b58 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:22.636390 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ea9c6-e06e-41ae-bffb-3cb2fa7e7b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:22.636755 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ea9c6-e06e-41ae-bffb-3cb2fa7e7b58 None admin] PATH_INFO: `/v3/projects/64ecee0211ba477d8f867eb1b5f77c2e/groups/e46ab79c89484fcca57bfc9d9548be28/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:22.641257 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ea9c6-e06e-41ae-bffb-3cb2fa7e7b58 None admin] RBAC: Authorizing `identity:create_grant(project_id=64ecee0211ba477d8f867eb1b5f77c2e, group_id=e46ab79c89484fcca57bfc9d9548be28, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:22.643379 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ea9c6-e06e-41ae-bffb-3cb2fa7e7b58 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:22.660795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 213/415] 10.222.0.35 () {58 vars in 1442 bytes} [Thu May 19 21:52:22 2022] PUT /identity/v3/projects/64ecee0211ba477d8f867eb1b5f77c2e/groups/e46ab79c89484fcca57bfc9d9548be28/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:52:22.802176 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323abd7-4904-46c2-ad7a-858ffe101e22 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:22.802463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323abd7-4904-46c2-ad7a-858ffe101e22 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:22.802990 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323abd7-4904-46c2-ad7a-858ffe101e22 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:22.805012 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 203/416] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:22.811470 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137d600-c5a9-4cc0-87ef-1dc71678d348 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:22.811768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137d600-c5a9-4cc0-87ef-1dc71678d348 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:22.812233 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137d600-c5a9-4cc0-87ef-1dc71678d348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:22.835511 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8137d600-c5a9-4cc0-87ef-1dc71678d348 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:22.837089 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8137d600-c5a9-4cc0-87ef-1dc71678d348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:22.919912 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 214/417] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:22.956639 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323abd7-4904-46c2-ad7a-858ffe101e22 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:23.099869 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323abd7-4904-46c2-ad7a-858ffe101e22 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:23.146207 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b02506-14e6-4d71-8a3a-a1e54640576e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:23.147056 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b02506-14e6-4d71-8a3a-a1e54640576e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:23.147343 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b02506-14e6-4d71-8a3a-a1e54640576e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:23.147622 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b02506-14e6-4d71-8a3a-a1e54640576e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:23.161650 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b02506-14e6-4d71-8a3a-a1e54640576e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:23.169812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-a1b02506-14e6-4d71-8a3a-a1e54640576e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:52:23.169812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:23.169812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:23.169812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:23.169812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:23.169812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:23.169812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:23.169812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:23.169812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:23.169812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:23.169812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:23.169812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:23.169812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:23.169812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:23.169812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:23.169812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:23.170693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:23.170693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:23.170693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:23.170693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:23.170693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:23.170693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:23.170693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:23.170693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:23.170693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:23.170693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:23.170693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:23.170693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:23.170693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:23.170693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:23.170693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:23.170693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:23.171475 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:23.171475 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:23.171475 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:23.171475 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:23.171475 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:23.171475 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:23.171475 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:23.171475 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:23.171475 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:23.171475 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:23.171475 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:52:23.171475 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:23.171475 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 204/418] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 21:52:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:23.184170 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137d600-c5a9-4cc0-87ef-1dc71678d348 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:23.235178 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:23.302757 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137d600-c5a9-4cc0-87ef-1dc71678d348 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:23.341834 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1dfbc4-db4f-4940-99c4-5798fc770b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:23.342928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dfbc4-db4f-4940-99c4-5798fc770b61 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:23.343446 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dfbc4-db4f-4940-99c4-5798fc770b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:23.343924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dfbc4-db4f-4940-99c4-5798fc770b61 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:23.344930 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1dfbc4-db4f-4940-99c4-5798fc770b61 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:23.345459 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1dfbc4-db4f-4940-99c4-5798fc770b61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:23.347045 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1dfbc4-db4f-4940-99c4-5798fc770b61 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:23.356901 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 215/419] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:52:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:23.365823 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b02506-14e6-4d71-8a3a-a1e54640576e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:23.379868 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:23.502735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b02506-14e6-4d71-8a3a-a1e54640576e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:23.539807 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163b9b1-81b1-4d47-9787-b24d68d2a3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:23.540601 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163b9b1-81b1-4d47-9787-b24d68d2a3ca None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:23.540837 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163b9b1-81b1-4d47-9787-b24d68d2a3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:23.541292 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163b9b1-81b1-4d47-9787-b24d68d2a3ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:23.651924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163b9b1-81b1-4d47-9787-b24d68d2a3ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:23.653379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163b9b1-81b1-4d47-9787-b24d68d2a3ca None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:23.658825 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:23.705424 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603da44f-a7cb-4ce4-b5c1-cdec94b350db None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:23.705750 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603da44f-a7cb-4ce4-b5c1-cdec94b350db None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:23.705986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603da44f-a7cb-4ce4-b5c1-cdec94b350db None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:23.711239 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 216/420] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:52:23.716206 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17c3bf-8c50-4720-9b89-df1e9bee6b71 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:23.716541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17c3bf-8c50-4720-9b89-df1e9bee6b71 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:23.716818 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17c3bf-8c50-4720-9b89-df1e9bee6b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:23.761587 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-4d17c3bf-8c50-4720-9b89-df1e9bee6b71 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:23.762793 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4d17c3bf-8c50-4720-9b89-df1e9bee6b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:23.826527 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 205/421] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:52:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:52:23.827756 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163b9b1-81b1-4d47-9787-b24d68d2a3ca None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:23.906780 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 217/422] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:23.946982 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17c3bf-8c50-4720-9b89-df1e9bee6b71 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:23.995293 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163b9b1-81b1-4d47-9787-b24d68d2a3ca None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:23.999617 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:24.008776 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:24.036124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8aa39-acc5-4230-94d7-07ea95d6cab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:24.037524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8aa39-acc5-4230-94d7-07ea95d6cab1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:24.038023 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8aa39-acc5-4230-94d7-07ea95d6cab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:24.038487 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8aa39-acc5-4230-94d7-07ea95d6cab1 None admin] PATH_INFO: `/v3/projects/eeea527f528b47d882789251a2058689` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:24.039909 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8aa39-acc5-4230-94d7-07ea95d6cab1 None admin] RBAC: Authorizing `identity:get_project(project_id=eeea527f528b47d882789251a2058689)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:24.042221 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8aa39-acc5-4230-94d7-07ea95d6cab1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:24.044587 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 206/423] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:52:23 2022] GET /identity/v3/projects/eeea527f528b47d882789251a2058689 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:24.059733 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8aa39-acc5-4230-94d7-07ea95d6cab1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:24.172521 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17c3bf-8c50-4720-9b89-df1e9bee6b71 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:24.218638 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8aa39-acc5-4230-94d7-07ea95d6cab1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:24.261629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd91887-1980-45e5-9c20-01210e43d865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:24.262451 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd91887-1980-45e5-9c20-01210e43d865 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:24.262733 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd91887-1980-45e5-9c20-01210e43d865 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:24.263005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd91887-1980-45e5-9c20-01210e43d865 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:24.279812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0e02d-f426-447e-804b-650c0ff500bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:24.279812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0e02d-f426-447e-804b-650c0ff500bf None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:24.279812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0e02d-f426-447e-804b-650c0ff500bf None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:24.279812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0e02d-f426-447e-804b-650c0ff500bf None admin] PATH_INFO: `/v3/groups/d07a2f2021e44aa4b1fd33eab6a60898` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:24.280216 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0e02d-f426-447e-804b-650c0ff500bf None admin] RBAC: Authorizing `identity:get_group(group_id=d07a2f2021e44aa4b1fd33eab6a60898)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:24.280216 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0e02d-f426-447e-804b-650c0ff500bf None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:24.287322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 207/424] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 21:52:24 2022] GET /identity/v3/groups/d07a2f2021e44aa4b1fd33eab6a60898 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:24.287322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07284d08-8c0f-4c45-b318-c05ecbb7b83f None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:24.287322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07284d08-8c0f-4c45-b318-c05ecbb7b83f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:24.287322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07284d08-8c0f-4c45-b318-c05ecbb7b83f None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:24.287322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 208/425] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:24.287322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07284d08-8c0f-4c45-b318-c05ecbb7b83f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:24.296286 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd91887-1980-45e5-9c20-01210e43d865 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:24.303797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-dcd91887-1980-45e5-9c20-01210e43d865 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:52:24.303797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:24.303797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:24.303797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:24.303797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:24.303797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:24.303797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:24.303797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:24.303797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:24.303797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:24.303797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:24.303797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:24.303797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:24.303797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:24.303797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:24.303797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:24.304769 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:24.304769 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:24.304769 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:24.304769 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:24.304769 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:24.304769 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:24.304769 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:24.304769 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:24.304769 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:24.304769 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:24.304769 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:24.304769 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:24.304769 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:24.304769 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:24.304769 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:24.304769 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:24.305584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:24.305584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:24.305584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:24.305584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:24.305584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:24.305584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:24.305584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:24.305584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:24.305584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:24.305584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:24.305584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:52:24.305584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:24.305584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 218/426] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:52:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:52:24.306945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcdaac-e18f-472c-9584-e06d5c7f9797 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:24.307301 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcdaac-e18f-472c-9584-e06d5c7f9797 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:24.307587 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcdaac-e18f-472c-9584-e06d5c7f9797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:24.325034 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-dbbcdaac-e18f-472c-9584-e06d5c7f9797 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:24.326264 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-dbbcdaac-e18f-472c-9584-e06d5c7f9797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:24.349105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:24.406894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 219/427] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:24.406894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcdaac-e18f-472c-9584-e06d5c7f9797 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:24.444430 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:24.455256 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07284d08-8c0f-4c45-b318-c05ecbb7b83f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:24.503195 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ba850-c840-4e8c-b85b-02ed273fe761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:24.504206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ba850-c840-4e8c-b85b-02ed273fe761 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:24.504750 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ba850-c840-4e8c-b85b-02ed273fe761 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:24.505226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ba850-c840-4e8c-b85b-02ed273fe761 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:24.506276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ba850-c840-4e8c-b85b-02ed273fe761 None admin] RBAC: Adding query filter params (group.id=d07a2f2021e44aa4b1fd33eab6a60898, role.id=3fb2a96d6ee74a7dbd046488f5ec322b, scope.project.id=eeea527f528b47d882789251a2058689) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:24.506786 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ba850-c840-4e8c-b85b-02ed273fe761 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:24.508591 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ba850-c840-4e8c-b85b-02ed273fe761 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:24.512858 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcdaac-e18f-472c-9584-e06d5c7f9797 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:24.524723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 209/428] 10.222.0.35 () {56 vars in 1376 bytes} [Thu May 19 21:52:24 2022] GET /identity/v3/role_assignments?group.id=d07a2f2021e44aa4b1fd33eab6a60898&scope.project.id=eeea527f528b47d882789251a2058689&role.id=3fb2a96d6ee74a7dbd046488f5ec322b => generated 611 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:24.526049 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ba850-c840-4e8c-b85b-02ed273fe761 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:24.552162 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480b116-cb79-4f6f-8644-2e14b16e097c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:24.552643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480b116-cb79-4f6f-8644-2e14b16e097c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:24.552927 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480b116-cb79-4f6f-8644-2e14b16e097c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:24.553208 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480b116-cb79-4f6f-8644-2e14b16e097c None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:24.554023 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480b116-cb79-4f6f-8644-2e14b16e097c None admin] RBAC: Adding query filter params (name=member) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:24.554341 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480b116-cb79-4f6f-8644-2e14b16e097c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:24.555786 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480b116-cb79-4f6f-8644-2e14b16e097c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:24.566026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 220/429] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 21:52:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:24.571816 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480b116-cb79-4f6f-8644-2e14b16e097c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:24.676548 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:24.713573 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480b116-cb79-4f6f-8644-2e14b16e097c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:24.729781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ba850-c840-4e8c-b85b-02ed273fe761 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:24.731518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:24.770800 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3b374-6a54-452e-b0b8-4ebe3f1b91dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:24.771618 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3b374-6a54-452e-b0b8-4ebe3f1b91dd None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:24.771902 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3b374-6a54-452e-b0b8-4ebe3f1b91dd None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:24.772177 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3b374-6a54-452e-b0b8-4ebe3f1b91dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:24.784851 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3b374-6a54-452e-b0b8-4ebe3f1b91dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:24.790364 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d17cf-9774-428d-9c0f-a4cf90c0d7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:24.791386 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d17cf-9774-428d-9c0f-a4cf90c0d7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:24.791938 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d17cf-9774-428d-9c0f-a4cf90c0d7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:24.792469 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d17cf-9774-428d-9c0f-a4cf90c0d7f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:24.793752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-51f3b374-6a54-452e-b0b8-4ebe3f1b91dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 21:52:24.793752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:24.793752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:24.793752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:24.793752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:24.793752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:24.793752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:24.793752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:24.793752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:24.793752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:24.793752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:24.793752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:24.793752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:24.793752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:24.793752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:24.793752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:24.794706 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:24.794706 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:24.794706 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:24.794706 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:24.794706 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:24.794706 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:24.794706 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:24.794706 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:24.794706 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:24.794706 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:24.794706 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:24.794706 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:24.794706 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:24.794706 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:24.794706 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:24.794706 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:24.795482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:24.795482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:24.795482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:24.795482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:24.795482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:24.795482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:24.795482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:24.795482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:24.795482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:24.795482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:24.795482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 21:52:24.795482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:24.800596 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 210/430] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:52:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:24.801538 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3b374-6a54-452e-b0b8-4ebe3f1b91dd None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:24.893168 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d17cf-9774-428d-9c0f-a4cf90c0d7f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:24.903722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d17cf-9774-428d-9c0f-a4cf90c0d7f7 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:24.954692 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3b374-6a54-452e-b0b8-4ebe3f1b91dd None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:24.996486 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289460dd-6e82-474a-9128-f59883e26e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:24.997515 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289460dd-6e82-474a-9128-f59883e26e90 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:24.998007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289460dd-6e82-474a-9128-f59883e26e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:24.998489 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289460dd-6e82-474a-9128-f59883e26e90 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:25.006935 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289460dd-6e82-474a-9128-f59883e26e90 None admin] RBAC: Adding query filter params (name=member) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:25.007603 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289460dd-6e82-474a-9128-f59883e26e90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:25.009393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289460dd-6e82-474a-9128-f59883e26e90 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:25.010163 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:25.022055 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 211/431] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 21:52:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:52:25.028320 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289460dd-6e82-474a-9128-f59883e26e90 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:25.040508 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 221/432] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:52:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 21:52:25.048530 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d17cf-9774-428d-9c0f-a4cf90c0d7f7 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:25.067575 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:25.158719 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289460dd-6e82-474a-9128-f59883e26e90 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:25.177778 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d17cf-9774-428d-9c0f-a4cf90c0d7f7 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:25.200551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013ec71-15f2-4e20-bc52-d554fd65969c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:25.202180 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013ec71-15f2-4e20-bc52-d554fd65969c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:25.202676 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013ec71-15f2-4e20-bc52-d554fd65969c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:25.203156 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013ec71-15f2-4e20-bc52-d554fd65969c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:25.223258 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830acd63-ff08-4901-8b4a-919e938f68ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:25.224132 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830acd63-ff08-4901-8b4a-919e938f68ab None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:25.224432 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830acd63-ff08-4901-8b4a-919e938f68ab None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:25.225121 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830acd63-ff08-4901-8b4a-919e938f68ab None admin] PATH_INFO: `/v3/projects/eeea527f528b47d882789251a2058689` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:25.226598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830acd63-ff08-4901-8b4a-919e938f68ab None admin] RBAC: Authorizing `identity:get_project(project_id=eeea527f528b47d882789251a2058689)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:25.228358 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830acd63-ff08-4901-8b4a-919e938f68ab None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:25.232500 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 222/433] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:52:25 2022] GET /identity/v3/projects/eeea527f528b47d882789251a2058689 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:25.237860 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830acd63-ff08-4901-8b4a-919e938f68ab None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:25.315855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:25.316486 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013ec71-15f2-4e20-bc52-d554fd65969c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:25.319345 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013ec71-15f2-4e20-bc52-d554fd65969c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:25.356818 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:25.385408 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830acd63-ff08-4901-8b4a-919e938f68ab None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:25.425395 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6034129-8676-4f0b-95d9-168f884839cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:25.426965 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6034129-8676-4f0b-95d9-168f884839cd None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:25.426965 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6034129-8676-4f0b-95d9-168f884839cd None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:25.427260 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6034129-8676-4f0b-95d9-168f884839cd None admin] PATH_INFO: `/v3/groups/d07a2f2021e44aa4b1fd33eab6a60898` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:25.428599 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6034129-8676-4f0b-95d9-168f884839cd None admin] RBAC: Authorizing `identity:get_group(group_id=d07a2f2021e44aa4b1fd33eab6a60898)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:25.430057 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6034129-8676-4f0b-95d9-168f884839cd None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:25.432193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 223/434] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 21:52:25 2022] GET /identity/v3/groups/d07a2f2021e44aa4b1fd33eab6a60898 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:25.439768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6034129-8676-4f0b-95d9-168f884839cd None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:25.460766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 212/435] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:52:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 21:52:25.468307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013ec71-15f2-4e20-bc52-d554fd65969c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:25.555191 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6034129-8676-4f0b-95d9-168f884839cd None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:25.573263 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:25.579073 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013ec71-15f2-4e20-bc52-d554fd65969c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:25.592777 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16495c47-62ba-412f-96f4-7028bc8a304e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:25.593443 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16495c47-62ba-412f-96f4-7028bc8a304e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:25.593735 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16495c47-62ba-412f-96f4-7028bc8a304e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:25.594015 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16495c47-62ba-412f-96f4-7028bc8a304e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:25.594857 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16495c47-62ba-412f-96f4-7028bc8a304e None admin] RBAC: Adding query filter params (group.id=d07a2f2021e44aa4b1fd33eab6a60898, role.id=4749055b54a542b29f57155df3756136, scope.project.id=eeea527f528b47d882789251a2058689) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:25.595170 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16495c47-62ba-412f-96f4-7028bc8a304e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:25.596616 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16495c47-62ba-412f-96f4-7028bc8a304e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:25.602476 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 224/436] 10.222.0.35 () {56 vars in 1376 bytes} [Thu May 19 21:52:25 2022] GET /identity/v3/role_assignments?group.id=d07a2f2021e44aa4b1fd33eab6a60898&scope.project.id=eeea527f528b47d882789251a2058689&role.id=4749055b54a542b29f57155df3756136 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:52:25.603734 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edf1e0-7522-49f4-a445-d3628f27a6de None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:25.604022 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edf1e0-7522-49f4-a445-d3628f27a6de None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:25.604308 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edf1e0-7522-49f4-a445-d3628f27a6de None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:25.605603 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 225/437] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:25.606743 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa6f25-616e-4d9d-9a1c-b9dd9323dc80 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:25.607032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa6f25-616e-4d9d-9a1c-b9dd9323dc80 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:25.607316 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa6f25-616e-4d9d-9a1c-b9dd9323dc80 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:25.608821 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 226/438] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:25.611453 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee360768-1922-44a3-acdb-cc99158327b6 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:25.611738 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee360768-1922-44a3-acdb-cc99158327b6 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:25.612013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee360768-1922-44a3-acdb-cc99158327b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:25.614559 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:25.628453 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6c89d-15f5-461e-a5da-323ddc750f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:25.629335 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6c89d-15f5-461e-a5da-323ddc750f43 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:25.629614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6c89d-15f5-461e-a5da-323ddc750f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:25.629891 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6c89d-15f5-461e-a5da-323ddc750f43 None admin] PATH_INFO: `/v3/projects/87ea432faccb40e590632800fcca178a` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:25.631265 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d6c89d-15f5-461e-a5da-323ddc750f43 None admin] RBAC: Authorizing `identity:get_project(project_id=87ea432faccb40e590632800fcca178a)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:25.632796 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d6c89d-15f5-461e-a5da-323ddc750f43 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:25.633594 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-ee360768-1922-44a3-acdb-cc99158327b6 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:25.634824 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 213/439] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:52:25 2022] GET /identity/v3/projects/87ea432faccb40e590632800fcca178a => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:25.636879 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9439e09-4827-4b87-9c68-b065287ce653 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:25.637164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9439e09-4827-4b87-9c68-b065287ce653 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:25.637438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9439e09-4827-4b87-9c68-b065287ce653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:25.640167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ee360768-1922-44a3-acdb-cc99158327b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:25.656288 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d9439e09-4827-4b87-9c68-b065287ce653 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:25.657541 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d9439e09-4827-4b87-9c68-b065287ce653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:25.727604 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 227/440] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:52:25.728804 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee360768-1922-44a3-acdb-cc99158327b6 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:25.752130 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 214/441] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:25.755418 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9439e09-4827-4b87-9c68-b065287ce653 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:25.880559 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee360768-1922-44a3-acdb-cc99158327b6 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:25.895928 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9439e09-4827-4b87-9c68-b065287ce653 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:25.898012 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:25.925056 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:25.929241 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f94954-5067-4df8-9c5b-0e20fdea4be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:25.930199 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f94954-5067-4df8-9c5b-0e20fdea4be6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:25.931291 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f94954-5067-4df8-9c5b-0e20fdea4be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:25.931291 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f94954-5067-4df8-9c5b-0e20fdea4be6 None admin] PATH_INFO: `/v3/groups/d07a2f2021e44aa4b1fd33eab6a60898` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:25.933151 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f94954-5067-4df8-9c5b-0e20fdea4be6 None admin] RBAC: Authorizing `identity:get_group(group_id=d07a2f2021e44aa4b1fd33eab6a60898)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:25.934986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f94954-5067-4df8-9c5b-0e20fdea4be6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:25.936659 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 228/442] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 21:52:25 2022] GET /identity/v3/groups/d07a2f2021e44aa4b1fd33eab6a60898 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:25.937419 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f94954-5067-4df8-9c5b-0e20fdea4be6 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:25.938008 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2671f97-074c-405c-99a9-d75258ffda2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:25.938873 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2671f97-074c-405c-99a9-d75258ffda2e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:25.939146 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2671f97-074c-405c-99a9-d75258ffda2e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:25.939429 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2671f97-074c-405c-99a9-d75258ffda2e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:25.958215 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2671f97-074c-405c-99a9-d75258ffda2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:25.967186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-e2671f97-074c-405c-99a9-d75258ffda2e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:52:25.967186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:25.967186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:25.967186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:25.967186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:25.967186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:25.967186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:25.967186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:25.967186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:25.967186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:25.967186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:25.967186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:25.967186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:25.967186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:25.967186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:25.967186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:25.968144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:25.968144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:25.968144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:25.968144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:25.968144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:25.968144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:25.968144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:25.968144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:25.968144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:25.968144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:25.968144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:25.968144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:25.968144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:25.968144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:25.968144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:25.968144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:25.969054 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:25.969054 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:25.969054 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:25.969054 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:25.969054 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:25.969054 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:25.969054 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:25.969054 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:25.969054 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:25.969054 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:25.969054 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:52:25.969054 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:25.969054 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 215/443] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 21:52:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:52:25.969743 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2671f97-074c-405c-99a9-d75258ffda2e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:26.076197 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f94954-5067-4df8-9c5b-0e20fdea4be6 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:26.091488 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2671f97-074c-405c-99a9-d75258ffda2e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:26.118236 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1a0d9-f71c-4277-a64b-e1d03de67728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:26.119053 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1a0d9-f71c-4277-a64b-e1d03de67728 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:26.122079 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1a0d9-f71c-4277-a64b-e1d03de67728 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:26.122308 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1a0d9-f71c-4277-a64b-e1d03de67728 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:26.135228 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1a0d9-f71c-4277-a64b-e1d03de67728 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:26.144397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-39b1a0d9-f71c-4277-a64b-e1d03de67728 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:52:26.144397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:26.144397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:26.144397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:26.144397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:26.144397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:26.144397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:26.144397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:26.144397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:26.144397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:26.144397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:26.144397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:26.144397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:26.144397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:26.144397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:26.144397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:26.145527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:26.145527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:26.145527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:26.145527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:26.145527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:26.145527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:26.145527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:26.145527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:26.145527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:26.145527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:26.145527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:26.145527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:26.145527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:26.145527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:26.145527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:26.145527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:26.146945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:26.146945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:26.146945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:26.146945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:26.146945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:26.146945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:26.146945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:26.146945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:26.146945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:26.146945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:26.146945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:52:26.146945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:26.147907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345871d-e404-4345-a6c7-3dcd8c12520a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:26.147907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345871d-e404-4345-a6c7-3dcd8c12520a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:26.147907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345871d-e404-4345-a6c7-3dcd8c12520a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:26.147907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345871d-e404-4345-a6c7-3dcd8c12520a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:26.148361 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 229/444] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:52:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:26.149854 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345871d-e404-4345-a6c7-3dcd8c12520a None admin] RBAC: Adding query filter params (group.id=d07a2f2021e44aa4b1fd33eab6a60898, role.id=4749055b54a542b29f57155df3756136, scope.project.id=87ea432faccb40e590632800fcca178a) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:26.150214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1a0d9-f71c-4277-a64b-e1d03de67728 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:26.150543 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345871d-e404-4345-a6c7-3dcd8c12520a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:26.155188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345871d-e404-4345-a6c7-3dcd8c12520a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:26.163373 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 216/445] 10.222.0.35 () {56 vars in 1376 bytes} [Thu May 19 21:52:25 2022] GET /identity/v3/role_assignments?group.id=d07a2f2021e44aa4b1fd33eab6a60898&scope.project.id=87ea432faccb40e590632800fcca178a&role.id=4749055b54a542b29f57155df3756136 => generated 611 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:26.164557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345871d-e404-4345-a6c7-3dcd8c12520a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:26.214277 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:26.245388 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:26.305788 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1a0d9-f71c-4277-a64b-e1d03de67728 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:26.330857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345871d-e404-4345-a6c7-3dcd8c12520a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:26.351320 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08139e9-ccbc-43c4-bae8-9ee0691528a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:26.352009 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08139e9-ccbc-43c4-bae8-9ee0691528a7 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:26.352290 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08139e9-ccbc-43c4-bae8-9ee0691528a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:26.352598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08139e9-ccbc-43c4-bae8-9ee0691528a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:26.353368 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08139e9-ccbc-43c4-bae8-9ee0691528a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:26.354316 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08139e9-ccbc-43c4-bae8-9ee0691528a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:26.358733 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08139e9-ccbc-43c4-bae8-9ee0691528a7 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:26.368566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 230/446] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:52:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:26.373763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08139e9-ccbc-43c4-bae8-9ee0691528a7 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:26.385349 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7696b0-9ac3-4558-9d28-526d034d41f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:26.386750 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7696b0-9ac3-4558-9d28-526d034d41f1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:26.386750 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7696b0-9ac3-4558-9d28-526d034d41f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:26.386750 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7696b0-9ac3-4558-9d28-526d034d41f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:26.387282 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7696b0-9ac3-4558-9d28-526d034d41f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:26.387594 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7696b0-9ac3-4558-9d28-526d034d41f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:26.389025 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7696b0-9ac3-4558-9d28-526d034d41f1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:26.401566 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 217/447] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:52:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:26.408016 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7696b0-9ac3-4558-9d28-526d034d41f1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:26.507533 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08139e9-ccbc-43c4-bae8-9ee0691528a7 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:26.507770 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:26.536353 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7696b0-9ac3-4558-9d28-526d034d41f1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:26.546038 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:26.554202 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdde6f3-4933-414f-858a-9d193a4aa71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:26.555031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdde6f3-4933-414f-858a-9d193a4aa71f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:26.555320 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdde6f3-4933-414f-858a-9d193a4aa71f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:26.555896 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdde6f3-4933-414f-858a-9d193a4aa71f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:26.577430 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11d162-9a25-41ca-a9b5-2034f28fc235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:26.578087 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11d162-9a25-41ca-a9b5-2034f28fc235 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:26.578370 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11d162-9a25-41ca-a9b5-2034f28fc235 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:26.578643 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11d162-9a25-41ca-a9b5-2034f28fc235 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:26.635891 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdde6f3-4933-414f-858a-9d193a4aa71f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:26.637270 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdde6f3-4933-414f-858a-9d193a4aa71f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:26.653269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11d162-9a25-41ca-a9b5-2034f28fc235 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:26.654868 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11d162-9a25-41ca-a9b5-2034f28fc235 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:26.753116 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 231/448] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:52:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:52:26.758659 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdde6f3-4933-414f-858a-9d193a4aa71f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:26.761333 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:26.767871 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 218/449] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:52:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:52:26.773547 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11d162-9a25-41ca-a9b5-2034f28fc235 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:26.784848 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:26.879841 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11d162-9a25-41ca-a9b5-2034f28fc235 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:26.880062 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdde6f3-4933-414f-858a-9d193a4aa71f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:26.915972 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd985ac-e8bf-4fa4-809c-c5ee2fdd6d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:26.916822 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd985ac-e8bf-4fa4-809c-c5ee2fdd6d42 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:26.916925 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9c63b-0829-420a-8f8a-6ad84f09ab62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:26.917102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd985ac-e8bf-4fa4-809c-c5ee2fdd6d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:26.917373 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd985ac-e8bf-4fa4-809c-c5ee2fdd6d42 None admin] PATH_INFO: `/v3/projects/87ea432faccb40e590632800fcca178a` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:26.917731 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9c63b-0829-420a-8f8a-6ad84f09ab62 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:26.918018 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9c63b-0829-420a-8f8a-6ad84f09ab62 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:26.918295 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9c63b-0829-420a-8f8a-6ad84f09ab62 None admin] PATH_INFO: `/v3/projects/64ecee0211ba477d8f867eb1b5f77c2e` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:26.918569 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd985ac-e8bf-4fa4-809c-c5ee2fdd6d42 None admin] RBAC: Authorizing `identity:get_project(project_id=87ea432faccb40e590632800fcca178a)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:26.919479 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9c63b-0829-420a-8f8a-6ad84f09ab62 None admin] RBAC: Authorizing `identity:get_project(project_id=64ecee0211ba477d8f867eb1b5f77c2e)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:26.920007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd985ac-e8bf-4fa4-809c-c5ee2fdd6d42 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:26.920953 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9c63b-0829-420a-8f8a-6ad84f09ab62 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:26.921731 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 232/450] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:52:26 2022] GET /identity/v3/projects/87ea432faccb40e590632800fcca178a => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:52:26.922815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 219/451] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:52:26 2022] GET /identity/v3/projects/64ecee0211ba477d8f867eb1b5f77c2e => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:52:26.927101 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd985ac-e8bf-4fa4-809c-c5ee2fdd6d42 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:26.927796 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9c63b-0829-420a-8f8a-6ad84f09ab62 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:27.007495 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:27.008276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:27.033176 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9c63b-0829-420a-8f8a-6ad84f09ab62 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:27.042369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd985ac-e8bf-4fa4-809c-c5ee2fdd6d42 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:27.067047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ba24a-e6f9-4adf-9f36-2554e5849609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:27.067894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ba24a-e6f9-4adf-9f36-2554e5849609 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:27.068179 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ba24a-e6f9-4adf-9f36-2554e5849609 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:27.068478 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ba24a-e6f9-4adf-9f36-2554e5849609 None admin] PATH_INFO: `/v3/groups/e46ab79c89484fcca57bfc9d9548be28` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:27.069647 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ba24a-e6f9-4adf-9f36-2554e5849609 None admin] RBAC: Authorizing `identity:get_group(group_id=e46ab79c89484fcca57bfc9d9548be28)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:27.071071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ba24a-e6f9-4adf-9f36-2554e5849609 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:27.073206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 220/452] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 21:52:26 2022] GET /identity/v3/groups/e46ab79c89484fcca57bfc9d9548be28 => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:52:27.077039 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ebbc9-6898-4b26-8746-9c05a5cc6715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:27.077903 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ebbc9-6898-4b26-8746-9c05a5cc6715 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:27.078187 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ebbc9-6898-4b26-8746-9c05a5cc6715 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:27.078461 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ebbc9-6898-4b26-8746-9c05a5cc6715 None admin] PATH_INFO: `/v3/groups/d07a2f2021e44aa4b1fd33eab6a60898` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:27.078872 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ba24a-e6f9-4adf-9f36-2554e5849609 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:27.079662 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ebbc9-6898-4b26-8746-9c05a5cc6715 None admin] RBAC: Authorizing `identity:get_group(group_id=d07a2f2021e44aa4b1fd33eab6a60898)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:27.081131 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ebbc9-6898-4b26-8746-9c05a5cc6715 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:27.082836 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 233/453] 10.222.0.35 () {56 vars in 1180 bytes} [Thu May 19 21:52:26 2022] GET /identity/v3/groups/d07a2f2021e44aa4b1fd33eab6a60898 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:27.092042 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ebbc9-6898-4b26-8746-9c05a5cc6715 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:27.181366 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ba24a-e6f9-4adf-9f36-2554e5849609 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:27.194335 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ebbc9-6898-4b26-8746-9c05a5cc6715 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:27.225614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a511cdf-ff55-4536-967f-e3dce30c568a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:27.226272 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a511cdf-ff55-4536-967f-e3dce30c568a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:27.226560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a511cdf-ff55-4536-967f-e3dce30c568a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:27.226840 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a511cdf-ff55-4536-967f-e3dce30c568a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:27.227664 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a511cdf-ff55-4536-967f-e3dce30c568a None admin] RBAC: Adding query filter params (group.id=e46ab79c89484fcca57bfc9d9548be28, role.id=04369f3c13174671a298fcd8175998d8, scope.project.id=64ecee0211ba477d8f867eb1b5f77c2e) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:27.227978 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a511cdf-ff55-4536-967f-e3dce30c568a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:27.229712 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a511cdf-ff55-4536-967f-e3dce30c568a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:27.229940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e66be-d8ec-4735-87ed-e269410657d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:27.230593 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e66be-d8ec-4735-87ed-e269410657d9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:27.230872 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e66be-d8ec-4735-87ed-e269410657d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:27.231144 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e66be-d8ec-4735-87ed-e269410657d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:27.231970 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e66be-d8ec-4735-87ed-e269410657d9 None admin] RBAC: Adding query filter params (group.id=d07a2f2021e44aa4b1fd33eab6a60898, role.id=3fb2a96d6ee74a7dbd046488f5ec322b, scope.project.id=87ea432faccb40e590632800fcca178a) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:27.232334 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e66be-d8ec-4735-87ed-e269410657d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:27.233819 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e66be-d8ec-4735-87ed-e269410657d9 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:27.235790 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 221/454] 10.222.0.35 () {56 vars in 1376 bytes} [Thu May 19 21:52:27 2022] GET /identity/v3/role_assignments?group.id=e46ab79c89484fcca57bfc9d9548be28&scope.project.id=64ecee0211ba477d8f867eb1b5f77c2e&role.id=04369f3c13174671a298fcd8175998d8 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:27.240348 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 234/455] 10.222.0.35 () {56 vars in 1376 bytes} [Thu May 19 21:52:27 2022] GET /identity/v3/role_assignments?group.id=d07a2f2021e44aa4b1fd33eab6a60898&scope.project.id=87ea432faccb40e590632800fcca178a&role.id=3fb2a96d6ee74a7dbd046488f5ec322b => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:30.232471 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea81ae-b94a-4fd4-b6e4-6e0b3d7adabc None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:30.232989 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea81ae-b94a-4fd4-b6e4-6e0b3d7adabc None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:30.233063 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea81ae-b94a-4fd4-b6e4-6e0b3d7adabc None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:30.234912 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 222/456] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:30.240202 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87f18d-98d4-4379-85a3-bc1f53e65c67 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:30.240663 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87f18d-98d4-4379-85a3-bc1f53e65c67 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:30.240841 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87f18d-98d4-4379-85a3-bc1f53e65c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:30.247790 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:30.269602 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1f87f18d-98d4-4379-85a3-bc1f53e65c67 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:30.270862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1f87f18d-98d4-4379-85a3-bc1f53e65c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:30.394559 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bc475-b8fe-4d11-97f0-e71ed7e59344 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:30.395189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bc475-b8fe-4d11-97f0-e71ed7e59344 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:30.395436 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 235/457] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:30.396071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bc475-b8fe-4d11-97f0-e71ed7e59344 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:30.399183 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 223/458] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:30.404748 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73e938-6a70-443f-bc3e-f06e2498e9ef None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:30.405042 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73e938-6a70-443f-bc3e-f06e2498e9ef None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:30.405326 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73e938-6a70-443f-bc3e-f06e2498e9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:30.421548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bc475-b8fe-4d11-97f0-e71ed7e59344 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:30.435088 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:30.441565 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-df73e938-6a70-443f-bc3e-f06e2498e9ef None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:30.442803 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-df73e938-6a70-443f-bc3e-f06e2498e9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:30.563430 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 236/459] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:30.586196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bc475-b8fe-4d11-97f0-e71ed7e59344 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:30.588592 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b59a4-6bb3-4fa3-bf0a-da138b8993d5 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:30.589331 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b59a4-6bb3-4fa3-bf0a-da138b8993d5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:30.589801 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b59a4-6bb3-4fa3-bf0a-da138b8993d5 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:30.591631 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 237/460] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:30.597229 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ed561-be60-4a96-abfe-03b6ebb9af1c None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:30.597745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ed561-be60-4a96-abfe-03b6ebb9af1c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:30.598169 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ed561-be60-4a96-abfe-03b6ebb9af1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:30.618625 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-da7ed561-be60-4a96-abfe-03b6ebb9af1c None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:30.620840 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-da7ed561-be60-4a96-abfe-03b6ebb9af1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:30.634196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c9226-3ee8-4786-8044-2c5f350667e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:30.635093 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c9226-3ee8-4786-8044-2c5f350667e0 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:30.635527 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c9226-3ee8-4786-8044-2c5f350667e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:30.635970 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c9226-3ee8-4786-8044-2c5f350667e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:30.647254 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c9226-3ee8-4786-8044-2c5f350667e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:30.648970 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c9226-3ee8-4786-8044-2c5f350667e0 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:30.668496 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-e35c9226-3ee8-4786-8044-2c5f350667e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:30.668496 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:30.668496 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:30.668496 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:30.668496 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:30.668496 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:30.668496 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:30.668496 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:30.668496 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:30.668496 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:30.668496 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:30.668496 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:30.668496 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:30.668496 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:30.668496 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:30.669405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:30.669405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:30.669405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:30.669405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:30.669405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:30.669405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:30.669405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:30.669405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:30.669405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:30.669405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:30.669405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:30.669405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:30.669405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:30.669405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:30.669405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:30.669405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:30.669405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:30.670226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:30.670226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:30.670226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:30.670226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:30.672344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 224/461] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:30.673369 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c9226-3ee8-4786-8044-2c5f350667e0 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:30.696028 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:30.711435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 238/462] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:30.712604 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ed561-be60-4a96-abfe-03b6ebb9af1c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:30.769951 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:30.825999 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c9226-3ee8-4786-8044-2c5f350667e0 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:30.866712 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c132302-1007-4e5a-8d5d-db0409c5e3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:30.867961 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c132302-1007-4e5a-8d5d-db0409c5e3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:30.868505 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c132302-1007-4e5a-8d5d-db0409c5e3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:30.868992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c132302-1007-4e5a-8d5d-db0409c5e3b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:30.877380 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ed561-be60-4a96-abfe-03b6ebb9af1c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:30.886541 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c132302-1007-4e5a-8d5d-db0409c5e3b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:30.888561 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c132302-1007-4e5a-8d5d-db0409c5e3b4 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:30.909010 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-5c132302-1007-4e5a-8d5d-db0409c5e3b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:30.909010 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:30.909010 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:30.909010 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:30.909010 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:30.909010 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:30.909010 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:30.909010 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:30.909010 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:30.909010 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:30.909010 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:30.909010 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:30.909010 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:30.909010 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:30.909010 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:30.909881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:30.909881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:30.909881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:30.909881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:30.909881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:30.909881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:30.909881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:30.909881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:30.909881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:30.909881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:30.909881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:30.909881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:30.909881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:30.909881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:30.909881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:30.909881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:30.909881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:30.910703 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:30.910703 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:30.910703 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:30.910703 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:30.916531 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 225/463] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:30.917944 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c132302-1007-4e5a-8d5d-db0409c5e3b4 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:30.926103 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44a76d-5830-4acd-8b12-097ad8edd0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:30.926781 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44a76d-5830-4acd-8b12-097ad8edd0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:30.927065 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44a76d-5830-4acd-8b12-097ad8edd0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:30.927343 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44a76d-5830-4acd-8b12-097ad8edd0f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:30.928083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44a76d-5830-4acd-8b12-097ad8edd0f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:30.928391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44a76d-5830-4acd-8b12-097ad8edd0f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:30.929800 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44a76d-5830-4acd-8b12-097ad8edd0f9 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:30.944124 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 239/464] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:30.945024 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44a76d-5830-4acd-8b12-097ad8edd0f9 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:31.011711 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:31.055603 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c132302-1007-4e5a-8d5d-db0409c5e3b4 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:31.066170 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44a76d-5830-4acd-8b12-097ad8edd0f9 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:31.071487 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:31.095820 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711676c-41d8-45ce-a87d-1f0803b81db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:31.096600 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711676c-41d8-45ce-a87d-1f0803b81db2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:31.096890 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711676c-41d8-45ce-a87d-1f0803b81db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:31.097170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711676c-41d8-45ce-a87d-1f0803b81db2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:31.104306 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197cb06-75f3-48d9-aa06-576ba37796fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:31.105010 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197cb06-75f3-48d9-aa06-576ba37796fa None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:31.105296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197cb06-75f3-48d9-aa06-576ba37796fa None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:31.105577 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197cb06-75f3-48d9-aa06-576ba37796fa None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:31.106307 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197cb06-75f3-48d9-aa06-576ba37796fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:31.106612 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197cb06-75f3-48d9-aa06-576ba37796fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:31.107986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197cb06-75f3-48d9-aa06-576ba37796fa None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:31.109495 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f711676c-41d8-45ce-a87d-1f0803b81db2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:31.110930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f711676c-41d8-45ce-a87d-1f0803b81db2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:31.124597 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 240/465] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:31.124597 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197cb06-75f3-48d9-aa06-576ba37796fa None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:31.133514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-f711676c-41d8-45ce-a87d-1f0803b81db2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:31.133514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:31.133514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:31.133514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:31.133514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:31.133514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:31.133514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:31.133514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:31.133514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:31.133514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:31.133514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:31.133514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:31.133514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:31.133514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:31.133514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:31.134393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:31.134393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:31.134393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:31.134393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:31.134393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:31.134393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:31.134393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:31.134393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:31.134393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:31.134393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:31.134393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:31.134393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:31.134393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:31.134393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:31.134393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:31.134393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:31.134393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:31.135552 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:31.135552 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:31.135552 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:31.135552 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:31.135552 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 226/466] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:31.136457 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f340e-2916-451a-a264-33fea698c6cd None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:31.136555 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f340e-2916-451a-a264-33fea698c6cd None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:31.137070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f340e-2916-451a-a264-33fea698c6cd None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:31.142236 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 227/467] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:31.142236 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f340e-2916-451a-a264-33fea698c6cd None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:31.242556 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197cb06-75f3-48d9-aa06-576ba37796fa None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:31.258258 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:31.266550 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f340e-2916-451a-a264-33fea698c6cd None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:31.284093 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5fd21-8a64-47fd-8b9e-99270d4aa624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:31.284885 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5fd21-8a64-47fd-8b9e-99270d4aa624 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:31.285173 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5fd21-8a64-47fd-8b9e-99270d4aa624 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:31.285669 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5fd21-8a64-47fd-8b9e-99270d4aa624 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:31.286357 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5fd21-8a64-47fd-8b9e-99270d4aa624 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:31.287836 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5fd21-8a64-47fd-8b9e-99270d4aa624 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:31.305877 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f4d22-d5ff-4e2f-8540-ee8163854bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:31.306716 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f4d22-d5ff-4e2f-8540-ee8163854bbb None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:31.307171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f4d22-d5ff-4e2f-8540-ee8163854bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:31.307460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f4d22-d5ff-4e2f-8540-ee8163854bbb None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:31.308296 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f4d22-d5ff-4e2f-8540-ee8163854bbb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:31.309874 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f4d22-d5ff-4e2f-8540-ee8163854bbb None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:31.324779 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 241/468] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 21:52:31 2022] POST /identity/v3/users => generated 246 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:52:31.325790 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5fd21-8a64-47fd-8b9e-99270d4aa624 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:31.343477 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 228/469] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 21:52:31 2022] POST /identity/v3/users => generated 248 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:52:31.344815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3ebfb-0580-49c3-a7cd-28de138b45a5 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:31.345160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3ebfb-0580-49c3-a7cd-28de138b45a5 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:31.345441 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3ebfb-0580-49c3-a7cd-28de138b45a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:31.376830 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-49f3ebfb-0580-49c3-a7cd-28de138b45a5 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:31.379427 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-49f3ebfb-0580-49c3-a7cd-28de138b45a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:31.421061 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:31.536692 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5fd21-8a64-47fd-8b9e-99270d4aa624 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:31.577547 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 229/470] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:31.581667 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f253374-3eea-4a38-b528-428f3dcda7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:31.583768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f253374-3eea-4a38-b528-428f3dcda7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:31.583768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f253374-3eea-4a38-b528-428f3dcda7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:31.583768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f253374-3eea-4a38-b528-428f3dcda7e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:31.583768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f253374-3eea-4a38-b528-428f3dcda7e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:31.584124 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f253374-3eea-4a38-b528-428f3dcda7e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:31.586344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f253374-3eea-4a38-b528-428f3dcda7e2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:31.598593 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 242/471] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:31.604491 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3ebfb-0580-49c3-a7cd-28de138b45a5 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:31.607691 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f253374-3eea-4a38-b528-428f3dcda7e2 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:31.645059 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:31.736967 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3ebfb-0580-49c3-a7cd-28de138b45a5 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:31.762508 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f253374-3eea-4a38-b528-428f3dcda7e2 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:31.804975 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5ec1d-5526-44fc-8155-2e00933ac03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:31.805652 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5ec1d-5526-44fc-8155-2e00933ac03c None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:31.805935 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5ec1d-5526-44fc-8155-2e00933ac03c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:31.806206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5ec1d-5526-44fc-8155-2e00933ac03c None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:31.807684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5ec1d-5526-44fc-8155-2e00933ac03c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:31.809154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5ec1d-5526-44fc-8155-2e00933ac03c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:31.835207 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5963fb-86fe-4063-bccb-e048ef479fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:31.836239 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5963fb-86fe-4063-bccb-e048ef479fbe None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:31.836634 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5963fb-86fe-4063-bccb-e048ef479fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:31.836843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5963fb-86fe-4063-bccb-e048ef479fbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:31.844960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 230/472] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 21:52:31 2022] POST /identity/v3/users => generated 248 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:52:31.859463 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5963fb-86fe-4063-bccb-e048ef479fbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:31.861057 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5963fb-86fe-4063-bccb-e048ef479fbe None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:31.897739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-bf5963fb-86fe-4063-bccb-e048ef479fbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:31.897739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:31.897739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:31.897739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:31.897739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:31.897739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:31.897739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:31.897739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:31.897739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:31.897739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:31.897739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:31.897739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:31.897739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:31.897739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:31.897739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:31.898844 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:31.898844 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:31.898844 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:31.898844 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:31.898844 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:31.898844 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:31.898844 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:31.898844 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:31.898844 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:31.898844 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:31.898844 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:31.898844 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:31.898844 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:31.898844 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:31.898844 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:31.898844 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:31.898844 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:31.899865 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:31.899865 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:31.899865 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:31.899865 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:31.899865 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 243/473] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:31.906667 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5ec1d-5526-44fc-8155-2e00933ac03c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:31.924899 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:31.961786 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7885f5-a9f3-4b5c-8024-d337f96aa2d0 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:31.962066 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7885f5-a9f3-4b5c-8024-d337f96aa2d0 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:31.962346 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7885f5-a9f3-4b5c-8024-d337f96aa2d0 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:31.965678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 244/474] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:31.973970 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8696165-b094-42c7-85da-03cc5518fb39 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:31.974300 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8696165-b094-42c7-85da-03cc5518fb39 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:31.974537 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8696165-b094-42c7-85da-03cc5518fb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:32.009586 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-d8696165-b094-42c7-85da-03cc5518fb39 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:32.011359 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d8696165-b094-42c7-85da-03cc5518fb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:32.044965 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5ec1d-5526-44fc-8155-2e00933ac03c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:32.084701 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f240ce-921e-4c65-a409-be1491e8fedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:32.084701 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f240ce-921e-4c65-a409-be1491e8fedd None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:32.084701 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f240ce-921e-4c65-a409-be1491e8fedd None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:32.084701 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f240ce-921e-4c65-a409-be1491e8fedd None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:32.085112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f240ce-921e-4c65-a409-be1491e8fedd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:32.085112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f240ce-921e-4c65-a409-be1491e8fedd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:32.085920 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f240ce-921e-4c65-a409-be1491e8fedd None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:32.100835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 231/475] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:32.106442 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f240ce-921e-4c65-a409-be1491e8fedd None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:32.159452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 245/476] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:32.185172 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8696165-b094-42c7-85da-03cc5518fb39 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:32.201056 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:32.221544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:32.269750 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f240ce-921e-4c65-a409-be1491e8fedd None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:32.318261 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8696165-b094-42c7-85da-03cc5518fb39 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:32.319330 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e0ffd-29bc-4c4f-9c73-6d885edfe39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:32.320014 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e0ffd-29bc-4c4f-9c73-6d885edfe39e None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:32.320299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e0ffd-29bc-4c4f-9c73-6d885edfe39e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:32.320607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e0ffd-29bc-4c4f-9c73-6d885edfe39e None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:32.321464 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e0ffd-29bc-4c4f-9c73-6d885edfe39e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:32.324023 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e0ffd-29bc-4c4f-9c73-6d885edfe39e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:32.351610 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 232/477] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 21:52:32 2022] POST /identity/v3/users => generated 249 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:52:32.372357 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bb543-2959-4a72-971d-4960a735132b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:32.373135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bb543-2959-4a72-971d-4960a735132b None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:32.373421 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bb543-2959-4a72-971d-4960a735132b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:32.373751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bb543-2959-4a72-971d-4960a735132b None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:32.374525 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747bb543-2959-4a72-971d-4960a735132b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:32.375961 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747bb543-2959-4a72-971d-4960a735132b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:32.386305 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.sql.core [None req-747bb543-2959-4a72-971d-4960a735132b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 21:52:32.386305 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 21:52:32.386305 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [parameters: {'id': '193796e107d64852a46b9ae4de034fe9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 21:52:32.386305 dv-cinder-842237-1-smb devstack@keystone.service[80210]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80210) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 21:52:32.405201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-747bb543-2959-4a72-971d-4960a735132b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 21:52:32.405201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:32.405201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 21:52:32.405201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 21:52:32.405201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 21:52:32.405201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 21:52:32.405201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 21:52:32.405201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application result = self._query(query) May 19 21:52:32.405201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 21:52:32.405201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application conn.query(q) May 19 21:52:32.405201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 21:52:32.405201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 21:52:32.405201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 21:52:32.405201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application result.read() May 19 21:52:32.405201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 21:52:32.406148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 21:52:32.406148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 21:52:32.406148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 21:52:32.406148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 21:52:32.406148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 21:52:32.406148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 21:52:32.406148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 21:52:32.406148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 21:52:32.406148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:32.406148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 21:52:32.406148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:32.406148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:32.406148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 21:52:32.406148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 21:52:32.406148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 19 21:52:32.406148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return ref.to_dict() May 19 21:52:32.406148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 21:52:32.406148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application next(self.gen) May 19 21:52:32.407023 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 21:52:32.407023 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application yield resource May 19 21:52:32.407023 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 21:52:32.407023 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application next(self.gen) May 19 21:52:32.407023 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 21:52:32.407023 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self.session.rollback() May 19 21:52:32.407023 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 21:52:32.407023 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self.force_reraise() May 19 21:52:32.407023 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 21:52:32.407023 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise self.value May 19 21:52:32.407023 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 21:52:32.407023 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 21:52:32.407023 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 21:52:32.407023 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application session.commit() May 19 21:52:32.407023 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 21:52:32.407023 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 21:52:32.407023 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 21:52:32.407843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._prepare_impl() May 19 21:52:32.407843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 21:52:32.407843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self.session.flush() May 19 21:52:32.407843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 21:52:32.407843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._flush(objects) May 19 21:52:32.407843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 21:52:32.407843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 21:52:32.407843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 21:52:32.407843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application compat.raise_( May 19 21:52:32.407843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 21:52:32.407843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception May 19 21:52:32.407843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 21:52:32.407843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application flush_context.execute() May 19 21:52:32.407843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 21:52:32.407843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rec.execute(self) May 19 21:52:32.407843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 21:52:32.407843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 21:52:32.410040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 21:52:32.410040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 21:52:32.410040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 21:52:32.410040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 21:52:32.410040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 21:52:32.410040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 21:52:32.410040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 21:52:32.410040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 21:52:32.410040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 21:52:32.410040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 21:52:32.410040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 21:52:32.410040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 21:52:32.410040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 21:52:32.410040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 21:52:32.410040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 21:52:32.410040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception May 19 21:52:32.411547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 21:52:32.411547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 21:52:32.411547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 21:52:32.411547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 21:52:32.411547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 21:52:32.411547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application result = self._query(query) May 19 21:52:32.411547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 21:52:32.411547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application conn.query(q) May 19 21:52:32.411547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 21:52:32.411547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 21:52:32.411547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 21:52:32.411547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application result.read() May 19 21:52:32.411547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 21:52:32.411547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 21:52:32.411547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 21:52:32.411547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 21:52:32.412566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 21:52:32.412566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 21:52:32.412566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 21:52:32.412566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 21:52:32.412566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 21:52:32.412566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 21:52:32.412566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [parameters: {'id': '193796e107d64852a46b9ae4de034fe9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 21:52:32.412566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 21:52:32.412566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:32.412566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:52:32.412566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:32.412566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:32.412566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:32.412566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:32.412566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:32.412566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:32.413621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:32.413621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:32.413621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:32.413621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:32.413621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:32.413621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:32.413621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 19 21:52:32.413621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 19 21:52:32.413621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:32.413621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:32.413621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 19 21:52:32.413621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 19 21:52:32.413621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 21:52:32.413621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 21:52:32.413621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 21:52:32.413621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:32.414648 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 246/478] 10.222.0.35 () {60 vars in 1131 bytes} [Thu May 19 21:52:32 2022] POST /identity/v3/roles => generated 144 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:32.421414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e0ffd-29bc-4c4f-9c73-6d885edfe39e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:32.552380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e0ffd-29bc-4c4f-9c73-6d885edfe39e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:32.578598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:32.594916 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8af6c-3656-4a7e-a5db-5f0824d8fb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:32.596019 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8af6c-3656-4a7e-a5db-5f0824d8fb12 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:32.596473 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8af6c-3656-4a7e-a5db-5f0824d8fb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:32.596911 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8af6c-3656-4a7e-a5db-5f0824d8fb12 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:32.610767 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8af6c-3656-4a7e-a5db-5f0824d8fb12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:32.620336 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-96b8af6c-3656-4a7e-a5db-5f0824d8fb12 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:52:32.620336 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:32.620336 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:32.620336 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:32.620336 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:32.620336 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:32.620336 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:32.620336 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:32.620336 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:32.620336 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:32.620336 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:32.620336 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:32.620336 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:32.620336 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:32.620336 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:32.620336 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:32.621655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:32.621655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:32.621655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:32.621655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:32.621655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:32.621655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:32.621655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:32.621655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:32.621655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:32.621655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:32.621655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:32.621655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:32.621655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:32.621655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:32.621655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:32.621655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:32.622595 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:32.622595 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:32.622595 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:32.622595 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:32.622595 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:32.622595 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:32.622595 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:32.622595 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:32.622595 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:32.622595 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:32.622595 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 21:52:32.622595 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:32.625020 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 233/479] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 21:52:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:32.630758 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bb543-2959-4a72-971d-4960a735132b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:32.719886 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:32.754028 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bb543-2959-4a72-971d-4960a735132b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:32.793610 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ae874-dffd-4fa4-b941-50f7fb8c7d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:32.794420 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ae874-dffd-4fa4-b941-50f7fb8c7d75 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:32.794768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ae874-dffd-4fa4-b941-50f7fb8c7d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:32.795110 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ae874-dffd-4fa4-b941-50f7fb8c7d75 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:32.795935 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ae874-dffd-4fa4-b941-50f7fb8c7d75 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:32.796307 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ae874-dffd-4fa4-b941-50f7fb8c7d75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:32.797773 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ae874-dffd-4fa4-b941-50f7fb8c7d75 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:32.808230 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 247/480] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:52:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:34.149878 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ea6cb-53fa-4cbe-a3d3-75ebe0ad044b None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:34.151059 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ea6cb-53fa-4cbe-a3d3-75ebe0ad044b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:34.151556 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ea6cb-53fa-4cbe-a3d3-75ebe0ad044b None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:34.153685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 234/481] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:34.178561 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc669fb-28a5-4ca0-a959-45bacfba5cac None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:34.179508 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc669fb-28a5-4ca0-a959-45bacfba5cac None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:34.179984 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc669fb-28a5-4ca0-a959-45bacfba5cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:34.200674 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3bc669fb-28a5-4ca0-a959-45bacfba5cac None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:34.202234 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3bc669fb-28a5-4ca0-a959-45bacfba5cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:34.275411 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 248/482] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:34.311578 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ea6cb-53fa-4cbe-a3d3-75ebe0ad044b None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:34.457033 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ea6cb-53fa-4cbe-a3d3-75ebe0ad044b None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:34.492970 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60448eb-e3b8-453f-80ee-ee2fec724535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:34.493781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60448eb-e3b8-453f-80ee-ee2fec724535 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:34.494234 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60448eb-e3b8-453f-80ee-ee2fec724535 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:34.494677 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60448eb-e3b8-453f-80ee-ee2fec724535 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:34.505466 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60448eb-e3b8-453f-80ee-ee2fec724535 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:34.514161 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-a60448eb-e3b8-453f-80ee-ee2fec724535 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:34.514161 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:34.514161 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:34.514161 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:34.514161 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:34.514161 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:34.514161 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:34.514161 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:34.514161 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:34.514161 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:34.514161 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:34.514161 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:34.514161 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:34.514161 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:34.514161 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:34.514161 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:34.515044 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:34.515044 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:34.515044 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:34.515044 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:34.515044 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:34.515044 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:34.515044 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:34.515044 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:34.515044 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:34.515044 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:34.515044 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:34.515044 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:34.515044 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:34.515044 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:34.515044 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:34.515044 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:34.516235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:34.516235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:34.516235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:34.516235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:34.516235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:34.516235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:34.516235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:34.516235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:34.516235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:34.516235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:34.516235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:34.516235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:34.516235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 235/483] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 21:52:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:34.523078 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc669fb-28a5-4ca0-a959-45bacfba5cac None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:34.608092 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba9adc-8279-4d33-a584-86dc560640f2 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:34.608422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba9adc-8279-4d33-a584-86dc560640f2 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:34.608707 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba9adc-8279-4d33-a584-86dc560640f2 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:34.610297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 236/484] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:34.615588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4797d0-aac4-4c3b-8d98-dbb522e266a9 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:34.615870 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4797d0-aac4-4c3b-8d98-dbb522e266a9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:34.616142 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4797d0-aac4-4c3b-8d98-dbb522e266a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:34.630729 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:34.633784 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-dc4797d0-aac4-4c3b-8d98-dbb522e266a9 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:34.635827 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-dc4797d0-aac4-4c3b-8d98-dbb522e266a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:34.685993 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:34.720096 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc669fb-28a5-4ca0-a959-45bacfba5cac None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:34.756848 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 237/485] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:52:34.779773 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b639f-781a-49a8-b5a7-06b333f24ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:34.780481 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b639f-781a-49a8-b5a7-06b333f24ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:34.780767 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b639f-781a-49a8-b5a7-06b333f24ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:34.781040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b639f-781a-49a8-b5a7-06b333f24ef3 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:34.781800 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b639f-781a-49a8-b5a7-06b333f24ef3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:34.782104 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b639f-781a-49a8-b5a7-06b333f24ef3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:34.783479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b639f-781a-49a8-b5a7-06b333f24ef3 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:34.791697 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4797d0-aac4-4c3b-8d98-dbb522e266a9 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:34.804768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 249/486] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 21:52:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:34.808164 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b639f-781a-49a8-b5a7-06b333f24ef3 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:34.942598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4797d0-aac4-4c3b-8d98-dbb522e266a9 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:34.976562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b639f-781a-49a8-b5a7-06b333f24ef3 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:34.981360 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d8a0e-51a0-4a3f-b51c-2c19e111f828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:34.982466 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d8a0e-51a0-4a3f-b51c-2c19e111f828 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:34.982948 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d8a0e-51a0-4a3f-b51c-2c19e111f828 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:34.983443 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d8a0e-51a0-4a3f-b51c-2c19e111f828 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:34.995829 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d8a0e-51a0-4a3f-b51c-2c19e111f828 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:35.004137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-2d3d8a0e-51a0-4a3f-b51c-2c19e111f828 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:35.004137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:35.004137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:35.004137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:35.004137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:35.004137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:35.004137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:35.004137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:35.004137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:35.004137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:35.004137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:35.004137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:35.004137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:35.004137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:35.004137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:35.004137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:35.005103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:35.005103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:35.005103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:35.005103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:35.005103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:35.005103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:35.005103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:35.005103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:35.005103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:35.005103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:35.005103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:35.005103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:35.005103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:35.005103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:35.005103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:35.005103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:35.005870 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:35.005870 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:35.005870 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:35.005870 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:35.005870 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:35.005870 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:35.005870 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:35.005870 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:35.005870 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:35.005870 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:35.005870 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:35.005870 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:35.008768 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 238/487] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 21:52:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:52:35.011391 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7717f76-5833-4e28-a40e-fb1c70a36b18 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:35.011940 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7717f76-5833-4e28-a40e-fb1c70a36b18 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:35.012381 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7717f76-5833-4e28-a40e-fb1c70a36b18 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:35.014208 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 239/488] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:35.015167 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7717f76-5833-4e28-a40e-fb1c70a36b18 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:35.017633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:35.030409 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8ffbe-4e1f-41df-ac1c-6220f13e9150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:35.031344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8ffbe-4e1f-41df-ac1c-6220f13e9150 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:35.032079 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8ffbe-4e1f-41df-ac1c-6220f13e9150 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:35.032372 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8ffbe-4e1f-41df-ac1c-6220f13e9150 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:35.047910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a8ffbe-4e1f-41df-ac1c-6220f13e9150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:35.050422 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a8ffbe-4e1f-41df-ac1c-6220f13e9150 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:35.051247 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:35.074366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-21a8ffbe-4e1f-41df-ac1c-6220f13e9150 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:35.074366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:35.074366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:35.074366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:35.074366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:35.074366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:35.074366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:35.074366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:35.074366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:35.074366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:35.074366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:35.074366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:35.074366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:35.074366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:35.074366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:35.075371 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:35.075371 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:35.075371 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:35.075371 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:35.075371 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:35.075371 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:35.075371 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:35.075371 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:35.075371 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:35.075371 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:35.075371 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:35.075371 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:35.075371 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:35.075371 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:35.075371 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:35.075371 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:35.075371 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:35.076479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:35.076479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:35.076479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:35.076479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:35.076479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 250/489] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:35.077715 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd09b0-17f9-4765-b22a-4ef3d2900a5a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:35.078072 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd09b0-17f9-4765-b22a-4ef3d2900a5a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:35.078420 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd09b0-17f9-4765-b22a-4ef3d2900a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:35.097883 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-51dd09b0-17f9-4765-b22a-4ef3d2900a5a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:35.099296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-51dd09b0-17f9-4765-b22a-4ef3d2900a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:35.133949 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7717f76-5833-4e28-a40e-fb1c70a36b18 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:35.171904 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d5f690-a18b-4c56-abd8-218c76523882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:35.173358 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5f690-a18b-4c56-abd8-218c76523882 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:35.173846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5f690-a18b-4c56-abd8-218c76523882 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:35.174317 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5f690-a18b-4c56-abd8-218c76523882 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:35.175307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d5f690-a18b-4c56-abd8-218c76523882 None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:35.175882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d5f690-a18b-4c56-abd8-218c76523882 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:35.177566 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d5f690-a18b-4c56-abd8-218c76523882 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:35.183689 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 251/490] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:35.184647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd09b0-17f9-4765-b22a-4ef3d2900a5a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:35.187868 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 240/491] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 21:52:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:35.193811 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d5f690-a18b-4c56-abd8-218c76523882 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:35.312724 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:35.314440 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd09b0-17f9-4765-b22a-4ef3d2900a5a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:35.321633 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d5f690-a18b-4c56-abd8-218c76523882 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:35.334231 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:35.364015 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38f557-45ba-42ce-856e-9a6c89455e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:35.365471 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38f557-45ba-42ce-856e-9a6c89455e23 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:35.365959 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38f557-45ba-42ce-856e-9a6c89455e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:35.366434 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38f557-45ba-42ce-856e-9a6c89455e23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:35.375586 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443d598-46e5-451b-81ce-f4d40c78c225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:35.376282 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443d598-46e5-451b-81ce-f4d40c78c225 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:35.376601 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443d598-46e5-451b-81ce-f4d40c78c225 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:35.376881 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443d598-46e5-451b-81ce-f4d40c78c225 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:35.377629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2443d598-46e5-451b-81ce-f4d40c78c225 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:35.377937 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2443d598-46e5-451b-81ce-f4d40c78c225 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:35.379592 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2443d598-46e5-451b-81ce-f4d40c78c225 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:35.383896 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38f557-45ba-42ce-856e-9a6c89455e23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:35.386569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38f557-45ba-42ce-856e-9a6c89455e23 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:35.394287 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 252/492] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:35.395160 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443d598-46e5-451b-81ce-f4d40c78c225 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:35.405894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-8c38f557-45ba-42ce-856e-9a6c89455e23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:35.405894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:35.405894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:35.405894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:35.405894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:35.405894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:35.405894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:35.405894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:35.405894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:35.405894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:35.405894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:35.405894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:35.405894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:35.405894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:35.405894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:35.406739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:35.406739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:35.406739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:35.406739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:35.406739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:35.406739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:35.406739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:35.406739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:35.406739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:35.406739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:35.406739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:35.406739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:35.406739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:35.406739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:35.406739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:35.406739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:35.406739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:35.407549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:35.407549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:35.407549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:35.407549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:35.409810 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 241/493] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:35.410931 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38f557-45ba-42ce-856e-9a6c89455e23 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:35.521083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38f557-45ba-42ce-856e-9a6c89455e23 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:35.521783 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443d598-46e5-451b-81ce-f4d40c78c225 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:35.559039 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890db31a-e049-443a-ac05-02b2aafad1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:35.559841 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890db31a-e049-443a-ac05-02b2aafad1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:35.560123 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890db31a-e049-443a-ac05-02b2aafad1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:35.560396 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890db31a-e049-443a-ac05-02b2aafad1f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:35.560997 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5f886-8e99-4fb3-b2ff-8e68605d3aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:35.561803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5f886-8e99-4fb3-b2ff-8e68605d3aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:35.562089 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5f886-8e99-4fb3-b2ff-8e68605d3aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:35.562547 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5f886-8e99-4fb3-b2ff-8e68605d3aa8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:35.570988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5f886-8e99-4fb3-b2ff-8e68605d3aa8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:35.571901 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890db31a-e049-443a-ac05-02b2aafad1f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:35.573073 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5f886-8e99-4fb3-b2ff-8e68605d3aa8 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:35.580684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-890db31a-e049-443a-ac05-02b2aafad1f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:35.580684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:35.580684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:35.580684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:35.580684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:35.580684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:35.580684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:35.580684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:35.580684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:35.580684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:35.580684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:35.580684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:35.580684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:35.580684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:35.580684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:35.580684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:35.581629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:35.581629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:35.581629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:35.581629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:35.581629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:35.581629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:35.581629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:35.581629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:35.581629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:35.581629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:35.581629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:35.581629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:35.581629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:35.581629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:35.581629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:35.581629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:35.587561 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:35.587561 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:35.587561 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:35.587561 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:35.587561 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:35.587561 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:35.587561 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:35.587561 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:35.587561 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:35.587561 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:35.587561 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:35.587561 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:35.587561 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 253/494] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 21:52:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:35.587561 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890db31a-e049-443a-ac05-02b2aafad1f5 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:35.589942 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-89f5f886-8e99-4fb3-b2ff-8e68605d3aa8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 21:52:35.589942 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:35.589942 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:35.589942 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:35.589942 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:35.589942 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:35.589942 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:35.589942 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:35.589942 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:35.589942 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:35.589942 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:35.589942 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:35.589942 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:52:35.589942 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:52:35.589942 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:52:35.589942 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:52:35.590802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:35.590802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:35.590802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:52:35.590802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:35.590802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:52:35.590802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:35.590802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:35.590802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:35.590802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:35.590802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:35.590802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:35.590802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:35.590802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:35.590802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:35.590802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:35.590802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:35.590802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:35.590802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:35.593060 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:35.593060 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:35.593060 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:52:35.593060 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:52:35.593060 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:52:35.593060 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:52:35.593060 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:52:35.593060 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:52:35.593060 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 21:52:35.593060 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:35.593060 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 242/495] 10.222.0.35 () {56 vars in 1093 bytes} [Thu May 19 21:52:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:35.593060 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef18f5-5de6-4dbf-9386-0ded4e1f548c None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:35.593060 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef18f5-5de6-4dbf-9386-0ded4e1f548c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:35.594655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef18f5-5de6-4dbf-9386-0ded4e1f548c None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:35.594655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 243/496] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:35.595258 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef18f5-5de6-4dbf-9386-0ded4e1f548c None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:35.605848 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:35.628497 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:35.713614 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890db31a-e049-443a-ac05-02b2aafad1f5 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:35.726851 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef18f5-5de6-4dbf-9386-0ded4e1f548c None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:35.752698 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58074f-08db-46c5-8d09-8de7614b8f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:35.753392 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58074f-08db-46c5-8d09-8de7614b8f3b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:35.753761 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58074f-08db-46c5-8d09-8de7614b8f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:35.754036 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58074f-08db-46c5-8d09-8de7614b8f3b None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:35.754775 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58074f-08db-46c5-8d09-8de7614b8f3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:35.755081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58074f-08db-46c5-8d09-8de7614b8f3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:35.756720 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58074f-08db-46c5-8d09-8de7614b8f3b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:35.768230 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f5bf0-bc86-4fa7-ba84-b7ffd64e307c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:35.768939 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f5bf0-bc86-4fa7-ba84-b7ffd64e307c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:35.769221 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f5bf0-bc86-4fa7-ba84-b7ffd64e307c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:35.769602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f5bf0-bc86-4fa7-ba84-b7ffd64e307c None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:35.774680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 254/497] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:35.774832 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f5bf0-bc86-4fa7-ba84-b7ffd64e307c None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:35.774832 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f5bf0-bc86-4fa7-ba84-b7ffd64e307c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:35.774975 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58074f-08db-46c5-8d09-8de7614b8f3b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:35.775131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f5bf0-bc86-4fa7-ba84-b7ffd64e307c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:35.784233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 244/498] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 21:52:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:35.786421 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f7e62-c90c-4ae5-aabc-f3372ba550fa None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:35.786865 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f7e62-c90c-4ae5-aabc-f3372ba550fa None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:35.787286 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f7e62-c90c-4ae5-aabc-f3372ba550fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:35.808349 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4b9f7e62-c90c-4ae5-aabc-f3372ba550fa None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:35.809651 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4b9f7e62-c90c-4ae5-aabc-f3372ba550fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:35.876524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:35.881964 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 245/499] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:35.882732 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:35.882850 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f7e62-c90c-4ae5-aabc-f3372ba550fa None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:35.902129 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58074f-08db-46c5-8d09-8de7614b8f3b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:35.937687 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27021691-bf5b-4e4d-9ac5-92c56c58f734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:35.938364 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27021691-bf5b-4e4d-9ac5-92c56c58f734 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:35.938645 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27021691-bf5b-4e4d-9ac5-92c56c58f734 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:35.938986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27021691-bf5b-4e4d-9ac5-92c56c58f734 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:35.939880 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27021691-bf5b-4e4d-9ac5-92c56c58f734 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:35.940201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27021691-bf5b-4e4d-9ac5-92c56c58f734 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:35.941708 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27021691-bf5b-4e4d-9ac5-92c56c58f734 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:35.979989 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 255/500] 10.222.0.35 () {56 vars in 1133 bytes} [Thu May 19 21:52:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:35.980872 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27021691-bf5b-4e4d-9ac5-92c56c58f734 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:35.998259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f7e62-c90c-4ae5-aabc-f3372ba550fa None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:36.032613 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1423869-658c-43fb-9fb9-d2edc95470c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:36.033404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1423869-658c-43fb-9fb9-d2edc95470c4 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:36.033688 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1423869-658c-43fb-9fb9-d2edc95470c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:36.033959 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1423869-658c-43fb-9fb9-d2edc95470c4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:36.041636 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1423869-658c-43fb-9fb9-d2edc95470c4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:36.043123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1423869-658c-43fb-9fb9-d2edc95470c4 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:36.059071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-f1423869-658c-43fb-9fb9-d2edc95470c4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 21:52:36.059071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:36.059071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:36.059071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:36.059071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:36.059071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:36.059071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:36.059071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:36.059071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:36.059071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:36.059071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:36.059071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:36.059071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:52:36.059071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:52:36.059071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:52:36.059071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:52:36.060049 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:36.060049 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:36.060049 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:52:36.060049 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:36.060049 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:52:36.060049 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:36.060049 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:36.060049 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:36.060049 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:36.060049 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:36.060049 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:36.060049 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:36.060049 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:36.060049 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:36.060049 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:36.060049 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:36.060049 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:36.060049 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:36.060949 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:36.060949 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:36.060949 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:52:36.060949 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:52:36.060949 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:52:36.060949 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:52:36.060949 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:52:36.060949 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:52:36.060949 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 21:52:36.060949 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:36.060949 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 246/501] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:52:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:36.061941 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d994b-81bb-4974-aea9-1c8c779d526d None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:36.062203 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d994b-81bb-4974-aea9-1c8c779d526d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:36.062413 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d994b-81bb-4974-aea9-1c8c779d526d None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:36.063691 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 247/502] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:36.064377 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d994b-81bb-4974-aea9-1c8c779d526d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:36.088657 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27021691-bf5b-4e4d-9ac5-92c56c58f734 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:36.124520 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef298ad8-5927-4147-b94c-1eae08531121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:36.125321 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef298ad8-5927-4147-b94c-1eae08531121 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:36.125604 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef298ad8-5927-4147-b94c-1eae08531121 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:36.125877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef298ad8-5927-4147-b94c-1eae08531121 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:36.126409 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:36.136289 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef298ad8-5927-4147-b94c-1eae08531121 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:36.137728 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef298ad8-5927-4147-b94c-1eae08531121 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:36.146152 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:36.157095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-ef298ad8-5927-4147-b94c-1eae08531121 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:36.157095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:36.157095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:36.157095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:36.157095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:36.157095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:36.157095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:36.157095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:36.157095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:36.157095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:36.157095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:36.157095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:36.157095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:36.157095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:36.157095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:36.158201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:36.158201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:36.158201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:36.158201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:36.158201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:36.158201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:36.158201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:36.158201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:36.158201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:36.158201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:36.158201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:36.158201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:36.158201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:36.158201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:36.158201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:36.158201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:36.158201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:36.159327 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:36.159327 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:36.159327 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:36.159327 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:36.159327 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 256/503] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:36.159327 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef298ad8-5927-4147-b94c-1eae08531121 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:36.180757 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d994b-81bb-4974-aea9-1c8c779d526d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:36.216769 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cf52b-e79b-4b16-8d52-271536153dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:36.217678 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cf52b-e79b-4b16-8d52-271536153dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:36.217853 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cf52b-e79b-4b16-8d52-271536153dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:36.218144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cf52b-e79b-4b16-8d52-271536153dc1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:36.231127 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0cf52b-e79b-4b16-8d52-271536153dc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:36.238832 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-cc0cf52b-e79b-4b16-8d52-271536153dc1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:36.238832 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:36.238832 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:36.238832 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:36.238832 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:36.238832 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:36.238832 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:36.238832 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:36.238832 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:36.238832 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:36.238832 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:36.238832 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:36.238832 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:36.238832 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:36.238832 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:36.238832 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:36.240108 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:36.240108 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:36.240108 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:36.240108 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:36.240108 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:36.240108 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:36.240108 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:36.240108 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:36.240108 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:36.240108 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:36.240108 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:36.240108 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:36.240108 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:36.240108 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:36.240108 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:36.240108 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:36.240939 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:36.240939 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:36.240939 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:36.240939 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:36.240939 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:36.240939 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:36.240939 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:36.240939 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:36.240939 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:36.240939 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:36.240939 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:36.240939 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:36.240939 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 248/504] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 21:52:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:36.241561 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cf52b-e79b-4b16-8d52-271536153dc1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:36.266661 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef298ad8-5927-4147-b94c-1eae08531121 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:36.308564 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd63be2-a8ff-476d-b0db-f1d9aa82a1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:36.309260 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd63be2-a8ff-476d-b0db-f1d9aa82a1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:36.309541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd63be2-a8ff-476d-b0db-f1d9aa82a1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:36.309818 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd63be2-a8ff-476d-b0db-f1d9aa82a1f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:36.349829 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cf52b-e79b-4b16-8d52-271536153dc1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:36.374222 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:36.384477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:36.387746 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd63be2-a8ff-476d-b0db-f1d9aa82a1f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:36.389661 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd63be2-a8ff-476d-b0db-f1d9aa82a1f0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:36.391890 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01df25f-5b96-4e19-a38f-3bb4eb3cd397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:36.392607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01df25f-5b96-4e19-a38f-3bb4eb3cd397 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:36.392891 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01df25f-5b96-4e19-a38f-3bb4eb3cd397 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:36.393174 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01df25f-5b96-4e19-a38f-3bb4eb3cd397 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:36.394006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01df25f-5b96-4e19-a38f-3bb4eb3cd397 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:36.394315 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01df25f-5b96-4e19-a38f-3bb4eb3cd397 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:36.395751 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01df25f-5b96-4e19-a38f-3bb4eb3cd397 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:36.438625 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 249/505] 10.222.0.35 () {56 vars in 1137 bytes} [Thu May 19 21:52:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:36.440025 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b190f-2937-4abb-a799-fb872f83a08a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:36.440340 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b190f-2937-4abb-a799-fb872f83a08a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:36.440645 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b190f-2937-4abb-a799-fb872f83a08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:36.458126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-517b190f-2937-4abb-a799-fb872f83a08a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:36.459500 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-517b190f-2937-4abb-a799-fb872f83a08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:36.507805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 257/506] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:52:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:52:36.508783 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd63be2-a8ff-476d-b0db-f1d9aa82a1f0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:36.529831 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 250/507] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:36.530677 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b190f-2937-4abb-a799-fb872f83a08a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:36.617748 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:36.621512 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd63be2-a8ff-476d-b0db-f1d9aa82a1f0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:36.635576 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b190f-2937-4abb-a799-fb872f83a08a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:36.643169 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:36.659643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9650a1-87c2-4065-b7be-84a2bfd9f64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:36.660309 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9650a1-87c2-4065-b7be-84a2bfd9f64d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:36.660617 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9650a1-87c2-4065-b7be-84a2bfd9f64d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:36.660887 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9650a1-87c2-4065-b7be-84a2bfd9f64d None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:36.661608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9650a1-87c2-4065-b7be-84a2bfd9f64d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:36.661916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9650a1-87c2-4065-b7be-84a2bfd9f64d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:36.663279 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9650a1-87c2-4065-b7be-84a2bfd9f64d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:36.675598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 258/508] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:36.676484 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9650a1-87c2-4065-b7be-84a2bfd9f64d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:36.682291 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1925f-ecab-4919-b972-eefb948db13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:36.682967 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1925f-ecab-4919-b972-eefb948db13b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:36.683253 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1925f-ecab-4919-b972-eefb948db13b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:36.683534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1925f-ecab-4919-b972-eefb948db13b None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:36.684291 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1925f-ecab-4919-b972-eefb948db13b None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:36.684633 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1925f-ecab-4919-b972-eefb948db13b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:36.686021 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1925f-ecab-4919-b972-eefb948db13b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:36.694458 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 251/509] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 21:52:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:36.695269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1925f-ecab-4919-b972-eefb948db13b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:36.783450 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9650a1-87c2-4065-b7be-84a2bfd9f64d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:36.802677 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1925f-ecab-4919-b972-eefb948db13b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:36.818542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88577866-e9a7-4d37-b4d9-032acc0cf590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:36.819191 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88577866-e9a7-4d37-b4d9-032acc0cf590 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:36.819494 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88577866-e9a7-4d37-b4d9-032acc0cf590 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:36.819765 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88577866-e9a7-4d37-b4d9-032acc0cf590 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:36.843562 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f5716-515e-4e86-900c-ecb739c9def2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:36.844369 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f5716-515e-4e86-900c-ecb739c9def2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:36.844691 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f5716-515e-4e86-900c-ecb739c9def2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:36.844973 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f5716-515e-4e86-900c-ecb739c9def2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:36.851573 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:36.857140 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f5716-515e-4e86-900c-ecb739c9def2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:36.858606 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f5716-515e-4e86-900c-ecb739c9def2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:36.877077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-a98f5716-515e-4e86-900c-ecb739c9def2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:36.877077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:36.877077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:36.877077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:36.877077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:36.877077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:36.877077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:36.877077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:36.877077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:36.877077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:36.877077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:36.877077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:36.877077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:36.877077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:36.877077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:36.878070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:36.878070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:36.878070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:36.878070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:36.878070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:36.878070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:36.878070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:36.878070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:36.878070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:36.878070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:36.878070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:36.878070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:36.878070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:36.878070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:36.878070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:36.878070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:36.878070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:36.878936 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:36.878936 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:36.878936 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:36.878936 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:36.878936 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 252/510] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:36.879226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f5716-515e-4e86-900c-ecb739c9def2 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:36.900254 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88577866-e9a7-4d37-b4d9-032acc0cf590 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:36.901960 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88577866-e9a7-4d37-b4d9-032acc0cf590 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:36.903242 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:36.987871 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f5716-515e-4e86-900c-ecb739c9def2 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:37.023931 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fc370-913a-44c0-ae5e-d19c6e608f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:37.024266 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 259/511] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:52:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:52:37.024753 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fc370-913a-44c0-ae5e-d19c6e608f16 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:37.025037 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fc370-913a-44c0-ae5e-d19c6e608f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:37.025134 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88577866-e9a7-4d37-b4d9-032acc0cf590 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:37.025456 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fc370-913a-44c0-ae5e-d19c6e608f16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:37.045970 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fc370-913a-44c0-ae5e-d19c6e608f16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:37.047451 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fc370-913a-44c0-ae5e-d19c6e608f16 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:37.065160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-0f6fc370-913a-44c0-ae5e-d19c6e608f16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:37.065160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:37.065160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:37.065160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:37.065160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:37.065160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:37.065160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:37.065160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:37.065160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:37.065160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:37.065160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:37.065160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:37.065160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:37.065160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:37.065160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:37.066123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:37.066123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:37.066123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:37.066123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:37.066123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:37.066123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:37.066123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:37.066123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:37.066123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:37.066123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:37.066123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:37.066123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:37.066123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:37.066123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:37.066123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:37.066123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:37.066123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:37.066933 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:37.066933 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:37.066933 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:37.066933 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:37.066933 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 253/512] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:37.067194 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fc370-913a-44c0-ae5e-d19c6e608f16 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:37.091154 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:37.136197 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88577866-e9a7-4d37-b4d9-032acc0cf590 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:37.139325 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:37.171644 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fc370-913a-44c0-ae5e-d19c6e608f16 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:37.172915 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64490fee-0730-4328-b8bf-9f8710ee7b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:37.173724 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64490fee-0730-4328-b8bf-9f8710ee7b68 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:37.174006 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64490fee-0730-4328-b8bf-9f8710ee7b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:37.174284 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64490fee-0730-4328-b8bf-9f8710ee7b68 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:37.182213 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64490fee-0730-4328-b8bf-9f8710ee7b68 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:37.183701 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64490fee-0730-4328-b8bf-9f8710ee7b68 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:37.206994 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5949931-9d2f-46c8-a167-a44396023a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:37.207792 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5949931-9d2f-46c8-a167-a44396023a57 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:37.208081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5949931-9d2f-46c8-a167-a44396023a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:37.208353 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5949931-9d2f-46c8-a167-a44396023a57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:37.209255 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-64490fee-0730-4328-b8bf-9f8710ee7b68 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 21:52:37.209255 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:37.209255 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:37.209255 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:37.209255 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:37.209255 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:37.209255 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:37.209255 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:37.209255 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:37.209255 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:37.209255 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:37.209255 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:37.209255 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:52:37.209255 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:52:37.209255 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:52:37.209255 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:52:37.210102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:37.210102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:37.210102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:52:37.210102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:37.210102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:52:37.210102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:37.210102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:37.210102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:37.210102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:37.210102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:37.210102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:37.210102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:37.210102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:37.210102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:37.210102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:37.210102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:37.210102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:37.210102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:37.210968 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:37.210968 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:37.210968 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:52:37.210968 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:52:37.210968 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:52:37.210968 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:52:37.210968 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:52:37.210968 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:52:37.210968 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 21:52:37.210968 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:37.210968 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 260/513] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:52:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:37.211536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64490fee-0730-4328-b8bf-9f8710ee7b68 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:37.224161 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5949931-9d2f-46c8-a167-a44396023a57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:37.225690 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5949931-9d2f-46c8-a167-a44396023a57 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:37.243450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-e5949931-9d2f-46c8-a167-a44396023a57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:37.243450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:37.243450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:37.243450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:37.243450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:37.243450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:37.243450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:37.243450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:37.243450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:37.243450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:37.243450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:37.243450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:37.243450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:37.243450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:37.243450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:37.245164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:37.245164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:37.245164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:37.245164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:37.245164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:37.245164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:37.245164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:37.245164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:37.245164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:37.245164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:37.245164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:37.245164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:37.245164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:37.245164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:37.245164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:37.245164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:37.245164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:37.246107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:37.246107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:37.246107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:37.246107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:37.246107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 254/514] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:37.246779 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5949931-9d2f-46c8-a167-a44396023a57 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:37.326899 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64490fee-0730-4328-b8bf-9f8710ee7b68 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:37.348475 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:37.363590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5949931-9d2f-46c8-a167-a44396023a57 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:37.365380 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca31d2-bef7-4203-87fa-ae6befa81cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:37.366104 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca31d2-bef7-4203-87fa-ae6befa81cca None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:37.367085 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca31d2-bef7-4203-87fa-ae6befa81cca None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:37.367085 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca31d2-bef7-4203-87fa-ae6befa81cca None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:37.367385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca31d2-bef7-4203-87fa-ae6befa81cca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:37.367697 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca31d2-bef7-4203-87fa-ae6befa81cca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:37.369659 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca31d2-bef7-4203-87fa-ae6befa81cca None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:37.381243 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 261/515] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:37.382117 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca31d2-bef7-4203-87fa-ae6befa81cca None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:37.389461 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:37.402336 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdad062-a54a-4501-872f-5b42acc001a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:37.403153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdad062-a54a-4501-872f-5b42acc001a2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:37.403436 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdad062-a54a-4501-872f-5b42acc001a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:37.403711 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdad062-a54a-4501-872f-5b42acc001a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:37.414926 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdad062-a54a-4501-872f-5b42acc001a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:37.417350 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdad062-a54a-4501-872f-5b42acc001a2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:37.436025 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-7cdad062-a54a-4501-872f-5b42acc001a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:37.436025 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:37.436025 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:37.436025 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:37.436025 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:37.436025 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:37.436025 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:37.436025 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:37.436025 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:37.436025 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:37.436025 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:37.436025 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:37.436025 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:37.436025 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:37.436025 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:37.437103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:37.437103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:37.437103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:37.437103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:37.437103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:37.437103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:37.437103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:37.437103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:37.437103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:37.437103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:37.437103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:37.437103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:37.437103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:37.437103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:37.437103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:37.437103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:37.437103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:37.437977 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:37.437977 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:37.437977 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:37.437977 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:37.437977 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 255/516] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:37.438234 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdad062-a54a-4501-872f-5b42acc001a2 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:37.492334 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca31d2-bef7-4203-87fa-ae6befa81cca None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:37.529447 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7188fc-ad64-4455-876a-461d69dd1423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:37.530119 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7188fc-ad64-4455-876a-461d69dd1423 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:37.530400 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7188fc-ad64-4455-876a-461d69dd1423 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:37.530676 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7188fc-ad64-4455-876a-461d69dd1423 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:37.531404 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7188fc-ad64-4455-876a-461d69dd1423 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:37.531713 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7188fc-ad64-4455-876a-461d69dd1423 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:37.533119 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7188fc-ad64-4455-876a-461d69dd1423 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:37.545597 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 262/517] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:37.546397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7188fc-ad64-4455-876a-461d69dd1423 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:37.554985 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdad062-a54a-4501-872f-5b42acc001a2 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:37.591370 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b9b77-d527-478a-b0cb-24f9758f3fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:37.592040 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b9b77-d527-478a-b0cb-24f9758f3fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:37.592330 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b9b77-d527-478a-b0cb-24f9758f3fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:37.592486 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:37.592635 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b9b77-d527-478a-b0cb-24f9758f3fa3 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:37.593485 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b9b77-d527-478a-b0cb-24f9758f3fa3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:37.593834 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b9b77-d527-478a-b0cb-24f9758f3fa3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:37.595260 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b9b77-d527-478a-b0cb-24f9758f3fa3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:37.615441 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 256/518] 10.222.0.35 () {56 vars in 1137 bytes} [Thu May 19 21:52:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:37.616291 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b9b77-d527-478a-b0cb-24f9758f3fa3 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:37.651616 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:37.655156 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7188fc-ad64-4455-876a-461d69dd1423 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:37.691648 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3affc6c-7030-4703-8079-71dfbaa73098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:37.692326 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3affc6c-7030-4703-8079-71dfbaa73098 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:37.692696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3affc6c-7030-4703-8079-71dfbaa73098 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:37.692973 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3affc6c-7030-4703-8079-71dfbaa73098 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:37.693693 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3affc6c-7030-4703-8079-71dfbaa73098 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:37.693995 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3affc6c-7030-4703-8079-71dfbaa73098 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:37.695380 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3affc6c-7030-4703-8079-71dfbaa73098 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:37.707355 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 263/519] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:37.708257 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3affc6c-7030-4703-8079-71dfbaa73098 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:37.722528 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b9b77-d527-478a-b0cb-24f9758f3fa3 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:37.756916 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb69c0d-1f63-41f8-b3d2-fc48a3aa5d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:37.757709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb69c0d-1f63-41f8-b3d2-fc48a3aa5d5a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:37.757988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb69c0d-1f63-41f8-b3d2-fc48a3aa5d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:37.758259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb69c0d-1f63-41f8-b3d2-fc48a3aa5d5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:37.766376 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb69c0d-1f63-41f8-b3d2-fc48a3aa5d5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:37.767859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb69c0d-1f63-41f8-b3d2-fc48a3aa5d5a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:37.782563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-9fb69c0d-1f63-41f8-b3d2-fc48a3aa5d5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:37.782563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:37.782563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:37.782563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:37.782563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:37.782563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:37.782563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:37.782563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:37.782563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:37.782563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:37.782563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:37.782563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:37.782563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:52:37.782563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:52:37.782563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:52:37.783452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:52:37.783452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:37.783452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:37.783452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:37.783452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:37.783452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:37.783452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:37.783452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:37.783452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:37.783452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:37.783452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:37.783452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:37.783452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:37.783452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:37.783452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:37.783452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:37.783452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:37.784243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:52:37.784243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:52:37.784243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:52:37.784243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:52:37.784243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:52:37.784243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:52:37.784243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:37.784243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:37.784243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 257/520] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:52:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:37.784782 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb69c0d-1f63-41f8-b3d2-fc48a3aa5d5a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:37.836350 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:37.839643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3affc6c-7030-4703-8079-71dfbaa73098 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:37.878375 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27c856-47ed-4962-abcd-f6c5ddf99330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:37.879048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27c856-47ed-4962-abcd-f6c5ddf99330 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:37.879333 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27c856-47ed-4962-abcd-f6c5ddf99330 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:37.879614 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27c856-47ed-4962-abcd-f6c5ddf99330 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:37.880348 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b27c856-47ed-4962-abcd-f6c5ddf99330 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:37.880690 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b27c856-47ed-4962-abcd-f6c5ddf99330 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:37.881334 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:37.882086 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b27c856-47ed-4962-abcd-f6c5ddf99330 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:37.889216 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb69c0d-1f63-41f8-b3d2-fc48a3aa5d5a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:37.897041 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 264/521] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:37.897872 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27c856-47ed-4962-abcd-f6c5ddf99330 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:37.923315 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c229754-21a1-4fa4-8535-8f21c5679147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:37.924000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c229754-21a1-4fa4-8535-8f21c5679147 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:37.924287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c229754-21a1-4fa4-8535-8f21c5679147 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:37.924603 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c229754-21a1-4fa4-8535-8f21c5679147 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:37.925325 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c229754-21a1-4fa4-8535-8f21c5679147 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:37.926787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c229754-21a1-4fa4-8535-8f21c5679147 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:37.946783 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 258/522] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 21:52:37 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:52:37.948716 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c229754-21a1-4fa4-8535-8f21c5679147 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:38.028966 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27c856-47ed-4962-abcd-f6c5ddf99330 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:38.066360 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c229754-21a1-4fa4-8535-8f21c5679147 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:38.068665 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c38d84-75eb-468a-8729-20cbb39a6814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:38.069344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c38d84-75eb-468a-8729-20cbb39a6814 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:38.069622 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c38d84-75eb-468a-8729-20cbb39a6814 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:38.069898 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c38d84-75eb-468a-8729-20cbb39a6814 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:38.102595 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:38.115335 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3bef8c-3f4f-46ab-91e2-9913716191ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:38.116150 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bef8c-3f4f-46ab-91e2-9913716191ac None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:38.116458 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bef8c-3f4f-46ab-91e2-9913716191ac None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:38.116757 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bef8c-3f4f-46ab-91e2-9913716191ac None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:38.126379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3bef8c-3f4f-46ab-91e2-9913716191ac None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:38.128606 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3bef8c-3f4f-46ab-91e2-9913716191ac None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:38.144170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-5d3bef8c-3f4f-46ab-91e2-9913716191ac None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 21:52:38.144170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:38.144170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:38.144170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:38.144170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:38.144170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:38.144170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:38.144170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:38.144170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:38.144170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:38.144170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:38.144170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:38.144170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:52:38.144170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:52:38.144170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:52:38.144170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:52:38.145322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:38.145322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:38.145322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:52:38.145322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:38.145322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:52:38.145322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:38.145322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:38.145322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:38.145322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:38.145322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:38.145322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:38.145322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:38.145322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:38.145322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:38.145322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:38.145322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:38.145322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:38.145322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:38.146287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:38.146287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:38.146287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:52:38.146287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:52:38.146287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:52:38.146287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:52:38.146287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:52:38.146287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:52:38.146287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 21:52:38.146287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:38.146287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 259/523] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 21:52:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:38.146951 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3bef8c-3f4f-46ab-91e2-9913716191ac None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:38.157699 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c38d84-75eb-468a-8729-20cbb39a6814 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:38.159661 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:38.160067 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c38d84-75eb-468a-8729-20cbb39a6814 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:38.270300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3bef8c-3f4f-46ab-91e2-9913716191ac None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:38.285788 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 265/524] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:52:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:52:38.286964 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c38d84-75eb-468a-8729-20cbb39a6814 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:38.319225 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d51864-193b-4102-81a3-7decd4726d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:38.320585 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d51864-193b-4102-81a3-7decd4726d18 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:38.321004 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d51864-193b-4102-81a3-7decd4726d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:38.321422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d51864-193b-4102-81a3-7decd4726d18 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:38.322817 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d51864-193b-4102-81a3-7decd4726d18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:38.323299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d51864-193b-4102-81a3-7decd4726d18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:38.325606 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d51864-193b-4102-81a3-7decd4726d18 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:38.359997 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 260/525] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:52:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:38.359997 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d51864-193b-4102-81a3-7decd4726d18 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:38.369955 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:38.427867 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c38d84-75eb-468a-8729-20cbb39a6814 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:38.443229 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:38.473489 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298bca8-a31b-4481-861e-49226967b34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:38.475020 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298bca8-a31b-4481-861e-49226967b34b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:38.475402 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298bca8-a31b-4481-861e-49226967b34b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:38.475777 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298bca8-a31b-4481-861e-49226967b34b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:38.476644 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d51864-193b-4102-81a3-7decd4726d18 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:38.485254 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298bca8-a31b-4481-861e-49226967b34b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:38.487325 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298bca8-a31b-4481-861e-49226967b34b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:38.504180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-8298bca8-a31b-4481-861e-49226967b34b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:38.504180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:38.504180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:38.504180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:38.504180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:38.504180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:38.504180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:38.504180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:38.504180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:38.504180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:38.504180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:38.504180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:38.504180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:52:38.504180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:52:38.504180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:52:38.505382 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:52:38.505382 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:38.505382 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:38.505382 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:38.505382 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:38.505382 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:38.505382 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:38.505382 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:38.505382 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:38.505382 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:38.505382 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:38.505382 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:38.505382 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:38.505382 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:38.505382 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:38.505382 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:38.505382 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:38.506214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:52:38.506214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:52:38.506214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:52:38.506214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:52:38.506214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:52:38.506214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:52:38.506214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:38.506214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:38.506214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 266/526] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:52:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:38.506214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298bca8-a31b-4481-861e-49226967b34b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:38.521616 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fc4a7-ed04-45a5-a79f-b31b8bc8b124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:38.522212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fc4a7-ed04-45a5-a79f-b31b8bc8b124 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:38.522494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fc4a7-ed04-45a5-a79f-b31b8bc8b124 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:38.522766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fc4a7-ed04-45a5-a79f-b31b8bc8b124 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:38.523610 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fc4a7-ed04-45a5-a79f-b31b8bc8b124 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:38.523916 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fc4a7-ed04-45a5-a79f-b31b8bc8b124 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:38.525934 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fc4a7-ed04-45a5-a79f-b31b8bc8b124 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:38.545065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 261/527] 10.222.0.35 () {56 vars in 1139 bytes} [Thu May 19 21:52:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:38.546278 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fc4a7-ed04-45a5-a79f-b31b8bc8b124 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:38.628611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298bca8-a31b-4481-861e-49226967b34b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:38.658451 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:38.664968 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fc4a7-ed04-45a5-a79f-b31b8bc8b124 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:38.675260 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e34d17-506d-4f92-8154-2c33353024d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:38.676159 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e34d17-506d-4f92-8154-2c33353024d0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:38.676540 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e34d17-506d-4f92-8154-2c33353024d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:38.676877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e34d17-506d-4f92-8154-2c33353024d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:38.688893 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e34d17-506d-4f92-8154-2c33353024d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:38.690369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e34d17-506d-4f92-8154-2c33353024d0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:38.693760 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:38.704960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db8d1c-4574-4bb7-adae-c6e60a0e621a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:38.705626 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db8d1c-4574-4bb7-adae-c6e60a0e621a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:38.705916 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db8d1c-4574-4bb7-adae-c6e60a0e621a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:38.706195 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db8d1c-4574-4bb7-adae-c6e60a0e621a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:38.707043 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db8d1c-4574-4bb7-adae-c6e60a0e621a None admin] RBAC: Adding query filter params (role.id=372e9dc71b5a4a4daddc43ab384fa67b, scope.project.id=89b20e18525c473e94a2b263148f1f5f, user.id=902ca8f1d59547a0ab187b4748311f58) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:38.707359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db8d1c-4574-4bb7-adae-c6e60a0e621a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:38.708835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db8d1c-4574-4bb7-adae-c6e60a0e621a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:38.709924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-80e34d17-506d-4f92-8154-2c33353024d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:38.709924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:38.709924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:38.709924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:38.709924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:38.709924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:38.709924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:38.709924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:38.709924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:38.709924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:38.709924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:38.709924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:38.709924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:38.709924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:38.709924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:38.710847 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:38.710847 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:38.710847 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:38.710847 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:38.710847 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:38.710847 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:38.710847 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:38.710847 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:38.710847 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:38.710847 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:38.710847 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:38.710847 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:38.710847 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:38.710847 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:38.710847 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:38.710847 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:38.710847 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:38.711703 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:38.711703 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:38.711703 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:38.711703 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:38.711703 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 267/528] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:38.711979 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e34d17-506d-4f92-8154-2c33353024d0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:38.720114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 262/529] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:52:38 2022] GET /identity/v3/role_assignments?user.id=902ca8f1d59547a0ab187b4748311f58&scope.project.id=89b20e18525c473e94a2b263148f1f5f&role.id=372e9dc71b5a4a4daddc43ab384fa67b => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:38.725870 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db8d1c-4574-4bb7-adae-c6e60a0e621a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:38.833088 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e34d17-506d-4f92-8154-2c33353024d0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:38.850202 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db8d1c-4574-4bb7-adae-c6e60a0e621a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:38.882740 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94459e3b-d6d0-41fc-a04c-1832da5305d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:38.883942 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94459e3b-d6d0-41fc-a04c-1832da5305d5 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:38.884387 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94459e3b-d6d0-41fc-a04c-1832da5305d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:38.885648 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94459e3b-d6d0-41fc-a04c-1832da5305d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:38.886914 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94459e3b-d6d0-41fc-a04c-1832da5305d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:38.887522 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94459e3b-d6d0-41fc-a04c-1832da5305d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:38.889859 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94459e3b-d6d0-41fc-a04c-1832da5305d5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:38.895946 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b494c4-e7fc-4155-b481-4c227278090d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:38.896874 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b494c4-e7fc-4155-b481-4c227278090d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:38.897258 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b494c4-e7fc-4155-b481-4c227278090d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:38.897632 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b494c4-e7fc-4155-b481-4c227278090d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:38.921846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 268/530] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:52:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:38.923029 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94459e3b-d6d0-41fc-a04c-1832da5305d5 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:38.958458 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:38.970917 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:38.989155 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b494c4-e7fc-4155-b481-4c227278090d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:38.991112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b494c4-e7fc-4155-b481-4c227278090d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:39.052244 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94459e3b-d6d0-41fc-a04c-1832da5305d5 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:39.090509 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b0d14-fe34-4c97-bb02-718873501201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:39.091397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b0d14-fe34-4c97-bb02-718873501201 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:39.091822 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b0d14-fe34-4c97-bb02-718873501201 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:39.092235 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b0d14-fe34-4c97-bb02-718873501201 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:39.093123 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b0d14-fe34-4c97-bb02-718873501201 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:39.093589 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b0d14-fe34-4c97-bb02-718873501201 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:39.095307 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b0d14-fe34-4c97-bb02-718873501201 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:39.108529 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 269/531] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:39.109659 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b0d14-fe34-4c97-bb02-718873501201 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:39.115555 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 263/532] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:52:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:52:39.115555 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b494c4-e7fc-4155-b481-4c227278090d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:39.216542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:39.217383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:39.228089 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b494c4-e7fc-4155-b481-4c227278090d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:39.229396 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b0d14-fe34-4c97-bb02-718873501201 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:39.266217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e35d5-e5c7-4ab7-8975-9428b760a811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:39.266702 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3be785-6910-488c-b23a-7498ce173865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:39.267093 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e35d5-e5c7-4ab7-8975-9428b760a811 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:39.267452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e35d5-e5c7-4ab7-8975-9428b760a811 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:39.267744 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e35d5-e5c7-4ab7-8975-9428b760a811 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:39.268192 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3be785-6910-488c-b23a-7498ce173865 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:39.268518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3be785-6910-488c-b23a-7498ce173865 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:39.268704 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e35d5-e5c7-4ab7-8975-9428b760a811 None admin] RBAC: Adding query filter params (role.id=372e9dc71b5a4a4daddc43ab384fa67b, scope.project.id=89b20e18525c473e94a2b263148f1f5f, user.id=bf64f4ec145742d78eee6c4a447515dc) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:39.268822 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3be785-6910-488c-b23a-7498ce173865 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:39.269017 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e35d5-e5c7-4ab7-8975-9428b760a811 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:39.270723 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e35d5-e5c7-4ab7-8975-9428b760a811 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:39.277580 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3be785-6910-488c-b23a-7498ce173865 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:39.279179 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3be785-6910-488c-b23a-7498ce173865 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:39.280576 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 270/533] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:52:39 2022] GET /identity/v3/role_assignments?user.id=bf64f4ec145742d78eee6c4a447515dc&scope.project.id=89b20e18525c473e94a2b263148f1f5f&role.id=372e9dc71b5a4a4daddc43ab384fa67b => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:39.281454 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e35d5-e5c7-4ab7-8975-9428b760a811 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:39.321876 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-dc3be785-6910-488c-b23a-7498ce173865 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:39.321876 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:39.321876 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:39.321876 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:39.321876 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:39.321876 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:39.321876 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:39.321876 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:39.321876 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:39.321876 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:39.321876 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:39.321876 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:39.321876 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:52:39.321876 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:52:39.321876 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:52:39.323234 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:52:39.323234 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:39.323234 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:39.323234 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:39.323234 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:39.323234 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:39.323234 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:39.323234 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:39.323234 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:39.323234 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:39.323234 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:39.323234 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:39.323234 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:39.323234 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:39.323234 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:39.323234 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:39.323234 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:39.324099 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:52:39.324099 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:52:39.324099 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:52:39.324099 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:52:39.324099 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:52:39.324099 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:52:39.324099 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:39.324099 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:39.324099 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 264/534] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:52:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:39.334088 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3be785-6910-488c-b23a-7498ce173865 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:39.520831 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e35d5-e5c7-4ab7-8975-9428b760a811 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:39.542982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3be785-6910-488c-b23a-7498ce173865 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:39.563732 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877bf5b-6106-499a-88d7-e11eeb84cfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:39.564927 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877bf5b-6106-499a-88d7-e11eeb84cfb6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:39.565205 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877bf5b-6106-499a-88d7-e11eeb84cfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:39.565471 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877bf5b-6106-499a-88d7-e11eeb84cfb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:39.578429 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8877bf5b-6106-499a-88d7-e11eeb84cfb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:39.580113 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8877bf5b-6106-499a-88d7-e11eeb84cfb6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:39.601195 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-8877bf5b-6106-499a-88d7-e11eeb84cfb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:39.601195 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:39.601195 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:39.601195 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:39.601195 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:39.601195 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:39.601195 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:39.601195 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:39.601195 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:39.601195 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:39.601195 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:39.601195 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:39.601195 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:39.601195 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:39.601195 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:39.602081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:39.602081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:39.602081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:39.602081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:39.602081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:39.602081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:39.602081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:39.602081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:39.602081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:39.602081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:39.602081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:39.602081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:39.602081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:39.602081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:39.602081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:39.602081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:39.602081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:39.602991 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:39.602991 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:39.602991 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:39.602991 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:39.602991 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 271/535] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:39.609815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877bf5b-6106-499a-88d7-e11eeb84cfb6 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:39.625917 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:39.630756 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eeb8d3-2b18-493e-a42d-f353951a9f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:39.631489 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eeb8d3-2b18-493e-a42d-f353951a9f77 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:39.631824 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eeb8d3-2b18-493e-a42d-f353951a9f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:39.632103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eeb8d3-2b18-493e-a42d-f353951a9f77 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:39.632924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eeb8d3-2b18-493e-a42d-f353951a9f77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:39.633232 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eeb8d3-2b18-493e-a42d-f353951a9f77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:39.637216 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eeb8d3-2b18-493e-a42d-f353951a9f77 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:39.667701 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 265/536] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:52:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:39.673060 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eeb8d3-2b18-493e-a42d-f353951a9f77 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:39.705926 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:39.822519 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877bf5b-6106-499a-88d7-e11eeb84cfb6 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:39.885957 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eeb8d3-2b18-493e-a42d-f353951a9f77 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:39.891332 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639805a-7a74-4b4a-962e-549c03429a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:39.892009 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639805a-7a74-4b4a-962e-549c03429a78 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:39.892292 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639805a-7a74-4b4a-962e-549c03429a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:39.892601 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639805a-7a74-4b4a-962e-549c03429a78 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:39.893340 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639805a-7a74-4b4a-962e-549c03429a78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:39.893645 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639805a-7a74-4b4a-962e-549c03429a78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:39.895048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639805a-7a74-4b4a-962e-549c03429a78 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:39.916677 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 272/537] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:39.922364 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639805a-7a74-4b4a-962e-549c03429a78 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:39.954764 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf22650-f457-4f5e-a539-ca21bd7efb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:39.956322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf22650-f457-4f5e-a539-ca21bd7efb12 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:39.956738 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf22650-f457-4f5e-a539-ca21bd7efb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:39.957014 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf22650-f457-4f5e-a539-ca21bd7efb12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:39.957955 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf22650-f457-4f5e-a539-ca21bd7efb12 None admin] RBAC: Adding query filter params (role.id=372e9dc71b5a4a4daddc43ab384fa67b, scope.project.id=89b20e18525c473e94a2b263148f1f5f, user.id=85924e1dfe664f78af34565db18b0b55) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:39.958271 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf22650-f457-4f5e-a539-ca21bd7efb12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:39.959817 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf22650-f457-4f5e-a539-ca21bd7efb12 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:39.968969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 266/538] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:52:39 2022] GET /identity/v3/role_assignments?user.id=85924e1dfe664f78af34565db18b0b55&scope.project.id=89b20e18525c473e94a2b263148f1f5f&role.id=372e9dc71b5a4a4daddc43ab384fa67b => generated 259 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:52:40.022261 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:40.070435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639805a-7a74-4b4a-962e-549c03429a78 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:40.117212 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e0623-3a26-43af-9e1f-f893d6479687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:40.118066 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e0623-3a26-43af-9e1f-f893d6479687 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:40.118348 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e0623-3a26-43af-9e1f-f893d6479687 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:40.118621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e0623-3a26-43af-9e1f-f893d6479687 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:40.126935 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e0623-3a26-43af-9e1f-f893d6479687 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:40.128447 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e0623-3a26-43af-9e1f-f893d6479687 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:40.143385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-e90e0623-3a26-43af-9e1f-f893d6479687 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:40.143385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:40.143385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:40.143385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:40.143385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:40.143385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:40.143385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:40.143385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:40.143385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:40.143385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:40.143385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:40.143385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:40.143385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:52:40.143385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:52:40.143385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:52:40.144245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:52:40.144245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:40.144245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:40.144245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:40.144245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:40.144245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:40.144245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:40.144245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:40.144245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:40.144245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:40.144245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:40.144245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:40.144245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:40.144245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:40.144245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:40.144245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:40.144245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:40.145092 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:52:40.145092 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:52:40.145092 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:52:40.145092 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:52:40.145092 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:52:40.145092 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:52:40.145092 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:40.145092 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:40.145092 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 273/539] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:52:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:40.153567 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf22650-f457-4f5e-a539-ca21bd7efb12 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:40.265035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:40.296983 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf22650-f457-4f5e-a539-ca21bd7efb12 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:40.350258 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27609362-d8e5-4326-8af1-58c613007b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:40.350923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27609362-d8e5-4326-8af1-58c613007b27 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:40.351203 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27609362-d8e5-4326-8af1-58c613007b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:40.351476 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27609362-d8e5-4326-8af1-58c613007b27 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:40.352258 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27609362-d8e5-4326-8af1-58c613007b27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:40.352596 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27609362-d8e5-4326-8af1-58c613007b27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:40.354069 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27609362-d8e5-4326-8af1-58c613007b27 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:40.375262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 267/540] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:52:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:40.381095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e0623-3a26-43af-9e1f-f893d6479687 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:40.488098 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124315f-51e5-4273-bbb2-1b3a6a52a1e7 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:40.488470 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124315f-51e5-4273-bbb2-1b3a6a52a1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:40.488862 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124315f-51e5-4273-bbb2-1b3a6a52a1e7 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:40.490877 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 268/541] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:52:40.496861 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9c15b-94bc-4e68-95b4-a034db2d7618 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:40.497149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9c15b-94bc-4e68-95b4-a034db2d7618 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:40.497418 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9c15b-94bc-4e68-95b4-a034db2d7618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:40.514998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e7a9c15b-94bc-4e68-95b4-a034db2d7618 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:40.516183 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e7a9c15b-94bc-4e68-95b4-a034db2d7618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:40.543282 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e0623-3a26-43af-9e1f-f893d6479687 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:40.584865 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:40.595853 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0e179-3fe8-4ea3-9581-b185dea3cf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:40.596550 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0e179-3fe8-4ea3-9581-b185dea3cf26 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:40.596835 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0e179-3fe8-4ea3-9581-b185dea3cf26 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:40.597112 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0e179-3fe8-4ea3-9581-b185dea3cf26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:40.597959 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0e179-3fe8-4ea3-9581-b185dea3cf26 None admin] RBAC: Adding query filter params (role.id=372e9dc71b5a4a4daddc43ab384fa67b, scope.project.id=89b20e18525c473e94a2b263148f1f5f, user.id=a571d6fe63334552b532aae15299ef9a) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:40.598272 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0e179-3fe8-4ea3-9581-b185dea3cf26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:40.599718 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0e179-3fe8-4ea3-9581-b185dea3cf26 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:40.615952 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 274/542] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:52:40 2022] GET /identity/v3/role_assignments?user.id=a571d6fe63334552b532aae15299ef9a&scope.project.id=89b20e18525c473e94a2b263148f1f5f&role.id=372e9dc71b5a4a4daddc43ab384fa67b => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:40.628222 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 269/543] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:52:40.668352 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0e179-3fe8-4ea3-9581-b185dea3cf26 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:40.788061 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0e179-3fe8-4ea3-9581-b185dea3cf26 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:40.829027 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3af23d-2b5c-4590-8a6f-c186eb5cc6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:40.829845 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3af23d-2b5c-4590-8a6f-c186eb5cc6a8 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:40.830131 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3af23d-2b5c-4590-8a6f-c186eb5cc6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:40.830402 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3af23d-2b5c-4590-8a6f-c186eb5cc6a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:40.844037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3af23d-2b5c-4590-8a6f-c186eb5cc6a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:40.851942 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-cd3af23d-2b5c-4590-8a6f-c186eb5cc6a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:40.851942 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:40.851942 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:40.851942 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:40.851942 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:40.851942 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:40.851942 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:40.851942 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:40.851942 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:40.851942 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:40.851942 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:40.851942 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:40.851942 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:40.851942 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:40.851942 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:40.851942 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:40.852920 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:40.852920 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:40.852920 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:40.852920 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:40.852920 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:40.852920 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:40.852920 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:40.852920 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:40.852920 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:40.852920 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:40.852920 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:40.852920 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:40.852920 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:40.852920 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:40.852920 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:40.852920 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:40.853911 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:40.853911 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:40.853911 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:40.853911 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:40.853911 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:40.853911 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:40.853911 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:40.853911 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:40.853911 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:40.853911 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:40.853911 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:40.853911 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:40.853911 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 275/544] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 21:52:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:40.859287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9c15b-94bc-4e68-95b4-a034db2d7618 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:40.972038 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:41.016623 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9c15b-94bc-4e68-95b4-a034db2d7618 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:41.080221 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de281c2f-fc18-4e2d-9268-c59cccb27629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:41.080911 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de281c2f-fc18-4e2d-9268-c59cccb27629 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:41.081202 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de281c2f-fc18-4e2d-9268-c59cccb27629 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:41.081482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de281c2f-fc18-4e2d-9268-c59cccb27629 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:41.082247 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de281c2f-fc18-4e2d-9268-c59cccb27629 None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:41.082560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de281c2f-fc18-4e2d-9268-c59cccb27629 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:41.083945 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de281c2f-fc18-4e2d-9268-c59cccb27629 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:41.093135 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 270/545] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 21:52:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:41.098812 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3af23d-2b5c-4590-8a6f-c186eb5cc6a8 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:41.189130 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:41.256678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3af23d-2b5c-4590-8a6f-c186eb5cc6a8 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:41.313320 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc69c8c-2d8c-4432-9ddb-3b87742c178b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:41.314162 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc69c8c-2d8c-4432-9ddb-3b87742c178b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:41.314447 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc69c8c-2d8c-4432-9ddb-3b87742c178b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:41.314725 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc69c8c-2d8c-4432-9ddb-3b87742c178b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:41.330660 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc69c8c-2d8c-4432-9ddb-3b87742c178b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:41.332072 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc69c8c-2d8c-4432-9ddb-3b87742c178b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:41.347993 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e89c7-0ed2-41e5-8d42-4adcbcbc3e8a None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:41.348524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e89c7-0ed2-41e5-8d42-4adcbcbc3e8a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:41.348598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e89c7-0ed2-41e5-8d42-4adcbcbc3e8a None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:41.350187 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 271/546] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:41.354677 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-0cc69c8c-2d8c-4432-9ddb-3b87742c178b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:41.354677 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:41.354677 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:41.354677 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:41.354677 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:41.354677 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:41.354677 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:41.354677 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:41.354677 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:41.354677 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:41.354677 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:41.354677 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:41.354677 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:41.354677 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:41.354677 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:41.355502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:41.355502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:41.355502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:41.355502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:41.355502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:41.355502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:41.355502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:41.355502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:41.355502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:41.355502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:41.355502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:41.355502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:41.355502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:41.355502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:41.355502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:41.355502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:41.355502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:41.356438 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:41.356438 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:41.356438 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:41.356438 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:41.356665 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97702e91-76a9-44e9-a6bc-237e9fd692f6 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:41.356665 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97702e91-76a9-44e9-a6bc-237e9fd692f6 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:41.356665 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97702e91-76a9-44e9-a6bc-237e9fd692f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:41.356839 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 276/547] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:41.366785 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc69c8c-2d8c-4432-9ddb-3b87742c178b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:41.387145 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-97702e91-76a9-44e9-a6bc-237e9fd692f6 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:41.388690 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-97702e91-76a9-44e9-a6bc-237e9fd692f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:41.511524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 272/548] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:52:41.552215 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97702e91-76a9-44e9-a6bc-237e9fd692f6 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:41.552421 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc69c8c-2d8c-4432-9ddb-3b87742c178b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:41.554986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:41.597321 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39551f0-9efc-4113-8d82-c518aedc2e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:41.597916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39551f0-9efc-4113-8d82-c518aedc2e0a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:41.598201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39551f0-9efc-4113-8d82-c518aedc2e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:41.598481 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39551f0-9efc-4113-8d82-c518aedc2e0a None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:41.599225 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39551f0-9efc-4113-8d82-c518aedc2e0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:41.599528 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39551f0-9efc-4113-8d82-c518aedc2e0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:41.600962 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39551f0-9efc-4113-8d82-c518aedc2e0a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:41.614403 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 277/549] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:41.625580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39551f0-9efc-4113-8d82-c518aedc2e0a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:41.655751 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:41.744279 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39551f0-9efc-4113-8d82-c518aedc2e0a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:41.744497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97702e91-76a9-44e9-a6bc-237e9fd692f6 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:41.799974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6430da0-c99e-4968-bf99-4218cb531041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:41.800819 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6430da0-c99e-4968-bf99-4218cb531041 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:41.801349 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6430da0-c99e-4968-bf99-4218cb531041 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:41.801349 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6430da0-c99e-4968-bf99-4218cb531041 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:41.820024 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6430da0-c99e-4968-bf99-4218cb531041 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:41.821537 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6430da0-c99e-4968-bf99-4218cb531041 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:41.836981 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b256f-2339-4484-b983-ace4b1da236f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:41.838635 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b256f-2339-4484-b983-ace4b1da236f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:41.839110 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b256f-2339-4484-b983-ace4b1da236f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:41.839438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b256f-2339-4484-b983-ace4b1da236f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:41.855548 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-a6430da0-c99e-4968-bf99-4218cb531041 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 21:52:41.855548 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:41.855548 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:41.855548 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:41.855548 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:41.855548 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:41.855548 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:41.855548 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:41.855548 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:41.855548 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:41.855548 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:41.855548 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:41.855548 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:52:41.855548 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:52:41.855548 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:52:41.855548 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:52:41.856643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:41.856643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:41.856643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:52:41.856643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:41.856643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:52:41.856643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:41.856643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:41.856643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:41.856643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:41.856643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:41.856643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:41.856643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:41.856643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:41.856643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:41.856643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:41.856643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:41.856643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:41.856643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:41.857519 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:41.857519 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:41.857519 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:52:41.857519 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:52:41.857519 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:52:41.857519 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:52:41.857519 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:52:41.857519 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:52:41.857519 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 21:52:41.857519 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:41.857519 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 278/550] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:52:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:41.864132 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6430da0-c99e-4968-bf99-4218cb531041 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:41.865892 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b256f-2339-4484-b983-ace4b1da236f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:41.878269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-617b256f-2339-4484-b983-ace4b1da236f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:41.878269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:41.878269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:41.878269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:41.878269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:41.878269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:41.878269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:41.878269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:41.878269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:41.878269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:41.878269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:41.878269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:41.878269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:41.878269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:41.878269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:41.878269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:41.879206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:41.879206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:41.879206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:41.879206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:41.879206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:41.879206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:41.879206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:41.879206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:41.879206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:41.879206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:41.879206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:41.879206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:41.879206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:41.879206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:41.879206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:41.879206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:41.880204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:41.880204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:41.880204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:41.880204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:41.880204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:41.880204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:41.880204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:41.880204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:41.880204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:41.880204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:41.880204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:41.880204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:41.880204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 273/551] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 21:52:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:41.888323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b256f-2339-4484-b983-ace4b1da236f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:41.930097 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:42.001975 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6430da0-c99e-4968-bf99-4218cb531041 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:42.042115 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013d1c4-15ca-48e9-bdf1-3d9a5fd77c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:42.042966 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013d1c4-15ca-48e9-bdf1-3d9a5fd77c60 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:42.043348 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013d1c4-15ca-48e9-bdf1-3d9a5fd77c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:42.043722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013d1c4-15ca-48e9-bdf1-3d9a5fd77c60 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:42.044730 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013d1c4-15ca-48e9-bdf1-3d9a5fd77c60 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:42.045203 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013d1c4-15ca-48e9-bdf1-3d9a5fd77c60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:42.046802 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013d1c4-15ca-48e9-bdf1-3d9a5fd77c60 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:42.070463 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 279/552] 10.222.0.35 () {56 vars in 1135 bytes} [Thu May 19 21:52:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:42.071594 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013d1c4-15ca-48e9-bdf1-3d9a5fd77c60 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:42.114085 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b256f-2339-4484-b983-ace4b1da236f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:42.137348 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:42.159911 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a86c5-e2d9-4b86-9e32-b12b6cb1c766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:42.160794 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a86c5-e2d9-4b86-9e32-b12b6cb1c766 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:42.161183 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a86c5-e2d9-4b86-9e32-b12b6cb1c766 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:42.161671 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a86c5-e2d9-4b86-9e32-b12b6cb1c766 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:42.165700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a86c5-e2d9-4b86-9e32-b12b6cb1c766 None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:42.165700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a86c5-e2d9-4b86-9e32-b12b6cb1c766 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:42.165700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a86c5-e2d9-4b86-9e32-b12b6cb1c766 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:42.179794 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 274/553] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 21:52:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:42.181113 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a86c5-e2d9-4b86-9e32-b12b6cb1c766 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:42.259453 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:42.282301 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013d1c4-15ca-48e9-bdf1-3d9a5fd77c60 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:42.323839 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acb96f-eb6d-449e-afca-6895355540ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:42.324687 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acb96f-eb6d-449e-afca-6895355540ba None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:42.325070 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acb96f-eb6d-449e-afca-6895355540ba None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:42.325421 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acb96f-eb6d-449e-afca-6895355540ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:42.340438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a86c5-e2d9-4b86-9e32-b12b6cb1c766 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:42.380979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1490f0-2c84-4c4b-a28e-7b726bce7c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:42.381781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1490f0-2c84-4c4b-a28e-7b726bce7c82 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:42.382069 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1490f0-2c84-4c4b-a28e-7b726bce7c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:42.382354 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1490f0-2c84-4c4b-a28e-7b726bce7c82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:42.394683 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1490f0-2c84-4c4b-a28e-7b726bce7c82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:42.396274 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1490f0-2c84-4c4b-a28e-7b726bce7c82 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:42.406041 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acb96f-eb6d-449e-afca-6895355540ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:42.407536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acb96f-eb6d-449e-afca-6895355540ba None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:42.416563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-ef1490f0-2c84-4c4b-a28e-7b726bce7c82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:42.416563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:42.416563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:42.416563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:42.416563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:42.416563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:42.416563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:42.416563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:42.416563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:42.416563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:42.416563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:42.416563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:42.416563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:42.416563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:42.416563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:42.417614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:42.417614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:42.417614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:42.417614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:42.417614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:42.417614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:42.417614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:42.417614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:42.417614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:42.417614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:42.417614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:42.417614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:42.417614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:42.417614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:42.417614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:42.417614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:42.417614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:42.418648 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:42.418648 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:42.418648 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:42.418648 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:42.422857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 275/554] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:52:42.422857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50a7dd-0e27-4ec9-bfbb-08f335392889 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:42.422857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50a7dd-0e27-4ec9-bfbb-08f335392889 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:42.422857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50a7dd-0e27-4ec9-bfbb-08f335392889 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:42.423306 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 276/555] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:42.428673 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d929e-820b-44ad-82fd-aa88f66c1b82 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:42.429077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d929e-820b-44ad-82fd-aa88f66c1b82 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:42.429452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d929e-820b-44ad-82fd-aa88f66c1b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:42.448586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-1e9d929e-820b-44ad-82fd-aa88f66c1b82 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:42.450196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1e9d929e-820b-44ad-82fd-aa88f66c1b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:42.502221 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:42.505637 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:42.525540 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 280/556] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:52:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:52:42.526596 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acb96f-eb6d-449e-afca-6895355540ba None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:42.527895 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 277/557] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:42.531989 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d929e-820b-44ad-82fd-aa88f66c1b82 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:42.641443 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acb96f-eb6d-449e-afca-6895355540ba None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:42.647974 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d929e-820b-44ad-82fd-aa88f66c1b82 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:42.683060 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d0586-a138-4dbf-ab53-f898da16cb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:42.684157 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d0586-a138-4dbf-ab53-f898da16cb8d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:42.684686 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d0586-a138-4dbf-ab53-f898da16cb8d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:42.685162 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d0586-a138-4dbf-ab53-f898da16cb8d None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:42.686126 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d0586-a138-4dbf-ab53-f898da16cb8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:42.686640 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d0586-a138-4dbf-ab53-f898da16cb8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:42.688341 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d0586-a138-4dbf-ab53-f898da16cb8d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:42.688468 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a5a46-e219-476c-a0d8-fb2947df090b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:42.689181 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a5a46-e219-476c-a0d8-fb2947df090b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:42.689469 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a5a46-e219-476c-a0d8-fb2947df090b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:42.689752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a5a46-e219-476c-a0d8-fb2947df090b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:42.701308 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a5a46-e219-476c-a0d8-fb2947df090b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:42.703020 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a5a46-e219-476c-a0d8-fb2947df090b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:42.706982 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 281/558] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:42.708031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d0586-a138-4dbf-ab53-f898da16cb8d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:42.724132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-1e0a5a46-e219-476c-a0d8-fb2947df090b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:42.724132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:42.724132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:42.724132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:42.724132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:42.724132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:42.724132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:42.724132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:42.724132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:42.724132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:42.724132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:42.724132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:42.724132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:42.724132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:42.724132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:42.725743 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:42.725743 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:42.725743 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:42.725743 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:42.725743 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:42.725743 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:42.725743 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:42.725743 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:42.725743 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:42.725743 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:42.725743 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:42.725743 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:42.725743 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:42.725743 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:42.725743 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:42.725743 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:42.725743 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:42.726592 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:42.726592 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:42.726592 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:42.726592 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:42.733865 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 278/559] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:42.735048 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a5a46-e219-476c-a0d8-fb2947df090b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:42.753060 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:42.760105 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:42.824296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d0586-a138-4dbf-ab53-f898da16cb8d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:42.856514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a5a46-e219-476c-a0d8-fb2947df090b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:42.860909 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2498a75-4d0e-41fc-9127-3958d13d02d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:42.861709 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2498a75-4d0e-41fc-9127-3958d13d02d1 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:42.861987 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2498a75-4d0e-41fc-9127-3958d13d02d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:42.862256 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2498a75-4d0e-41fc-9127-3958d13d02d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:42.875385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2498a75-4d0e-41fc-9127-3958d13d02d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:42.883063 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-a2498a75-4d0e-41fc-9127-3958d13d02d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:42.883063 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:42.883063 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:42.883063 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:42.883063 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:42.883063 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:42.883063 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:42.883063 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:42.883063 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:42.883063 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:42.883063 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:42.883063 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:42.883063 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:42.883063 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:42.883063 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:42.883063 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:42.883978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:42.883978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:42.883978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:42.883978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:42.883978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:42.883978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:42.883978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:42.883978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:42.883978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:42.883978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:42.883978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:42.883978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:42.883978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:42.883978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:42.883978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:42.883978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:42.885729 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:42.885729 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:42.885729 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:42.885729 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:42.885729 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:42.885729 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:42.885729 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:42.885729 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:42.885729 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:42.885729 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:42.885729 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:42.885729 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:42.885729 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 282/560] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 21:52:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:42.885729 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2498a75-4d0e-41fc-9127-3958d13d02d1 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:42.899558 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3c661-e1f0-439d-8a31-8b617a718b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:42.900331 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3c661-e1f0-439d-8a31-8b617a718b6c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:42.900679 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3c661-e1f0-439d-8a31-8b617a718b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:42.900936 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3c661-e1f0-439d-8a31-8b617a718b6c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:42.908308 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3c661-e1f0-439d-8a31-8b617a718b6c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:42.909791 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3c661-e1f0-439d-8a31-8b617a718b6c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:42.928378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-14e3c661-e1f0-439d-8a31-8b617a718b6c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 21:52:42.928378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:42.928378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:42.928378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:42.928378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:42.928378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:42.928378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:42.928378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:42.928378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:42.928378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:42.928378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:42.928378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:42.928378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:52:42.928378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:52:42.928378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:52:42.928378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:52:42.929404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:42.929404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:42.929404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:52:42.929404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:42.929404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:52:42.929404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:42.929404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:42.929404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:42.929404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:42.929404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:42.929404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:42.929404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:42.929404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:42.929404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:42.929404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:42.929404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:42.929404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:42.929404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:42.930306 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:42.930306 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:42.930306 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:52:42.930306 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:52:42.930306 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:52:42.930306 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:52:42.930306 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:52:42.930306 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:52:42.930306 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 21:52:42.930306 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:42.930306 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 279/561] 10.222.0.35 () {56 vars in 1093 bytes} [Thu May 19 21:52:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:42.933034 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214ed49-e938-416f-9b5a-89f239808881 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:42.933034 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214ed49-e938-416f-9b5a-89f239808881 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:42.933034 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214ed49-e938-416f-9b5a-89f239808881 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:42.934413 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 280/562] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:42.935034 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214ed49-e938-416f-9b5a-89f239808881 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:43.013481 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2498a75-4d0e-41fc-9127-3958d13d02d1 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:43.015516 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:43.022741 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:43.051781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214ed49-e938-416f-9b5a-89f239808881 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:43.052866 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de89455-0af7-4984-a164-010579ee487c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:43.053540 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de89455-0af7-4984-a164-010579ee487c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:43.053824 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de89455-0af7-4984-a164-010579ee487c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:43.054100 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de89455-0af7-4984-a164-010579ee487c None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:43.054830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de89455-0af7-4984-a164-010579ee487c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:43.055135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de89455-0af7-4984-a164-010579ee487c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:43.057161 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de89455-0af7-4984-a164-010579ee487c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:43.069904 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 283/563] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:43.070741 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de89455-0af7-4984-a164-010579ee487c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:43.097922 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f3db3-932b-4bd8-827b-cbb80eeef64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:43.098596 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f3db3-932b-4bd8-827b-cbb80eeef64c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:43.098882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f3db3-932b-4bd8-827b-cbb80eeef64c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:43.099154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f3db3-932b-4bd8-827b-cbb80eeef64c None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:43.099931 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f3db3-932b-4bd8-827b-cbb80eeef64c None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:43.100203 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f3db3-932b-4bd8-827b-cbb80eeef64c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:43.101946 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f3db3-932b-4bd8-827b-cbb80eeef64c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:43.110515 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 281/564] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 21:52:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:43.116618 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450b563-bfc0-421d-b7c4-4818f556c9e5 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:43.116618 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450b563-bfc0-421d-b7c4-4818f556c9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:43.117128 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450b563-bfc0-421d-b7c4-4818f556c9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:43.143561 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-2450b563-bfc0-421d-b7c4-4818f556c9e5 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:43.144798 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2450b563-bfc0-421d-b7c4-4818f556c9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:43.196589 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de89455-0af7-4984-a164-010579ee487c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:43.217869 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 282/565] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:43.221647 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450b563-bfc0-421d-b7c4-4818f556c9e5 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:43.243030 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce6031-1d3f-4d32-a856-a63ba16f5652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:43.243750 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce6031-1d3f-4d32-a856-a63ba16f5652 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:43.244105 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce6031-1d3f-4d32-a856-a63ba16f5652 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:43.244389 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce6031-1d3f-4d32-a856-a63ba16f5652 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:43.245300 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce6031-1d3f-4d32-a856-a63ba16f5652 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:43.245614 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce6031-1d3f-4d32-a856-a63ba16f5652 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:43.247111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce6031-1d3f-4d32-a856-a63ba16f5652 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:43.268436 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 284/566] 10.222.0.35 () {56 vars in 1133 bytes} [Thu May 19 21:52:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:43.273497 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce6031-1d3f-4d32-a856-a63ba16f5652 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:43.301351 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:43.307510 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:43.352981 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450b563-bfc0-421d-b7c4-4818f556c9e5 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:43.402515 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da00485-b705-4124-8ecf-cd2ffe6cc226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:43.403321 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da00485-b705-4124-8ecf-cd2ffe6cc226 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:43.403610 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da00485-b705-4124-8ecf-cd2ffe6cc226 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:43.403887 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da00485-b705-4124-8ecf-cd2ffe6cc226 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:43.407941 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce6031-1d3f-4d32-a856-a63ba16f5652 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:43.410922 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da00485-b705-4124-8ecf-cd2ffe6cc226 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:43.412379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da00485-b705-4124-8ecf-cd2ffe6cc226 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:43.426425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-2da00485-b705-4124-8ecf-cd2ffe6cc226 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:43.426425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:43.426425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:43.426425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:43.426425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:43.426425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:43.426425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:43.426425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:43.426425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:43.426425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:43.426425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:43.426425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:43.426425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:52:43.426425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:52:43.426425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:52:43.427326 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:52:43.427326 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:43.427326 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:43.427326 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:43.427326 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:43.427326 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:43.427326 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:43.427326 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:43.427326 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:43.427326 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:43.427326 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:43.427326 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:43.427326 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:43.427326 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:43.427326 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:43.427326 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:43.427326 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:43.428187 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:52:43.428187 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:52:43.428187 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:52:43.428187 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:52:43.428187 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:52:43.428187 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:52:43.428187 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:43.428187 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:43.428187 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 283/567] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:52:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:43.428694 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da00485-b705-4124-8ecf-cd2ffe6cc226 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:43.452055 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d21773-d50a-47b9-aa21-317c7d3e54a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:43.452923 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d21773-d50a-47b9-aa21-317c7d3e54a1 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:43.453205 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d21773-d50a-47b9-aa21-317c7d3e54a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:43.453479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d21773-d50a-47b9-aa21-317c7d3e54a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:43.464812 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d21773-d50a-47b9-aa21-317c7d3e54a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:43.466267 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d21773-d50a-47b9-aa21-317c7d3e54a1 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:43.484064 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-a5d21773-d50a-47b9-aa21-317c7d3e54a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:43.484064 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:43.484064 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:43.484064 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:43.484064 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:43.484064 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:43.484064 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:43.484064 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:43.484064 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:43.484064 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:43.484064 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:43.484064 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:43.484064 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:43.484064 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:43.484064 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:43.485193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:43.485193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:43.485193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:43.485193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:43.485193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:43.485193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:43.485193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:43.485193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:43.485193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:43.485193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:43.485193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:43.485193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:43.485193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:43.485193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:43.485193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:43.485193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:43.485193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:43.486072 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:43.486072 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:43.486072 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:43.486072 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:43.486072 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 285/568] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:43.486072 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d21773-d50a-47b9-aa21-317c7d3e54a1 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:43.542855 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da00485-b705-4124-8ecf-cd2ffe6cc226 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:43.561575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:43.571376 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:43.581214 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d1dbe-4b5e-48a8-b76b-742ffba44fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:43.582019 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d1dbe-4b5e-48a8-b76b-742ffba44fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:43.582298 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d1dbe-4b5e-48a8-b76b-742ffba44fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:43.582568 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d1dbe-4b5e-48a8-b76b-742ffba44fc8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:43.593857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d1dbe-4b5e-48a8-b76b-742ffba44fc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:43.595553 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d21773-d50a-47b9-aa21-317c7d3e54a1 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:43.601615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-965d1dbe-4b5e-48a8-b76b-742ffba44fc8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:43.601615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:43.601615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:43.601615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:43.601615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:43.601615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:43.601615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:43.601615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:43.601615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:43.601615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:43.601615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:43.601615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:43.601615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:43.601615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:43.601615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:43.601615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:43.602729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:43.602729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:43.602729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:43.602729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:43.602729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:43.602729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:43.602729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:43.602729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:43.602729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:43.602729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:43.602729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:43.602729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:43.602729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:43.602729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:43.602729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:43.602729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:43.604116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:43.604116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:43.604116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:43.604116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:43.604116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:43.604116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:43.604116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:43.604116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:43.604116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:43.604116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:43.604116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:43.604116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:43.604116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 284/569] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 21:52:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:43.605276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d1dbe-4b5e-48a8-b76b-742ffba44fc8 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:43.634511 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef9dae-dbf7-4aed-813e-086adce6edbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:43.635915 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef9dae-dbf7-4aed-813e-086adce6edbb None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:43.636143 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef9dae-dbf7-4aed-813e-086adce6edbb None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:43.636439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef9dae-dbf7-4aed-813e-086adce6edbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:43.647150 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef9dae-dbf7-4aed-813e-086adce6edbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:43.648735 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef9dae-dbf7-4aed-813e-086adce6edbb None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:43.669877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-73ef9dae-dbf7-4aed-813e-086adce6edbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:43.669877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:43.669877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:43.669877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:43.669877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:43.669877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:43.669877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:43.669877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:43.669877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:43.669877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:43.669877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:43.669877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:43.669877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:43.669877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:43.669877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:43.670836 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:43.670836 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:43.670836 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:43.670836 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:43.670836 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:43.670836 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:43.670836 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:43.670836 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:43.670836 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:43.670836 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:43.670836 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:43.670836 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:43.670836 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:43.670836 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:43.670836 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:43.670836 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:43.670836 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:43.671683 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:43.671683 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:43.671683 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:43.671683 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:43.671683 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 286/570] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:43.672627 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3368b-a310-4fd9-b881-cb36388deab2 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:43.672732 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3368b-a310-4fd9-b881-cb36388deab2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:43.672931 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3368b-a310-4fd9-b881-cb36388deab2 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:43.674183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 287/571] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:43.676559 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3368b-a310-4fd9-b881-cb36388deab2 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:43.720605 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d1dbe-4b5e-48a8-b76b-742ffba44fc8 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:43.755089 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb72bd4-c9c9-49db-b464-617848445ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:43.755763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb72bd4-c9c9-49db-b464-617848445ffb None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:43.756041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb72bd4-c9c9-49db-b464-617848445ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:43.756317 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb72bd4-c9c9-49db-b464-617848445ffb None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:43.757146 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb72bd4-c9c9-49db-b464-617848445ffb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:43.757457 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb72bd4-c9c9-49db-b464-617848445ffb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:43.758924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb72bd4-c9c9-49db-b464-617848445ffb None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:43.773300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 285/572] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:52:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:43.774149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb72bd4-c9c9-49db-b464-617848445ffb None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:43.784175 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3368b-a310-4fd9-b881-cb36388deab2 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:43.810487 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:43.822342 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45011151-956b-4a8b-9107-13ece21f6c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:43.823234 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45011151-956b-4a8b-9107-13ece21f6c72 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:43.823502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45011151-956b-4a8b-9107-13ece21f6c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:43.823732 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45011151-956b-4a8b-9107-13ece21f6c72 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:43.824504 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45011151-956b-4a8b-9107-13ece21f6c72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:43.824625 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:43.824855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45011151-956b-4a8b-9107-13ece21f6c72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:43.826512 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45011151-956b-4a8b-9107-13ece21f6c72 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:43.839164 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 288/573] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:43.839980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45011151-956b-4a8b-9107-13ece21f6c72 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:43.880561 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb72bd4-c9c9-49db-b464-617848445ffb None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:43.921400 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9053066-d9ec-4c17-9d03-affab9c4a4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:43.922096 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9053066-d9ec-4c17-9d03-affab9c4a4db None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:43.922350 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9053066-d9ec-4c17-9d03-affab9c4a4db None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:43.922622 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9053066-d9ec-4c17-9d03-affab9c4a4db None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:43.923364 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9053066-d9ec-4c17-9d03-affab9c4a4db None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:43.923664 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9053066-d9ec-4c17-9d03-affab9c4a4db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:43.925066 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9053066-d9ec-4c17-9d03-affab9c4a4db None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:43.933150 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 286/574] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 21:52:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:43.934483 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701f867-7e38-41be-a663-a38d50709182 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:43.934767 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701f867-7e38-41be-a663-a38d50709182 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:43.935175 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701f867-7e38-41be-a663-a38d50709182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:43.949539 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45011151-956b-4a8b-9107-13ece21f6c72 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:43.951600 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-7701f867-7e38-41be-a663-a38d50709182 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:43.952830 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7701f867-7e38-41be-a663-a38d50709182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:43.985421 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86ef0a-3730-4ef6-8a45-fab1d0c9b151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:43.986005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86ef0a-3730-4ef6-8a45-fab1d0c9b151 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:43.986287 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86ef0a-3730-4ef6-8a45-fab1d0c9b151 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:43.986564 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86ef0a-3730-4ef6-8a45-fab1d0c9b151 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:43.987292 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86ef0a-3730-4ef6-8a45-fab1d0c9b151 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:43.987596 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86ef0a-3730-4ef6-8a45-fab1d0c9b151 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:43.989005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86ef0a-3730-4ef6-8a45-fab1d0c9b151 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:44.001498 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 289/575] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:44.002302 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86ef0a-3730-4ef6-8a45-fab1d0c9b151 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:44.035351 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 287/576] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:44.036215 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701f867-7e38-41be-a663-a38d50709182 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:44.051420 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:44.082516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:44.112576 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86ef0a-3730-4ef6-8a45-fab1d0c9b151 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:44.153349 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ad688-ff71-4c6d-bc2b-9feb1ae9278d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:44.154007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ad688-ff71-4c6d-bc2b-9feb1ae9278d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:44.154289 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ad688-ff71-4c6d-bc2b-9feb1ae9278d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:44.154567 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ad688-ff71-4c6d-bc2b-9feb1ae9278d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:44.155469 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ad688-ff71-4c6d-bc2b-9feb1ae9278d None admin] RBAC: Adding query filter params (role.id=372e9dc71b5a4a4daddc43ab384fa67b, scope.project.id=89b20e18525c473e94a2b263148f1f5f, user.id=86a4208619f84f16b735871ee114e660) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:44.155674 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701f867-7e38-41be-a663-a38d50709182 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:44.155826 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ad688-ff71-4c6d-bc2b-9feb1ae9278d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:44.157174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ad688-ff71-4c6d-bc2b-9feb1ae9278d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:44.162722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 290/577] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:52:44 2022] GET /identity/v3/role_assignments?user.id=86a4208619f84f16b735871ee114e660&scope.project.id=89b20e18525c473e94a2b263148f1f5f&role.id=372e9dc71b5a4a4daddc43ab384fa67b => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:44.163572 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ad688-ff71-4c6d-bc2b-9feb1ae9278d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:44.209740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc95097-d047-4e5b-884f-6adc59674a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:44.210705 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc95097-d047-4e5b-884f-6adc59674a4f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:44.210994 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc95097-d047-4e5b-884f-6adc59674a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:44.211330 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc95097-d047-4e5b-884f-6adc59674a4f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:44.221079 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc95097-d047-4e5b-884f-6adc59674a4f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:44.222654 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc95097-d047-4e5b-884f-6adc59674a4f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:44.240338 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-1dc95097-d047-4e5b-884f-6adc59674a4f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 21:52:44.240338 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:44.240338 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:44.240338 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:44.240338 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:44.240338 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:44.240338 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:44.240338 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:44.240338 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:44.240338 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:44.240338 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:44.240338 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:44.240338 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:52:44.240338 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:52:44.240338 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:52:44.240338 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:52:44.241512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:44.241512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:44.241512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:52:44.241512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:44.241512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:52:44.241512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:44.241512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:44.241512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:44.241512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:44.241512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:44.241512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:44.241512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:44.241512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:44.241512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:44.241512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:44.241512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:44.241512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:44.241512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:44.242432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:44.242432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:44.242432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:52:44.242432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:52:44.242432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:52:44.242432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:52:44.242432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:52:44.242432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:52:44.242432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 21:52:44.242432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:44.242432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 288/578] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:52:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:44.243019 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc95097-d047-4e5b-884f-6adc59674a4f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:44.309506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ad688-ff71-4c6d-bc2b-9feb1ae9278d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:44.319860 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:44.357316 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537fa99-110c-4a79-a8be-e4e521c518c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:44.358122 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537fa99-110c-4a79-a8be-e4e521c518c8 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:44.358978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537fa99-110c-4a79-a8be-e4e521c518c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:44.358978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537fa99-110c-4a79-a8be-e4e521c518c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:44.371843 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:44.375972 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537fa99-110c-4a79-a8be-e4e521c518c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:44.377518 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537fa99-110c-4a79-a8be-e4e521c518c8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:44.379553 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc95097-d047-4e5b-884f-6adc59674a4f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:44.399573 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-6537fa99-110c-4a79-a8be-e4e521c518c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:44.399573 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:44.399573 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:44.399573 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:44.399573 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:44.399573 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:44.399573 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:44.399573 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:44.399573 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:44.399573 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:44.399573 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:44.399573 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:44.399573 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:44.399573 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:44.399573 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:44.401199 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:44.401199 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:44.401199 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:44.401199 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:44.401199 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:44.401199 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:44.401199 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:44.401199 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:44.401199 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:44.401199 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:44.401199 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:44.401199 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:44.401199 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:44.401199 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:44.401199 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:44.401199 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:44.401199 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:44.402067 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:44.402067 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:44.402067 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:44.402067 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:44.402067 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 291/579] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:44.402353 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537fa99-110c-4a79-a8be-e4e521c518c8 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:44.425424 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531a0e9-f308-4020-8129-0e42462b3d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:44.426169 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531a0e9-f308-4020-8129-0e42462b3d58 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:44.426618 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531a0e9-f308-4020-8129-0e42462b3d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:44.426618 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531a0e9-f308-4020-8129-0e42462b3d58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:44.435219 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531a0e9-f308-4020-8129-0e42462b3d58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:44.437129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531a0e9-f308-4020-8129-0e42462b3d58 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:44.451607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-7531a0e9-f308-4020-8129-0e42462b3d58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:44.451607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:44.451607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:44.451607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:44.451607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:44.451607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:44.451607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:44.451607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:44.451607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:44.451607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:44.451607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:44.451607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:44.451607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:52:44.451607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:52:44.451607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:52:44.452582 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:52:44.452582 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:44.452582 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:44.452582 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:44.452582 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:44.452582 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:44.452582 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:44.452582 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:44.452582 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:44.452582 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:44.452582 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:44.452582 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:44.452582 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:44.452582 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:44.452582 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:44.452582 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:44.452582 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:44.453466 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:52:44.453466 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:52:44.453466 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:52:44.453466 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:52:44.453466 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:52:44.453466 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:52:44.453466 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:44.453466 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:44.453466 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 289/580] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:52:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:44.453951 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531a0e9-f308-4020-8129-0e42462b3d58 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:44.537867 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537fa99-110c-4a79-a8be-e4e521c518c8 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:44.575940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429c3bd-b8aa-4b73-bd26-693adbf4020f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:44.577214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429c3bd-b8aa-4b73-bd26-693adbf4020f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:44.577613 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429c3bd-b8aa-4b73-bd26-693adbf4020f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:44.577893 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429c3bd-b8aa-4b73-bd26-693adbf4020f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:44.588615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531a0e9-f308-4020-8129-0e42462b3d58 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:44.595021 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429c3bd-b8aa-4b73-bd26-693adbf4020f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:44.604044 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-5429c3bd-b8aa-4b73-bd26-693adbf4020f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:44.604044 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:44.604044 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:44.604044 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:44.604044 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:44.604044 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:44.604044 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:44.604044 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:44.604044 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:44.604044 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:44.604044 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:44.604044 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:44.604044 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:44.604044 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:44.604044 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:44.604044 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:44.605186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:44.605186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:44.605186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:44.605186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:44.605186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:44.605186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:44.605186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:44.605186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:44.605186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:44.605186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:44.605186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:44.605186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:44.605186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:44.605186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:44.605186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:44.605186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:44.605994 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:44.605994 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:44.605994 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:44.605994 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:44.605994 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:44.605994 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:44.605994 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:44.605994 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:44.605994 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:44.605994 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:44.605994 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:44.605994 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:44.605994 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 292/581] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 21:52:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:44.606665 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429c3bd-b8aa-4b73-bd26-693adbf4020f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:44.634366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:44.636798 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac5a0f-1740-45dc-8764-b616ef76f530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:44.637902 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac5a0f-1740-45dc-8764-b616ef76f530 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:44.638196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac5a0f-1740-45dc-8764-b616ef76f530 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:44.638470 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac5a0f-1740-45dc-8764-b616ef76f530 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:44.639525 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac5a0f-1740-45dc-8764-b616ef76f530 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:44.640282 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac5a0f-1740-45dc-8764-b616ef76f530 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:44.642135 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac5a0f-1740-45dc-8764-b616ef76f530 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:44.664738 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 290/582] 10.222.0.35 () {56 vars in 1137 bytes} [Thu May 19 21:52:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:44.665692 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac5a0f-1740-45dc-8764-b616ef76f530 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:44.688320 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:44.735305 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429c3bd-b8aa-4b73-bd26-693adbf4020f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:44.777724 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648ba8e-d539-4bc2-8f9e-37fb364b35f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:44.778480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648ba8e-d539-4bc2-8f9e-37fb364b35f9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:44.778687 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648ba8e-d539-4bc2-8f9e-37fb364b35f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:44.778969 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648ba8e-d539-4bc2-8f9e-37fb364b35f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:44.779707 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648ba8e-d539-4bc2-8f9e-37fb364b35f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:44.780015 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648ba8e-d539-4bc2-8f9e-37fb364b35f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:44.781444 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648ba8e-d539-4bc2-8f9e-37fb364b35f9 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:44.783234 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac5a0f-1740-45dc-8764-b616ef76f530 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:44.795551 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 293/583] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:44.797360 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648ba8e-d539-4bc2-8f9e-37fb364b35f9 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:44.826315 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ad965-5a31-4ca0-8d3d-8aeb61d0cac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:44.826970 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ad965-5a31-4ca0-8d3d-8aeb61d0cac8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:44.827293 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ad965-5a31-4ca0-8d3d-8aeb61d0cac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:44.827517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ad965-5a31-4ca0-8d3d-8aeb61d0cac8 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:44.828293 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ad965-5a31-4ca0-8d3d-8aeb61d0cac8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:44.828632 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ad965-5a31-4ca0-8d3d-8aeb61d0cac8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:44.830060 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ad965-5a31-4ca0-8d3d-8aeb61d0cac8 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:44.842498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 291/584] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:52:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:44.846538 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ad965-5a31-4ca0-8d3d-8aeb61d0cac8 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:44.888439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:44.910547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648ba8e-d539-4bc2-8f9e-37fb364b35f9 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:44.934593 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:44.949936 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f9b92-d30d-4b1b-b4f1-d4e8e4f09bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:44.950618 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f9b92-d30d-4b1b-b4f1-d4e8e4f09bdc None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:44.950902 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f9b92-d30d-4b1b-b4f1-d4e8e4f09bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:44.951245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f9b92-d30d-4b1b-b4f1-d4e8e4f09bdc None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:44.952013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f9b92-d30d-4b1b-b4f1-d4e8e4f09bdc None admin] RBAC: Adding query filter params (name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:44.952374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f9b92-d30d-4b1b-b4f1-d4e8e4f09bdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:44.953830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f9b92-d30d-4b1b-b4f1-d4e8e4f09bdc None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:44.962359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ad965-5a31-4ca0-8d3d-8aeb61d0cac8 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:44.967833 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 294/585] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 21:52:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:44.967833 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f9b92-d30d-4b1b-b4f1-d4e8e4f09bdc None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:45.010246 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c08b9-837c-4937-a662-f429d4fa586a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:45.011148 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c08b9-837c-4937-a662-f429d4fa586a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:45.011421 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c08b9-837c-4937-a662-f429d4fa586a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:45.011691 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c08b9-837c-4937-a662-f429d4fa586a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:45.022994 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c08b9-837c-4937-a662-f429d4fa586a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:45.024480 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c08b9-837c-4937-a662-f429d4fa586a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:45.042777 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-dd8c08b9-837c-4937-a662-f429d4fa586a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:45.042777 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:45.042777 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:45.042777 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:45.042777 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:45.042777 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:45.042777 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:45.042777 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:45.042777 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:45.042777 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:45.042777 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:45.042777 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:45.042777 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:45.042777 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:45.042777 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:45.043686 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:45.043686 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:45.043686 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:45.043686 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:45.043686 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:45.043686 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:45.043686 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:45.043686 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:45.043686 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:45.043686 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:45.043686 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:45.043686 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:45.043686 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:45.043686 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:45.043686 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:45.043686 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:45.043686 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:45.044566 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:45.044566 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:45.044566 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:45.044566 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:45.044566 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 292/586] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:45.044841 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c08b9-837c-4937-a662-f429d4fa586a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:45.088274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f9b92-d30d-4b1b-b4f1-d4e8e4f09bdc None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:45.124833 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66990ccd-4016-4301-b371-27eaeffafbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:45.125594 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66990ccd-4016-4301-b371-27eaeffafbdf None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:45.125877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66990ccd-4016-4301-b371-27eaeffafbdf None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:45.126235 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66990ccd-4016-4301-b371-27eaeffafbdf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:45.135202 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66990ccd-4016-4301-b371-27eaeffafbdf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:45.136851 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66990ccd-4016-4301-b371-27eaeffafbdf None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:45.151983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-66990ccd-4016-4301-b371-27eaeffafbdf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 21:52:45.151983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:45.151983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:45.151983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:45.151983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:45.151983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:45.151983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:45.151983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:45.151983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:45.151983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:45.151983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:45.151983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:45.151983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:52:45.151983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:52:45.151983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:52:45.151983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:52:45.152945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:45.152945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:45.152945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:52:45.152945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:45.152945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:52:45.152945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:45.152945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:45.152945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:45.152945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:45.152945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:45.152945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:45.152945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:45.152945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:45.152945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:45.152945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:45.152945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:45.152945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:45.152945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:45.153830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:45.153830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:45.153830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:52:45.153830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:52:45.153830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:52:45.153830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:52:45.153830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:52:45.153830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:52:45.153830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 21:52:45.153830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:45.153830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 295/587] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:52:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:45.154404 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66990ccd-4016-4301-b371-27eaeffafbdf None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:45.159443 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:45.175399 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c08b9-837c-4937-a662-f429d4fa586a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:45.203600 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:45.213278 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3981921-27c1-4d0a-b0fc-8243dce4fddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:45.214815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3981921-27c1-4d0a-b0fc-8243dce4fddc None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:45.214815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3981921-27c1-4d0a-b0fc-8243dce4fddc None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:45.214815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3981921-27c1-4d0a-b0fc-8243dce4fddc None admin] PATH_INFO: `/v3/projects/89b20e18525c473e94a2b263148f1f5f/users/902ca8f1d59547a0ab187b4748311f58/roles/372e9dc71b5a4a4daddc43ab384fa67b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:45.232327 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3981921-27c1-4d0a-b0fc-8243dce4fddc None admin] RBAC: Authorizing `identity:create_grant(project_id=89b20e18525c473e94a2b263148f1f5f, user_id=902ca8f1d59547a0ab187b4748311f58, role_id=372e9dc71b5a4a4daddc43ab384fa67b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:45.233924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3981921-27c1-4d0a-b0fc-8243dce4fddc None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:45.250941 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 293/588] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 21:52:45 2022] PUT /identity/v3/projects/89b20e18525c473e94a2b263148f1f5f/users/902ca8f1d59547a0ab187b4748311f58/roles/372e9dc71b5a4a4daddc43ab384fa67b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:52:45.251565 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3981921-27c1-4d0a-b0fc-8243dce4fddc None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:45.299680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66990ccd-4016-4301-b371-27eaeffafbdf None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:45.349391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2880eb-1cbd-436a-8dda-42ecd461cdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:45.350612 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2880eb-1cbd-436a-8dda-42ecd461cdb5 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:45.351130 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2880eb-1cbd-436a-8dda-42ecd461cdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:45.351629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2880eb-1cbd-436a-8dda-42ecd461cdb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:45.378359 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2880eb-1cbd-436a-8dda-42ecd461cdb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:45.380515 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2880eb-1cbd-436a-8dda-42ecd461cdb5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:45.390512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3981921-27c1-4d0a-b0fc-8243dce4fddc None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:45.401807 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-fe2880eb-1cbd-436a-8dda-42ecd461cdb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:45.401807 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:45.401807 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:45.401807 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:45.401807 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:45.401807 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:45.401807 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:45.401807 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:45.401807 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:45.401807 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:45.401807 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:45.401807 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:45.401807 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:45.401807 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:45.401807 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:45.402763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:45.402763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:45.402763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:45.402763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:45.402763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:45.402763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:45.402763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:45.402763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:45.402763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:45.402763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:45.402763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:45.402763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:45.402763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:45.402763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:45.402763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:45.402763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:45.402763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:45.403709 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:45.403709 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:45.403709 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:45.403709 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:45.406314 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 296/589] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:45.407550 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2880eb-1cbd-436a-8dda-42ecd461cdb5 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:45.444754 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d527ff-609d-4cc8-b772-e27507b62fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:45.445475 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d527ff-609d-4cc8-b772-e27507b62fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:45.445794 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d527ff-609d-4cc8-b772-e27507b62fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:45.446080 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d527ff-609d-4cc8-b772-e27507b62fe6 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:45.447982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d527ff-609d-4cc8-b772-e27507b62fe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:45.448260 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d527ff-609d-4cc8-b772-e27507b62fe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:45.450056 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d527ff-609d-4cc8-b772-e27507b62fe6 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:45.475591 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 294/590] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:45.475591 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d527ff-609d-4cc8-b772-e27507b62fe6 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:45.496381 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:45.528441 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:45.556200 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2880eb-1cbd-436a-8dda-42ecd461cdb5 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:45.607731 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d527ff-609d-4cc8-b772-e27507b62fe6 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:45.607917 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d99f0a-3e85-4f73-a6f6-6c64c01819fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:45.608881 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d99f0a-3e85-4f73-a6f6-6c64c01819fc None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:45.609255 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d99f0a-3e85-4f73-a6f6-6c64c01819fc None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:45.609600 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d99f0a-3e85-4f73-a6f6-6c64c01819fc None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:45.610819 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d99f0a-3e85-4f73-a6f6-6c64c01819fc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:45.612134 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d99f0a-3e85-4f73-a6f6-6c64c01819fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:45.613901 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d99f0a-3e85-4f73-a6f6-6c64c01819fc None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:45.640500 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 297/591] 10.222.0.35 () {56 vars in 1137 bytes} [Thu May 19 21:52:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:45.644437 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d99f0a-3e85-4f73-a6f6-6c64c01819fc None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:45.657655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7637d48-dc8d-4295-8f05-e9a42d0a229f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:45.658637 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7637d48-dc8d-4295-8f05-e9a42d0a229f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:45.659107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7637d48-dc8d-4295-8f05-e9a42d0a229f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:45.659563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7637d48-dc8d-4295-8f05-e9a42d0a229f None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:45.660544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7637d48-dc8d-4295-8f05-e9a42d0a229f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:45.661037 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7637d48-dc8d-4295-8f05-e9a42d0a229f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:45.662615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7637d48-dc8d-4295-8f05-e9a42d0a229f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:45.687780 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 295/592] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:45.689025 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7637d48-dc8d-4295-8f05-e9a42d0a229f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:45.787375 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d99f0a-3e85-4f73-a6f6-6c64c01819fc None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:45.801167 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:45.805828 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7637d48-dc8d-4295-8f05-e9a42d0a229f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:45.807409 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:45.832980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4bfe3-1d06-4180-8cad-9245932bf7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:45.834302 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4bfe3-1d06-4180-8cad-9245932bf7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:45.834818 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4bfe3-1d06-4180-8cad-9245932bf7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:45.835555 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4bfe3-1d06-4180-8cad-9245932bf7f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:45.847414 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4bfe3-1d06-4180-8cad-9245932bf7f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:45.849316 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4bfe3-1d06-4180-8cad-9245932bf7f1 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:45.850802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3409adb-0a05-4d42-95cf-b809e8b5c023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:45.851621 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3409adb-0a05-4d42-95cf-b809e8b5c023 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:45.852064 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3409adb-0a05-4d42-95cf-b809e8b5c023 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:45.852351 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3409adb-0a05-4d42-95cf-b809e8b5c023 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:45.864327 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3409adb-0a05-4d42-95cf-b809e8b5c023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:45.866005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-d9a4bfe3-1d06-4180-8cad-9245932bf7f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:45.866005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:45.866005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:45.866005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:45.866005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:45.866005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:45.866005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:45.866005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:45.866005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:45.866005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:45.866005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:45.866005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:45.866005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:52:45.866005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:52:45.866005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:52:45.866832 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:52:45.866832 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:45.866832 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:45.866832 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:45.866832 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:45.866832 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:45.866832 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:45.866832 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:45.866832 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:45.866832 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:45.866832 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:45.866832 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:45.866832 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:45.866832 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:45.866832 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:45.866832 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:45.866832 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:45.867690 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:52:45.867690 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:52:45.867690 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:52:45.867690 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:52:45.867690 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:52:45.867690 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:52:45.867690 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:45.867690 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:45.868103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3409adb-0a05-4d42-95cf-b809e8b5c023 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:45.871267 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 298/593] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:52:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:45.877787 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4bfe3-1d06-4180-8cad-9245932bf7f1 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:45.904907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-d3409adb-0a05-4d42-95cf-b809e8b5c023 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:45.904907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:45.904907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:45.904907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:45.904907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:45.904907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:45.904907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:45.904907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:45.904907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:45.904907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:45.904907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:45.904907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:45.904907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:45.904907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:45.904907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:45.905860 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:45.905860 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:45.905860 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:45.905860 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:45.905860 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:45.905860 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:45.905860 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:45.905860 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:45.905860 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:45.905860 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:45.905860 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:45.905860 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:45.905860 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:45.905860 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:45.905860 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:45.905860 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:45.905860 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:45.911360 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:45.911360 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:45.911360 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:45.911360 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:45.911360 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 296/594] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:45.911360 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3409adb-0a05-4d42-95cf-b809e8b5c023 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:46.031149 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4bfe3-1d06-4180-8cad-9245932bf7f1 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:46.053463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3409adb-0a05-4d42-95cf-b809e8b5c023 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:46.077411 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12226cd9-e55d-4286-97b8-5ee25ebde16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:46.078607 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12226cd9-e55d-4286-97b8-5ee25ebde16b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:46.079095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12226cd9-e55d-4286-97b8-5ee25ebde16b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:46.079573 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12226cd9-e55d-4286-97b8-5ee25ebde16b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:46.089038 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12226cd9-e55d-4286-97b8-5ee25ebde16b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:46.090804 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12226cd9-e55d-4286-97b8-5ee25ebde16b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:46.092478 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63a616-f56e-4e39-a536-09aba8562451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:46.093263 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63a616-f56e-4e39-a536-09aba8562451 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:46.093555 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63a616-f56e-4e39-a536-09aba8562451 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:46.093835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63a616-f56e-4e39-a536-09aba8562451 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:46.094995 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63a616-f56e-4e39-a536-09aba8562451 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:46.094995 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63a616-f56e-4e39-a536-09aba8562451 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:46.096585 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63a616-f56e-4e39-a536-09aba8562451 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:46.109174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-12226cd9-e55d-4286-97b8-5ee25ebde16b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 21:52:46.109174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:46.109174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:46.109174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:46.109174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:46.109174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:46.109174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:46.109174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:46.109174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:46.109174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:46.109174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:46.109174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:46.109174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:52:46.109174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:52:46.109174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:52:46.109174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:52:46.110166 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:46.110166 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:46.110166 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:52:46.110166 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:46.110166 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:52:46.110166 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:46.110166 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:46.110166 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:46.110166 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:46.110166 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:46.110166 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:46.110166 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:46.110166 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:46.110166 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:46.110166 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:46.110166 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:46.110166 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:46.110166 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:46.116344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:46.116344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:46.116344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:52:46.116344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:52:46.116344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:52:46.116344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:52:46.116344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:52:46.116344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:52:46.116344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 21:52:46.116344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:46.116926 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 297/595] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:52:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:46.116926 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63a616-f56e-4e39-a536-09aba8562451 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:46.119146 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 299/596] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 21:52:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:46.120291 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12226cd9-e55d-4286-97b8-5ee25ebde16b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:46.125957 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:46.163381 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:46.235973 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63a616-f56e-4e39-a536-09aba8562451 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:46.244638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12226cd9-e55d-4286-97b8-5ee25ebde16b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:46.276323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff259a-726b-4073-8110-b7096a67353e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:46.277032 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff259a-726b-4073-8110-b7096a67353e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:46.277328 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff259a-726b-4073-8110-b7096a67353e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:46.277594 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff259a-726b-4073-8110-b7096a67353e None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:46.278373 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff259a-726b-4073-8110-b7096a67353e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:46.278685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff259a-726b-4073-8110-b7096a67353e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:46.280293 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff259a-726b-4073-8110-b7096a67353e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:46.285508 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8d66c-cb58-4a8c-a6e4-6b3b0a0108f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:46.286673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8d66c-cb58-4a8c-a6e4-6b3b0a0108f0 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:46.287160 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8d66c-cb58-4a8c-a6e4-6b3b0a0108f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:46.287741 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8d66c-cb58-4a8c-a6e4-6b3b0a0108f0 None admin] PATH_INFO: `/v3/projects/89b20e18525c473e94a2b263148f1f5f/users/bf64f4ec145742d78eee6c4a447515dc/roles/372e9dc71b5a4a4daddc43ab384fa67b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:46.298310 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 298/597] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:46.298310 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff259a-726b-4073-8110-b7096a67353e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:46.313375 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8d66c-cb58-4a8c-a6e4-6b3b0a0108f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=89b20e18525c473e94a2b263148f1f5f, user_id=bf64f4ec145742d78eee6c4a447515dc, role_id=372e9dc71b5a4a4daddc43ab384fa67b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:46.315656 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8d66c-cb58-4a8c-a6e4-6b3b0a0108f0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:46.332873 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 300/598] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 21:52:46 2022] PUT /identity/v3/projects/89b20e18525c473e94a2b263148f1f5f/users/bf64f4ec145742d78eee6c4a447515dc/roles/372e9dc71b5a4a4daddc43ab384fa67b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:52:46.334413 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8d66c-cb58-4a8c-a6e4-6b3b0a0108f0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:46.382938 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:46.421058 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff259a-726b-4073-8110-b7096a67353e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:46.443256 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:46.465001 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00aaee-0521-44f6-8d7a-8c89597d0f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:46.466292 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00aaee-0521-44f6-8d7a-8c89597d0f34 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:46.466799 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00aaee-0521-44f6-8d7a-8c89597d0f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:46.467351 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00aaee-0521-44f6-8d7a-8c89597d0f34 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:46.468475 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00aaee-0521-44f6-8d7a-8c89597d0f34 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:46.468722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8d66c-cb58-4a8c-a6e4-6b3b0a0108f0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:46.469178 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00aaee-0521-44f6-8d7a-8c89597d0f34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:46.470944 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00aaee-0521-44f6-8d7a-8c89597d0f34 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:46.492519 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 299/599] 10.222.0.35 () {56 vars in 1139 bytes} [Thu May 19 21:52:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:46.500439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00aaee-0521-44f6-8d7a-8c89597d0f34 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:46.516533 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a81f56-57e8-4f72-aac4-61229751f483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:46.517525 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a81f56-57e8-4f72-aac4-61229751f483 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:46.517875 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a81f56-57e8-4f72-aac4-61229751f483 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:46.518282 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a81f56-57e8-4f72-aac4-61229751f483 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:46.526977 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a81f56-57e8-4f72-aac4-61229751f483 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:46.528591 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a81f56-57e8-4f72-aac4-61229751f483 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:46.544714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-30a81f56-57e8-4f72-aac4-61229751f483 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:46.544714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:46.544714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:46.544714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:46.544714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:46.544714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:46.544714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:46.544714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:46.544714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:46.544714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:46.544714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:46.544714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:46.544714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:52:46.544714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:52:46.544714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:52:46.545676 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:52:46.545676 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:46.545676 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:46.545676 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:46.545676 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:46.545676 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:46.545676 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:46.545676 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:46.545676 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:46.545676 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:46.545676 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:46.545676 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:46.545676 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:46.545676 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:46.545676 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:46.545676 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:46.545676 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:46.546542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:52:46.546542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:52:46.546542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:52:46.546542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:52:46.546542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:52:46.546542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:52:46.546542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:46.546542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:46.546542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 301/600] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:52:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:46.552431 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac7068-c636-4f12-ae30-41fc03720bb6 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:46.552431 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac7068-c636-4f12-ae30-41fc03720bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:46.552431 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac7068-c636-4f12-ae30-41fc03720bb6 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:46.554931 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 302/601] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:46.555800 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac7068-c636-4f12-ae30-41fc03720bb6 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:46.652253 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00aaee-0521-44f6-8d7a-8c89597d0f34 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:46.688687 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac7068-c636-4f12-ae30-41fc03720bb6 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:46.700504 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:46.710080 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df193d3-ad00-4fab-917f-0bbb0a92aefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:46.711126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df193d3-ad00-4fab-917f-0bbb0a92aefc None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:46.711559 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df193d3-ad00-4fab-917f-0bbb0a92aefc None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:46.712090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df193d3-ad00-4fab-917f-0bbb0a92aefc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:46.724052 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df193d3-ad00-4fab-917f-0bbb0a92aefc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:46.725971 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df193d3-ad00-4fab-917f-0bbb0a92aefc None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:46.736276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab32022-f482-4b82-aad6-6515a5111727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:46.737506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab32022-f482-4b82-aad6-6515a5111727 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:46.737859 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab32022-f482-4b82-aad6-6515a5111727 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:46.738339 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab32022-f482-4b82-aad6-6515a5111727 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:46.739349 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab32022-f482-4b82-aad6-6515a5111727 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:46.739983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab32022-f482-4b82-aad6-6515a5111727 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:46.741577 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab32022-f482-4b82-aad6-6515a5111727 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:46.748640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-3df193d3-ad00-4fab-917f-0bbb0a92aefc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:46.748640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:46.748640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:46.748640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:46.748640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:46.748640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:46.748640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:46.748640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:46.748640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:46.748640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:46.748640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:46.748640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:46.748640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:46.748640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:46.748640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:46.749727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:46.749727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:46.749727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:46.749727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:46.749727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:46.749727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:46.749727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:46.749727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:46.749727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:46.749727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:46.749727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:46.749727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:46.749727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:46.749727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:46.749727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:46.749727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:46.749727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:46.750833 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:46.750833 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:46.750833 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:46.750833 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:46.752937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 300/602] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:46.758680 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5d9b6-f542-4ab6-a0b7-69ee0f90256d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:46.760149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5d9b6-f542-4ab6-a0b7-69ee0f90256d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:46.760776 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5d9b6-f542-4ab6-a0b7-69ee0f90256d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:46.762480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 303/603] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:52:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:46.763650 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab32022-f482-4b82-aad6-6515a5111727 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:46.766635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:46.783006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6ec5d9b6-f542-4ab6-a0b7-69ee0f90256d None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:46.784361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6ec5d9b6-f542-4ab6-a0b7-69ee0f90256d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:46.864518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 301/604] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:46.865746 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5d9b6-f542-4ab6-a0b7-69ee0f90256d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:46.893522 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab32022-f482-4b82-aad6-6515a5111727 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:46.943390 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207f242-5300-4b00-a547-482370993633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:46.944648 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207f242-5300-4b00-a547-482370993633 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:46.945340 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207f242-5300-4b00-a547-482370993633 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:46.945773 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207f242-5300-4b00-a547-482370993633 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:46.947777 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0207f242-5300-4b00-a547-482370993633 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:46.948246 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0207f242-5300-4b00-a547-482370993633 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:46.950080 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0207f242-5300-4b00-a547-482370993633 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:46.965982 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 304/605] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:46.972812 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207f242-5300-4b00-a547-482370993633 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:46.997138 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5d9b6-f542-4ab6-a0b7-69ee0f90256d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:47.010143 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:47.039295 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97213d-1489-4de8-ad72-03d26a52e374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:47.040456 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97213d-1489-4de8-ad72-03d26a52e374 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:47.041416 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97213d-1489-4de8-ad72-03d26a52e374 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:47.041837 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97213d-1489-4de8-ad72-03d26a52e374 None admin] PATH_INFO: `/v3/projects/89b20e18525c473e94a2b263148f1f5f/users/85924e1dfe664f78af34565db18b0b55/roles/372e9dc71b5a4a4daddc43ab384fa67b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:47.059147 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c97213d-1489-4de8-ad72-03d26a52e374 None admin] RBAC: Authorizing `identity:create_grant(project_id=89b20e18525c473e94a2b263148f1f5f, user_id=85924e1dfe664f78af34565db18b0b55, role_id=372e9dc71b5a4a4daddc43ab384fa67b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:47.060836 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c97213d-1489-4de8-ad72-03d26a52e374 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:47.069287 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:47.082759 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 302/606] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 21:52:46 2022] PUT /identity/v3/projects/89b20e18525c473e94a2b263148f1f5f/users/85924e1dfe664f78af34565db18b0b55/roles/372e9dc71b5a4a4daddc43ab384fa67b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:52:47.084011 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97213d-1489-4de8-ad72-03d26a52e374 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:47.149955 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207f242-5300-4b00-a547-482370993633 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:47.212471 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97213d-1489-4de8-ad72-03d26a52e374 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:47.226203 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9c250-9dcc-4a79-ba57-ea16a34b60be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:47.227067 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9c250-9dcc-4a79-ba57-ea16a34b60be None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:47.227296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9c250-9dcc-4a79-ba57-ea16a34b60be None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:47.227568 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9c250-9dcc-4a79-ba57-ea16a34b60be None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:47.256721 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05c632-80ea-474e-96bb-4f70f1ec25b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:47.257996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05c632-80ea-474e-96bb-4f70f1ec25b0 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:47.258497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05c632-80ea-474e-96bb-4f70f1ec25b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:47.259076 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05c632-80ea-474e-96bb-4f70f1ec25b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:47.262407 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9c250-9dcc-4a79-ba57-ea16a34b60be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:47.268363 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05c632-80ea-474e-96bb-4f70f1ec25b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:47.270144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05c632-80ea-474e-96bb-4f70f1ec25b0 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:47.270636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-f7a9c250-9dcc-4a79-ba57-ea16a34b60be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:47.270636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:47.270636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:47.270636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:47.270636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:47.270636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:47.270636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:47.270636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:47.270636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:47.270636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:47.270636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:47.270636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:47.270636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:47.270636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:47.270636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:47.270636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:47.271527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:47.271527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:47.271527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:47.271527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:47.271527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:47.271527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:47.271527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:47.271527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:47.271527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:47.271527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:47.271527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:47.271527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:47.271527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:47.271527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:47.271527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:47.271527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:47.272370 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:47.272370 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:47.272370 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:47.272370 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:47.272370 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:47.272370 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:47.272370 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:47.272370 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:47.272370 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:47.272370 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:47.272370 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:47.272370 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:47.276614 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 305/607] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 21:52:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:47.284673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9c250-9dcc-4a79-ba57-ea16a34b60be None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:47.314794 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-cd05c632-80ea-474e-96bb-4f70f1ec25b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:47.314794 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:47.314794 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:47.314794 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:47.314794 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:47.314794 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:47.314794 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:47.314794 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:47.314794 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:47.314794 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:47.314794 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:47.314794 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:47.314794 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:52:47.314794 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:52:47.314794 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:52:47.315715 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:52:47.315715 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:47.315715 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:47.315715 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:47.315715 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:47.315715 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:47.315715 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:47.315715 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:47.315715 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:47.315715 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:47.315715 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:47.315715 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:47.315715 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:47.315715 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:47.315715 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:47.315715 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:47.315715 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:47.317068 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:52:47.317068 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:52:47.317068 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:52:47.317068 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:52:47.317068 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:52:47.317068 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:52:47.317068 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:47.317068 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:47.319191 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 303/608] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:52:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:47.325735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05c632-80ea-474e-96bb-4f70f1ec25b0 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:47.360835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:47.470562 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05c632-80ea-474e-96bb-4f70f1ec25b0 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:47.511455 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9c250-9dcc-4a79-ba57-ea16a34b60be None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:47.516157 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77770191-9e0e-4ee2-bb45-9c2e085514e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:47.517104 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77770191-9e0e-4ee2-bb45-9c2e085514e8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:47.517619 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77770191-9e0e-4ee2-bb45-9c2e085514e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:47.518149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77770191-9e0e-4ee2-bb45-9c2e085514e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:47.519269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77770191-9e0e-4ee2-bb45-9c2e085514e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:47.519783 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77770191-9e0e-4ee2-bb45-9c2e085514e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:47.521581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77770191-9e0e-4ee2-bb45-9c2e085514e8 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:47.537038 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:47.545579 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 304/609] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:52:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:52:47.553032 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77770191-9e0e-4ee2-bb45-9c2e085514e8 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:47.555312 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c251b0e-fd80-4a4b-9fd7-19ce19f1d628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:47.556027 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c251b0e-fd80-4a4b-9fd7-19ce19f1d628 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:47.556997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c251b0e-fd80-4a4b-9fd7-19ce19f1d628 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:47.557331 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c251b0e-fd80-4a4b-9fd7-19ce19f1d628 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:47.558038 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c251b0e-fd80-4a4b-9fd7-19ce19f1d628 None admin] RBAC: Adding query filter params (name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:47.558327 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c251b0e-fd80-4a4b-9fd7-19ce19f1d628 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:47.564455 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c251b0e-fd80-4a4b-9fd7-19ce19f1d628 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:47.576476 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 306/610] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 21:52:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:52:47.577803 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c251b0e-fd80-4a4b-9fd7-19ce19f1d628 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:47.703989 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c251b0e-fd80-4a4b-9fd7-19ce19f1d628 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:47.754481 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd77ea-bb1a-4ed0-b4ca-0bcae3827088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:47.755216 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd77ea-bb1a-4ed0-b4ca-0bcae3827088 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:47.755490 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd77ea-bb1a-4ed0-b4ca-0bcae3827088 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:47.755757 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd77ea-bb1a-4ed0-b4ca-0bcae3827088 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:47.776114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:47.779696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd77ea-bb1a-4ed0-b4ca-0bcae3827088 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:47.781327 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd77ea-bb1a-4ed0-b4ca-0bcae3827088 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:47.801324 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-edfd77ea-bb1a-4ed0-b4ca-0bcae3827088 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:47.801324 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:47.801324 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:47.801324 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:47.801324 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:47.801324 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:47.801324 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:47.801324 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:47.801324 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:47.801324 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:47.801324 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:47.801324 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:47.801324 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:47.801324 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:47.801324 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:47.802251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:47.802251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:47.802251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:47.802251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:47.802251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:47.802251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:47.802251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:47.802251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:47.802251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:47.802251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:47.802251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:47.802251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:47.802251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:47.802251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:47.802251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:47.802251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:47.802251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:47.803111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:47.803111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:47.803111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:47.803111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:47.808295 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 307/611] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:52:47.809749 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd77ea-bb1a-4ed0-b4ca-0bcae3827088 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:47.818509 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77770191-9e0e-4ee2-bb45-9c2e085514e8 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:47.855717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:47.883192 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c4a48-ce46-43c8-a0b6-f2b7ccc5a695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:47.884246 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c4a48-ce46-43c8-a0b6-f2b7ccc5a695 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:47.884595 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c4a48-ce46-43c8-a0b6-f2b7ccc5a695 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:47.884873 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c4a48-ce46-43c8-a0b6-f2b7ccc5a695 None admin] PATH_INFO: `/v3/projects/89b20e18525c473e94a2b263148f1f5f/users/a571d6fe63334552b532aae15299ef9a/roles/372e9dc71b5a4a4daddc43ab384fa67b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:47.904185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c4a48-ce46-43c8-a0b6-f2b7ccc5a695 None admin] RBAC: Authorizing `identity:create_grant(project_id=89b20e18525c473e94a2b263148f1f5f, user_id=a571d6fe63334552b532aae15299ef9a, role_id=372e9dc71b5a4a4daddc43ab384fa67b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:47.905684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c4a48-ce46-43c8-a0b6-f2b7ccc5a695 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:47.923099 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 305/612] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 21:52:47 2022] PUT /identity/v3/projects/89b20e18525c473e94a2b263148f1f5f/users/a571d6fe63334552b532aae15299ef9a/roles/372e9dc71b5a4a4daddc43ab384fa67b => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:52:47.924760 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225bd41-5d86-4736-a257-6cd995cfbcb0 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:47.925042 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225bd41-5d86-4736-a257-6cd995cfbcb0 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:47.925320 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225bd41-5d86-4736-a257-6cd995cfbcb0 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:47.932594 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 306/613] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:47.934397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f73e4-1bc1-4683-9e7e-9ff9d5c44f43 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:47.934688 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f73e4-1bc1-4683-9e7e-9ff9d5c44f43 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:47.935297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f73e4-1bc1-4683-9e7e-9ff9d5c44f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:47.956150 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-9a5f73e4-1bc1-4683-9e7e-9ff9d5c44f43 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:47.957452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9a5f73e4-1bc1-4683-9e7e-9ff9d5c44f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:47.974018 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd77ea-bb1a-4ed0-b4ca-0bcae3827088 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:48.018527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b02a1b-e16e-427c-bd6b-e0604f4e58ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:48.019237 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b02a1b-e16e-427c-bd6b-e0604f4e58ef None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:48.019527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b02a1b-e16e-427c-bd6b-e0604f4e58ef None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:48.019808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b02a1b-e16e-427c-bd6b-e0604f4e58ef None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:48.020667 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b02a1b-e16e-427c-bd6b-e0604f4e58ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:48.020974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b02a1b-e16e-427c-bd6b-e0604f4e58ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:48.022426 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b02a1b-e16e-427c-bd6b-e0604f4e58ef None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:48.053667 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 308/614] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:48.053667 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b02a1b-e16e-427c-bd6b-e0604f4e58ef None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:48.122337 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 307/615] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:48.157822 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f73e4-1bc1-4683-9e7e-9ff9d5c44f43 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:48.158511 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:48.165052 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b02a1b-e16e-427c-bd6b-e0604f4e58ef None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:48.206395 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59522dbe-e53d-4ff7-8cd8-3f7b9b399a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:48.207208 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59522dbe-e53d-4ff7-8cd8-3f7b9b399a91 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:48.207487 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59522dbe-e53d-4ff7-8cd8-3f7b9b399a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:48.207759 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59522dbe-e53d-4ff7-8cd8-3f7b9b399a91 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:48.216894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59522dbe-e53d-4ff7-8cd8-3f7b9b399a91 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:48.218509 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59522dbe-e53d-4ff7-8cd8-3f7b9b399a91 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:48.234633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-59522dbe-e53d-4ff7-8cd8-3f7b9b399a91 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 21:52:48.234633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:48.234633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:48.234633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:48.234633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:48.234633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:48.234633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:48.234633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:48.234633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:48.234633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:48.234633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:48.234633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:48.234633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:52:48.234633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:52:48.234633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:52:48.234633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:52:48.235638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:48.235638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:48.235638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:52:48.235638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:48.235638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:52:48.235638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:48.235638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:48.235638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:48.235638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:48.235638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:48.235638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:48.235638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:48.235638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:48.235638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:48.235638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:48.235638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:48.235638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:48.235638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:48.236779 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:48.236779 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:48.236779 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:52:48.236779 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:52:48.236779 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:52:48.236779 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:52:48.236779 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:52:48.236779 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:52:48.236779 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 21:52:48.236779 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:48.236779 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 309/616] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:52:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:52:48.245908 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59522dbe-e53d-4ff7-8cd8-3f7b9b399a91 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:48.265180 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:48.305922 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f73e4-1bc1-4683-9e7e-9ff9d5c44f43 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:48.355323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef492597-f01d-4a08-8bb5-09e54bcde801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:48.356131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef492597-f01d-4a08-8bb5-09e54bcde801 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:48.356426 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef492597-f01d-4a08-8bb5-09e54bcde801 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:48.359348 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef492597-f01d-4a08-8bb5-09e54bcde801 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:48.386339 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef492597-f01d-4a08-8bb5-09e54bcde801 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:48.399517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-ef492597-f01d-4a08-8bb5-09e54bcde801 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:48.399517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:48.399517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:48.399517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:48.399517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:48.399517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:48.399517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:48.399517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:48.399517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:48.399517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:48.399517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:48.399517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:48.399517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:48.399517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:48.399517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:48.399517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:48.401107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:48.401107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:48.401107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:48.401107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:48.401107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:48.401107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:48.401107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:48.401107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:48.401107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:48.401107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:48.401107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:48.401107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:48.401107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:48.401107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:48.401107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:48.401107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:48.401914 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:48.401914 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:48.401914 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:48.401914 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:48.401914 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:48.401914 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:48.401914 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:48.401914 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:48.401914 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:48.401914 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:48.401914 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:48.401914 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:48.410061 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 308/617] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 21:52:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:48.414141 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef492597-f01d-4a08-8bb5-09e54bcde801 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:48.454661 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59522dbe-e53d-4ff7-8cd8-3f7b9b399a91 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:48.515180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489619fb-0db6-45e2-91f6-32e8ac6eba36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:48.515883 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489619fb-0db6-45e2-91f6-32e8ac6eba36 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:48.516170 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489619fb-0db6-45e2-91f6-32e8ac6eba36 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:48.516471 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489619fb-0db6-45e2-91f6-32e8ac6eba36 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:48.517332 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489619fb-0db6-45e2-91f6-32e8ac6eba36 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:48.517642 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489619fb-0db6-45e2-91f6-32e8ac6eba36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:48.519093 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489619fb-0db6-45e2-91f6-32e8ac6eba36 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:48.560620 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 310/618] 10.222.0.35 () {56 vars in 1135 bytes} [Thu May 19 21:52:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:48.566156 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489619fb-0db6-45e2-91f6-32e8ac6eba36 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:48.606428 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef492597-f01d-4a08-8bb5-09e54bcde801 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:48.615589 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:48.640791 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:48.653156 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8cccf-ef31-4ede-be5c-fab749a8c1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:48.654699 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8cccf-ef31-4ede-be5c-fab749a8c1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:48.655296 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8cccf-ef31-4ede-be5c-fab749a8c1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:48.656177 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8cccf-ef31-4ede-be5c-fab749a8c1f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:48.657805 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f8cccf-ef31-4ede-be5c-fab749a8c1f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:48.658487 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f8cccf-ef31-4ede-be5c-fab749a8c1f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:48.664271 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f8cccf-ef31-4ede-be5c-fab749a8c1f8 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:48.683524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 309/619] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 21:52:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:48.688450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8cccf-ef31-4ede-be5c-fab749a8c1f8 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:48.751149 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489619fb-0db6-45e2-91f6-32e8ac6eba36 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:48.791377 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97f269-d809-4ddf-831c-1a4de29460c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:48.793316 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97f269-d809-4ddf-831c-1a4de29460c7 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:48.793761 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97f269-d809-4ddf-831c-1a4de29460c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:48.794217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97f269-d809-4ddf-831c-1a4de29460c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:48.808954 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97f269-d809-4ddf-831c-1a4de29460c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:48.810863 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97f269-d809-4ddf-831c-1a4de29460c7 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:48.833493 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-8e97f269-d809-4ddf-831c-1a4de29460c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:48.833493 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:48.833493 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:48.833493 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:48.833493 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:48.833493 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:48.833493 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:48.833493 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:48.833493 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:48.833493 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:48.833493 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:48.833493 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:48.833493 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:48.833493 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:48.833493 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:48.834654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:48.834654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:48.834654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:48.834654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:48.834654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:48.834654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:48.834654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:48.834654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:48.834654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:48.834654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:48.834654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:48.834654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:48.834654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:48.834654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:48.834654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:48.834654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:48.834654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:48.835727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:48.835727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:48.835727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:48.835727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:48.838498 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 311/620] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:52:48.843897 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97f269-d809-4ddf-831c-1a4de29460c7 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:48.941088 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:48.981545 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8cccf-ef31-4ede-be5c-fab749a8c1f8 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:49.022232 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c17c3-055d-4ab6-a7a7-8a81d4054c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:49.023487 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c17c3-055d-4ab6-a7a7-8a81d4054c2c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:49.023919 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c17c3-055d-4ab6-a7a7-8a81d4054c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:49.024338 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c17c3-055d-4ab6-a7a7-8a81d4054c2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:49.038303 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c17c3-055d-4ab6-a7a7-8a81d4054c2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:49.039784 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97f269-d809-4ddf-831c-1a4de29460c7 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:49.040647 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c17c3-055d-4ab6-a7a7-8a81d4054c2c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:49.064439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-2c2c17c3-055d-4ab6-a7a7-8a81d4054c2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:49.064439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:49.064439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:49.064439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:49.064439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:49.064439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:49.064439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:49.064439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:49.064439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:49.064439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:49.064439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:49.064439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:49.064439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:49.064439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:49.064439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:49.065428 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:49.065428 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:49.065428 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:49.065428 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:49.065428 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:49.065428 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:49.065428 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:49.065428 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:49.065428 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:49.065428 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:49.065428 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:49.065428 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:49.065428 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:49.065428 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:49.065428 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:49.065428 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:49.065428 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:49.066331 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:49.066331 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:49.066331 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:49.066331 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:49.069165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 310/621] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:49.070772 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f4f3a-b621-4fc3-8596-d2c3c2a8cda7 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:49.071191 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f4f3a-b621-4fc3-8596-d2c3c2a8cda7 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:49.071624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f4f3a-b621-4fc3-8596-d2c3c2a8cda7 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:49.073571 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 311/622] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:49.074414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f4f3a-b621-4fc3-8596-d2c3c2a8cda7 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:49.090472 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb667676-9d58-4b86-bb59-58ef29df9caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:49.091318 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb667676-9d58-4b86-bb59-58ef29df9caf None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:49.091676 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb667676-9d58-4b86-bb59-58ef29df9caf None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:49.092047 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb667676-9d58-4b86-bb59-58ef29df9caf None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:49.092930 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb667676-9d58-4b86-bb59-58ef29df9caf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:49.093338 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb667676-9d58-4b86-bb59-58ef29df9caf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:49.095006 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb667676-9d58-4b86-bb59-58ef29df9caf None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:49.107985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 312/623] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:49.109553 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8105e1d-85f6-4812-8de1-2aab5499bfa5 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:49.109939 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8105e1d-85f6-4812-8de1-2aab5499bfa5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:49.110680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8105e1d-85f6-4812-8de1-2aab5499bfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:49.121484 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:49.131685 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b8105e1d-85f6-4812-8de1-2aab5499bfa5 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:49.133159 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b8105e1d-85f6-4812-8de1-2aab5499bfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:49.212501 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 313/624] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:49.213422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f4f3a-b621-4fc3-8596-d2c3c2a8cda7 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:49.214501 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8105e1d-85f6-4812-8de1-2aab5499bfa5 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:49.260905 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f79010-37aa-4ad4-b946-7b359588e427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:49.261751 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f79010-37aa-4ad4-b946-7b359588e427 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:49.262128 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f79010-37aa-4ad4-b946-7b359588e427 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:49.262502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f79010-37aa-4ad4-b946-7b359588e427 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:49.263323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f79010-37aa-4ad4-b946-7b359588e427 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:49.263728 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f79010-37aa-4ad4-b946-7b359588e427 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:49.265224 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f79010-37aa-4ad4-b946-7b359588e427 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:49.283927 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 312/625] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:49.284924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f79010-37aa-4ad4-b946-7b359588e427 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:49.298185 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:49.358644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8105e1d-85f6-4812-8de1-2aab5499bfa5 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:49.401169 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:49.404712 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ae283-01bc-47ed-a437-69c80543fb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:49.406767 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ae283-01bc-47ed-a437-69c80543fb02 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:49.407259 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ae283-01bc-47ed-a437-69c80543fb02 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:49.407731 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ae283-01bc-47ed-a437-69c80543fb02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:49.408451 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f79010-37aa-4ad4-b946-7b359588e427 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:49.417351 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ae283-01bc-47ed-a437-69c80543fb02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:49.419276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ae283-01bc-47ed-a437-69c80543fb02 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:49.437513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-e86ae283-01bc-47ed-a437-69c80543fb02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:49.437513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:49.437513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:49.437513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:49.437513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:49.437513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:49.437513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:49.437513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:49.437513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:49.437513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:49.437513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:49.437513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:49.437513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:52:49.437513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:52:49.437513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:52:49.438467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:52:49.438467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:49.438467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:49.438467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:49.438467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:49.438467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:49.438467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:49.438467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:49.438467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:49.438467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:49.438467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:49.438467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:49.438467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:49.438467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:49.438467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:49.438467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:49.438467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:49.439331 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:52:49.439331 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:52:49.439331 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:52:49.439331 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:52:49.439331 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:52:49.439331 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:52:49.439331 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:49.439331 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:49.441981 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 314/626] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:52:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:49.443401 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ae283-01bc-47ed-a437-69c80543fb02 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:49.449586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b53adc-c9d3-4d4f-937c-60af5803769f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:49.450462 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b53adc-c9d3-4d4f-937c-60af5803769f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:49.450755 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b53adc-c9d3-4d4f-937c-60af5803769f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:49.451033 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b53adc-c9d3-4d4f-937c-60af5803769f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:49.464853 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b53adc-c9d3-4d4f-937c-60af5803769f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:49.474747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-67b53adc-c9d3-4d4f-937c-60af5803769f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:49.474747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:49.474747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:49.474747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:49.474747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:49.474747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:49.474747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:49.474747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:49.474747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:49.474747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:49.474747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:49.474747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:49.474747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:49.474747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:49.474747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:49.474747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:49.475923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:49.475923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:49.475923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:49.475923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:49.475923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:49.475923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:49.475923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:49.475923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:49.475923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:49.475923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:49.475923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:49.475923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:49.475923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:49.475923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:49.475923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:49.475923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:49.476761 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:49.476761 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:49.476761 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:49.476761 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:49.476761 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:49.476761 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:49.476761 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:49.476761 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:49.476761 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:49.476761 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:49.476761 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:49.476761 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:49.480503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 313/627] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 21:52:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:49.481757 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b53adc-c9d3-4d4f-937c-60af5803769f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:49.566052 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ae283-01bc-47ed-a437-69c80543fb02 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:49.586803 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:49.611347 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300aaa2-c845-40af-bb03-7e19039676b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:49.612506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300aaa2-c845-40af-bb03-7e19039676b9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:49.613013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300aaa2-c845-40af-bb03-7e19039676b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:49.613488 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300aaa2-c845-40af-bb03-7e19039676b9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:49.623606 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300aaa2-c845-40af-bb03-7e19039676b9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:49.624185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b53adc-c9d3-4d4f-937c-60af5803769f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:49.625982 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300aaa2-c845-40af-bb03-7e19039676b9 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:49.642379 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-c300aaa2-c845-40af-bb03-7e19039676b9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 21:52:49.642379 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:49.642379 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:49.642379 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:49.642379 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:49.642379 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:49.642379 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:49.642379 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:49.642379 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:49.642379 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:49.642379 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:49.642379 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:49.642379 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:52:49.642379 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:52:49.642379 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:52:49.642379 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:52:49.643416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:49.643416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:49.643416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:52:49.643416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:49.643416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:52:49.643416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:49.643416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:49.643416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:49.643416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:49.643416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:49.643416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:49.643416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:49.643416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:49.643416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:49.643416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:49.643416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:49.643416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:49.643416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:49.644344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:49.644344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:49.644344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:52:49.644344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:52:49.644344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:52:49.644344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:52:49.644344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:52:49.644344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:52:49.644344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 21:52:49.644344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:49.655672 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 315/628] 10.222.0.35 () {56 vars in 1093 bytes} [Thu May 19 21:52:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:49.657779 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300aaa2-c845-40af-bb03-7e19039676b9 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:49.667139 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a669efd-fc37-40fa-96f2-21a858bc5b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:49.667835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a669efd-fc37-40fa-96f2-21a858bc5b40 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:49.668141 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a669efd-fc37-40fa-96f2-21a858bc5b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:49.668454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a669efd-fc37-40fa-96f2-21a858bc5b40 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:49.669294 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a669efd-fc37-40fa-96f2-21a858bc5b40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:49.669592 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a669efd-fc37-40fa-96f2-21a858bc5b40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:49.671068 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a669efd-fc37-40fa-96f2-21a858bc5b40 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:49.689545 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 314/629] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:52:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:49.690527 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a669efd-fc37-40fa-96f2-21a858bc5b40 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:49.712884 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:49.803979 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300aaa2-c845-40af-bb03-7e19039676b9 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:49.846673 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a669efd-fc37-40fa-96f2-21a858bc5b40 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:49.856435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77c2e4-6278-43ac-9d3c-3eaac929cce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:49.857898 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77c2e4-6278-43ac-9d3c-3eaac929cce6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:49.858483 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77c2e4-6278-43ac-9d3c-3eaac929cce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:49.859015 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77c2e4-6278-43ac-9d3c-3eaac929cce6 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:49.860353 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77c2e4-6278-43ac-9d3c-3eaac929cce6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:49.861197 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77c2e4-6278-43ac-9d3c-3eaac929cce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:49.863140 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77c2e4-6278-43ac-9d3c-3eaac929cce6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:49.882523 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 316/630] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 21:52:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:49.883554 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77c2e4-6278-43ac-9d3c-3eaac929cce6 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:49.898226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4c1cb-1c76-494b-924a-cb879551d8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:49.899905 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4c1cb-1c76-494b-924a-cb879551d8be None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:49.901073 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4c1cb-1c76-494b-924a-cb879551d8be None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:49.902042 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4c1cb-1c76-494b-924a-cb879551d8be None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:49.903100 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4c1cb-1c76-494b-924a-cb879551d8be None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:49.903908 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4c1cb-1c76-494b-924a-cb879551d8be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:49.906632 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4c1cb-1c76-494b-924a-cb879551d8be None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:49.938931 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:49.951380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 315/631] 10.222.0.35 () {56 vars in 1133 bytes} [Thu May 19 21:52:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:49.952573 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4c1cb-1c76-494b-924a-cb879551d8be None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:50.033052 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:50.034045 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77c2e4-6278-43ac-9d3c-3eaac929cce6 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:50.070241 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4c1cb-1c76-494b-924a-cb879551d8be None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:50.079323 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfaa8d-83d1-4954-957d-732fc2b65af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:50.081034 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfaa8d-83d1-4954-957d-732fc2b65af2 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:50.081660 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfaa8d-83d1-4954-957d-732fc2b65af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:50.082115 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfaa8d-83d1-4954-957d-732fc2b65af2 None admin] PATH_INFO: `/v3/projects/89b20e18525c473e94a2b263148f1f5f/users/86a4208619f84f16b735871ee114e660/roles/372e9dc71b5a4a4daddc43ab384fa67b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:50.108868 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbfaa8d-83d1-4954-957d-732fc2b65af2 None admin] RBAC: Authorizing `identity:create_grant(project_id=89b20e18525c473e94a2b263148f1f5f, user_id=86a4208619f84f16b735871ee114e660, role_id=372e9dc71b5a4a4daddc43ab384fa67b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:50.110572 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbfaa8d-83d1-4954-957d-732fc2b65af2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:50.110946 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f702c-01c0-415f-8891-b1c24a6ee403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:50.111973 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f702c-01c0-415f-8891-b1c24a6ee403 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:50.112465 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f702c-01c0-415f-8891-b1c24a6ee403 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:50.112926 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f702c-01c0-415f-8891-b1c24a6ee403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:50.125672 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f702c-01c0-415f-8891-b1c24a6ee403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:50.127505 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f702c-01c0-415f-8891-b1c24a6ee403 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:50.135759 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 317/632] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 21:52:49 2022] PUT /identity/v3/projects/89b20e18525c473e94a2b263148f1f5f/users/86a4208619f84f16b735871ee114e660/roles/372e9dc71b5a4a4daddc43ab384fa67b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:52:50.137006 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfaa8d-83d1-4954-957d-732fc2b65af2 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:50.147217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-5e3f702c-01c0-415f-8891-b1c24a6ee403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:50.147217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:50.147217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:50.147217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:50.147217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:50.147217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:50.147217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:50.147217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:50.147217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:50.147217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:50.147217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:50.147217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:50.147217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:50.147217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:50.147217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:50.148165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:50.148165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:50.148165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:50.148165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:50.148165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:50.148165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:50.148165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:50.148165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:50.148165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:50.148165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:50.148165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:50.148165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:50.148165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:50.148165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:50.148165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:50.148165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:50.148165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:50.149422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:50.149422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:50.149422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:50.149422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:50.149422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 316/633] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:50.150460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbc558-b8e9-43ca-8d31-329291c053f0 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:50.150744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbc558-b8e9-43ca-8d31-329291c053f0 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:50.151012 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbc558-b8e9-43ca-8d31-329291c053f0 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:50.153391 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 317/634] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:50.156753 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbc558-b8e9-43ca-8d31-329291c053f0 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:50.266845 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:50.287757 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfaa8d-83d1-4954-957d-732fc2b65af2 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:50.292547 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbc558-b8e9-43ca-8d31-329291c053f0 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:50.323171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:50.336635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d90c8d-0ffa-4fb2-a3a0-b720b5b6892e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:50.337390 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d90c8d-0ffa-4fb2-a3a0-b720b5b6892e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:50.337886 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d90c8d-0ffa-4fb2-a3a0-b720b5b6892e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:50.338580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d90c8d-0ffa-4fb2-a3a0-b720b5b6892e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:50.339432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3be7ed-9103-4e39-81f1-13dfae85efbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:50.340646 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3be7ed-9103-4e39-81f1-13dfae85efbe None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:50.341204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3be7ed-9103-4e39-81f1-13dfae85efbe None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:50.341685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3be7ed-9103-4e39-81f1-13dfae85efbe None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:50.342624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3be7ed-9103-4e39-81f1-13dfae85efbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:50.343127 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3be7ed-9103-4e39-81f1-13dfae85efbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:50.344900 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3be7ed-9103-4e39-81f1-13dfae85efbe None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:50.360321 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 318/635] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:52:50.362110 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83780fae-195e-44ef-936f-fefc8117c82a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:50.362669 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83780fae-195e-44ef-936f-fefc8117c82a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:50.363179 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83780fae-195e-44ef-936f-fefc8117c82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:50.384366 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-83780fae-195e-44ef-936f-fefc8117c82a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:50.386316 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-83780fae-195e-44ef-936f-fefc8117c82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:50.448578 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d90c8d-0ffa-4fb2-a3a0-b720b5b6892e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:50.450547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d90c8d-0ffa-4fb2-a3a0-b720b5b6892e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:50.483107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 319/636] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:50.484376 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83780fae-195e-44ef-936f-fefc8117c82a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:50.581344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:50.605751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 318/637] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:52:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:52:50.607437 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e15d4d-f5de-4457-80aa-a543751fd9a9 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:50.607722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e15d4d-f5de-4457-80aa-a543751fd9a9 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:50.607998 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e15d4d-f5de-4457-80aa-a543751fd9a9 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:50.609455 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 319/638] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:50.614268 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e15d4d-f5de-4457-80aa-a543751fd9a9 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:50.622877 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83780fae-195e-44ef-936f-fefc8117c82a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:50.640309 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:50.663200 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc617a6e-903d-4954-a61d-1e27f7a44e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:50.664005 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc617a6e-903d-4954-a61d-1e27f7a44e4c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:50.664288 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc617a6e-903d-4954-a61d-1e27f7a44e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:50.664608 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc617a6e-903d-4954-a61d-1e27f7a44e4c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:50.673793 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc617a6e-903d-4954-a61d-1e27f7a44e4c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:50.675366 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc617a6e-903d-4954-a61d-1e27f7a44e4c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:50.692235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-dc617a6e-903d-4954-a61d-1e27f7a44e4c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 21:52:50.692235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:50.692235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:50.692235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:50.692235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:50.692235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:50.692235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:50.692235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:50.692235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:50.692235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:50.692235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:50.692235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:50.692235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:52:50.692235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:52:50.692235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:52:50.692235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:52:50.693447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:50.693447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:50.693447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:52:50.693447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:50.693447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:52:50.693447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:50.693447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:50.693447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:50.693447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:50.693447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:50.693447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:50.693447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:50.693447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:50.693447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:50.693447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:50.693447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:50.693447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:50.693447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:50.694355 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:50.694355 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:50.694355 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:52:50.694355 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:52:50.694355 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:52:50.694355 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:52:50.694355 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:52:50.694355 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:52:50.694355 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 21:52:50.694355 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:50.694355 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 320/639] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:52:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:50.694920 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc617a6e-903d-4954-a61d-1e27f7a44e4c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:50.746659 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e15d4d-f5de-4457-80aa-a543751fd9a9 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:50.784628 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f328c4-3ab2-49ac-83b8-65d824a930a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:50.785593 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f328c4-3ab2-49ac-83b8-65d824a930a2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:50.785753 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f328c4-3ab2-49ac-83b8-65d824a930a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:50.786006 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f328c4-3ab2-49ac-83b8-65d824a930a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:50.798789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f328c4-3ab2-49ac-83b8-65d824a930a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:50.807262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-f2f328c4-3ab2-49ac-83b8-65d824a930a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:50.807262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:50.807262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:50.807262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:50.807262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:50.807262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:50.807262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:50.807262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:50.807262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:50.807262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:50.807262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:50.807262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:50.807262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:50.807262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:50.807262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:50.807262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:50.808217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:50.808217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:50.808217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:50.808217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:50.808217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:50.808217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:50.808217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:50.808217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:50.808217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:50.808217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:50.808217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:50.808217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:50.808217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:50.808217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:50.808217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:50.808217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:50.809079 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:50.809079 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:50.809079 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:50.809079 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:50.809079 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:50.809079 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:50.809079 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:50.809079 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:50.809079 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:50.809079 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:50.809079 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:50.809079 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:50.809079 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 320/640] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 21:52:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:50.810115 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69249a3e-df7a-4d69-b6ab-e736f729a025 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:50.810115 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69249a3e-df7a-4d69-b6ab-e736f729a025 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:50.810391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69249a3e-df7a-4d69-b6ab-e736f729a025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:50.825891 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc617a6e-903d-4954-a61d-1e27f7a44e4c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:50.829267 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-69249a3e-df7a-4d69-b6ab-e736f729a025 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:50.830483 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-69249a3e-df7a-4d69-b6ab-e736f729a025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:50.865273 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102caa0a-fd8d-40ab-86c8-f8d0c1f0067d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:50.866060 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102caa0a-fd8d-40ab-86c8-f8d0c1f0067d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:50.866350 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102caa0a-fd8d-40ab-86c8-f8d0c1f0067d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:50.866628 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102caa0a-fd8d-40ab-86c8-f8d0c1f0067d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:50.878314 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102caa0a-fd8d-40ab-86c8-f8d0c1f0067d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:50.879790 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102caa0a-fd8d-40ab-86c8-f8d0c1f0067d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:50.885189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:50.904361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-102caa0a-fd8d-40ab-86c8-f8d0c1f0067d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:50.904361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:50.904361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:50.904361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:50.904361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:50.904361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:50.904361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:50.904361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:50.904361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:50.904361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:50.904361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:50.904361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:50.904361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:50.904361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:50.904361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:50.905442 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:50.905442 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:50.905442 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:50.905442 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:50.905442 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:50.905442 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:50.905442 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:50.905442 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:50.905442 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:50.905442 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:50.905442 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:50.905442 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:50.905442 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:50.905442 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:50.905442 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:50.905442 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:50.905442 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:50.906485 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:50.906485 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:50.906485 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:50.906485 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:50.908042 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 321/641] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:50.908998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102caa0a-fd8d-40ab-86c8-f8d0c1f0067d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:50.919511 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 321/642] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:50.920359 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69249a3e-df7a-4d69-b6ab-e736f729a025 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:50.944500 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:51.029430 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102caa0a-fd8d-40ab-86c8-f8d0c1f0067d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:51.035303 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69249a3e-df7a-4d69-b6ab-e736f729a025 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:51.072643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef086b-7cf1-40db-8aa9-7e66f56e8dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:51.073336 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef086b-7cf1-40db-8aa9-7e66f56e8dba None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:51.073616 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef086b-7cf1-40db-8aa9-7e66f56e8dba None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:51.073890 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef086b-7cf1-40db-8aa9-7e66f56e8dba None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:51.074650 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef086b-7cf1-40db-8aa9-7e66f56e8dba None admin] RBAC: Adding query filter params (name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:51.074948 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef086b-7cf1-40db-8aa9-7e66f56e8dba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:51.076353 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef086b-7cf1-40db-8aa9-7e66f56e8dba None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:51.077971 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ffcf5-0dbe-4fb9-8ad5-c823d40c0886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:51.078829 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ffcf5-0dbe-4fb9-8ad5-c823d40c0886 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:51.079111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ffcf5-0dbe-4fb9-8ad5-c823d40c0886 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:51.079385 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ffcf5-0dbe-4fb9-8ad5-c823d40c0886 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:51.080218 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ffcf5-0dbe-4fb9-8ad5-c823d40c0886 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:51.080558 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ffcf5-0dbe-4fb9-8ad5-c823d40c0886 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:51.082170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ffcf5-0dbe-4fb9-8ad5-c823d40c0886 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:51.085335 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 322/643] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 21:52:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:51.086152 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef086b-7cf1-40db-8aa9-7e66f56e8dba None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:51.104541 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 322/644] 10.222.0.35 () {56 vars in 1137 bytes} [Thu May 19 21:52:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:51.105456 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ffcf5-0dbe-4fb9-8ad5-c823d40c0886 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:51.138524 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:51.202670 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:51.208893 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef086b-7cf1-40db-8aa9-7e66f56e8dba None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:51.220214 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ffcf5-0dbe-4fb9-8ad5-c823d40c0886 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:51.247187 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d32ef-c0c5-4cd7-93cd-00aa5ba8487e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:51.247900 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d32ef-c0c5-4cd7-93cd-00aa5ba8487e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:51.248189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d32ef-c0c5-4cd7-93cd-00aa5ba8487e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:51.248486 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d32ef-c0c5-4cd7-93cd-00aa5ba8487e None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:51.249240 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d32ef-c0c5-4cd7-93cd-00aa5ba8487e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:51.249536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d32ef-c0c5-4cd7-93cd-00aa5ba8487e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:51.250924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d32ef-c0c5-4cd7-93cd-00aa5ba8487e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:51.259392 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b491b-29aa-443c-8439-e9f467f328d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:51.260157 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b491b-29aa-443c-8439-e9f467f328d8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:51.260471 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b491b-29aa-443c-8439-e9f467f328d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:51.260752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b491b-29aa-443c-8439-e9f467f328d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:51.265635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 323/645] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:51.266893 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d32ef-c0c5-4cd7-93cd-00aa5ba8487e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:51.275575 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b491b-29aa-443c-8439-e9f467f328d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:51.283490 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-de9b491b-29aa-443c-8439-e9f467f328d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:51.283490 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:51.283490 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:51.283490 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:51.283490 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:51.283490 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:51.283490 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:51.283490 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:51.283490 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:51.283490 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:51.283490 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:51.283490 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:51.283490 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:51.283490 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:51.283490 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:51.283490 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:51.284431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:51.284431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:51.284431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:51.284431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:51.284431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:51.284431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:51.284431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:51.284431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:51.284431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:51.284431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:51.284431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:51.284431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:51.284431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:51.284431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:51.284431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:51.284431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:51.285425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:51.285425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:51.285425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:51.285425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:51.285425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:51.285425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:51.285425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:51.285425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:51.285425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:51.285425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:51.285425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:51.285425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:51.285425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 323/646] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 21:52:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:51.286709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b491b-29aa-443c-8439-e9f467f328d8 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:51.398659 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:51.402153 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d32ef-c0c5-4cd7-93cd-00aa5ba8487e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:51.422714 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b491b-29aa-443c-8439-e9f467f328d8 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:51.444112 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64256368-17d6-4df6-b482-e2a7a4935723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:51.445033 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64256368-17d6-4df6-b482-e2a7a4935723 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:51.445317 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64256368-17d6-4df6-b482-e2a7a4935723 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:51.445596 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64256368-17d6-4df6-b482-e2a7a4935723 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:51.459479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64256368-17d6-4df6-b482-e2a7a4935723 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:51.460908 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64256368-17d6-4df6-b482-e2a7a4935723 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:51.462837 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a7333-17fe-49b0-989c-cf48e30e110f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:51.463813 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a7333-17fe-49b0-989c-cf48e30e110f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:51.464219 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a7333-17fe-49b0-989c-cf48e30e110f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:51.464819 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a7333-17fe-49b0-989c-cf48e30e110f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:51.481260 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:51.483980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-64256368-17d6-4df6-b482-e2a7a4935723 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:51.483980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:51.483980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:51.483980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:51.483980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:51.483980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:51.483980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:51.483980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:51.483980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:51.483980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:51.483980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:51.483980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:51.483980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:51.483980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:51.483980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:51.485245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:51.485245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:51.485245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:51.485245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:51.485245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:51.485245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:51.485245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:51.485245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:51.485245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:51.485245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:51.485245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:51.485245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:51.485245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:51.485245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:51.485245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:51.485245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:51.485245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:51.486589 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:51.486589 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:51.486589 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:51.486589 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:51.489690 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 324/647] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:51.490716 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64256368-17d6-4df6-b482-e2a7a4935723 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:51.544812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a7333-17fe-49b0-989c-cf48e30e110f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:51.546272 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a7333-17fe-49b0-989c-cf48e30e110f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:51.602821 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64256368-17d6-4df6-b482-e2a7a4935723 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:51.641448 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503ddf2-8023-4bfa-892a-8aa89c82c00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:51.642259 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503ddf2-8023-4bfa-892a-8aa89c82c00b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:51.642543 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503ddf2-8023-4bfa-892a-8aa89c82c00b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:51.642934 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503ddf2-8023-4bfa-892a-8aa89c82c00b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:51.650863 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503ddf2-8023-4bfa-892a-8aa89c82c00b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:51.652444 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503ddf2-8023-4bfa-892a-8aa89c82c00b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:51.657272 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 324/648] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:52:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:52:51.658067 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a7333-17fe-49b0-989c-cf48e30e110f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:51.668250 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-c503ddf2-8023-4bfa-892a-8aa89c82c00b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:51.668250 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:51.668250 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:51.668250 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:51.668250 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:51.668250 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:51.668250 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:51.668250 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:51.668250 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:51.668250 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:51.668250 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:51.668250 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:51.668250 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:52:51.668250 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:52:51.668250 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:52:51.669391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:52:51.669391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:51.669391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:51.669391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:51.669391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:51.669391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:51.669391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:51.669391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:51.669391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:51.669391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:51.669391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:51.669391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:51.669391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:51.669391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:51.669391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:51.669391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:51.669391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:51.670256 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:52:51.670256 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:52:51.670256 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:52:51.670256 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:52:51.670256 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:52:51.670256 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:52:51.670256 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:51.670256 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:51.670256 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 325/649] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:52:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:51.670727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503ddf2-8023-4bfa-892a-8aa89c82c00b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:51.690026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:51.717682 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:51.783864 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503ddf2-8023-4bfa-892a-8aa89c82c00b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:51.784071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a7333-17fe-49b0-989c-cf48e30e110f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:51.818757 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb61e1-87cf-4df5-a989-89e5b0383c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:51.819454 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb61e1-87cf-4df5-a989-89e5b0383c88 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:51.819739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb61e1-87cf-4df5-a989-89e5b0383c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:51.820021 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb61e1-87cf-4df5-a989-89e5b0383c88 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:51.820821 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb61e1-87cf-4df5-a989-89e5b0383c88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:51.821136 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb61e1-87cf-4df5-a989-89e5b0383c88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:51.822885 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49611c33-0a49-4ce4-ab86-6d40d8ce300c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:51.823241 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb61e1-87cf-4df5-a989-89e5b0383c88 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:51.823521 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49611c33-0a49-4ce4-ab86-6d40d8ce300c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:51.823804 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49611c33-0a49-4ce4-ab86-6d40d8ce300c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:51.824080 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49611c33-0a49-4ce4-ab86-6d40d8ce300c None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:51.824906 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49611c33-0a49-4ce4-ab86-6d40d8ce300c None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:51.825481 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49611c33-0a49-4ce4-ab86-6d40d8ce300c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:51.827523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49611c33-0a49-4ce4-ab86-6d40d8ce300c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:51.841287 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 326/650] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:51.841287 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb61e1-87cf-4df5-a989-89e5b0383c88 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:51.842473 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 325/651] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 21:52:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:51.843265 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49611c33-0a49-4ce4-ab86-6d40d8ce300c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:51.926819 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:51.959599 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb61e1-87cf-4df5-a989-89e5b0383c88 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:51.960287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49611c33-0a49-4ce4-ab86-6d40d8ce300c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:51.968110 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:51.999668 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d255c-36b8-4aae-875e-22f9f49d27d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:52.000332 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d255c-36b8-4aae-875e-22f9f49d27d1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:52.000643 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d255c-36b8-4aae-875e-22f9f49d27d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:52.000982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d255c-36b8-4aae-875e-22f9f49d27d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:52.001253 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a145d3-18f4-4bc2-aa5e-0286b40fe3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:52.001767 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d255c-36b8-4aae-875e-22f9f49d27d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:52.002055 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a145d3-18f4-4bc2-aa5e-0286b40fe3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:52.002152 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d255c-36b8-4aae-875e-22f9f49d27d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:52.002338 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a145d3-18f4-4bc2-aa5e-0286b40fe3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:52.002614 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a145d3-18f4-4bc2-aa5e-0286b40fe3e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:52.003565 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d255c-36b8-4aae-875e-22f9f49d27d1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:52.014029 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a145d3-18f4-4bc2-aa5e-0286b40fe3e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:52.015486 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a145d3-18f4-4bc2-aa5e-0286b40fe3e1 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:52.022193 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 326/652] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:52:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:52.022945 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d255c-36b8-4aae-875e-22f9f49d27d1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:52.034506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-36a145d3-18f4-4bc2-aa5e-0286b40fe3e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:52.034506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:52.034506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:52.034506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:52.034506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:52.034506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:52.034506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:52.034506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:52.034506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:52.034506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:52.034506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:52.034506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:52.034506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:52.034506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:52.034506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:52.035673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:52.035673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:52.035673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:52.035673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:52.035673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:52.035673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:52.035673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:52.035673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:52.035673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:52.035673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:52.035673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:52.035673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:52.035673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:52.035673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:52.035673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:52.035673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:52.035673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:52.036794 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:52.036794 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:52.036794 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:52.036794 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:52.037498 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 327/653] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:52.038369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a145d3-18f4-4bc2-aa5e-0286b40fe3e1 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:52.148000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d255c-36b8-4aae-875e-22f9f49d27d1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:52.160814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a145d3-18f4-4bc2-aa5e-0286b40fe3e1 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:52.186912 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:52.187918 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06eebb8-aaf2-4c1a-a463-d8793c4186bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:52.188764 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06eebb8-aaf2-4c1a-a463-d8793c4186bd None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:52.189137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06eebb8-aaf2-4c1a-a463-d8793c4186bd None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:52.189571 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06eebb8-aaf2-4c1a-a463-d8793c4186bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:52.200860 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa698d-9895-4cdb-9e29-225ef9cee08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:52.201663 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa698d-9895-4cdb-9e29-225ef9cee08c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:52.201943 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa698d-9895-4cdb-9e29-225ef9cee08c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:52.202045 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06eebb8-aaf2-4c1a-a463-d8793c4186bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:52.202228 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa698d-9895-4cdb-9e29-225ef9cee08c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:52.203488 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06eebb8-aaf2-4c1a-a463-d8793c4186bd None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:52.210087 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa698d-9895-4cdb-9e29-225ef9cee08c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:52.211542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa698d-9895-4cdb-9e29-225ef9cee08c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:52.222597 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-e06eebb8-aaf2-4c1a-a463-d8793c4186bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:52.222597 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:52.222597 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:52.222597 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:52.222597 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:52.222597 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:52.222597 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:52.222597 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:52.222597 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:52.222597 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:52.222597 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:52.222597 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:52.222597 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:52.222597 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:52.222597 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:52.223523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:52.223523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:52.223523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:52.223523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:52.223523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:52.223523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:52.223523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:52.223523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:52.223523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:52.223523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:52.223523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:52.223523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:52.223523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:52.223523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:52.223523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:52.223523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:52.223523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:52.225081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:52.225081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:52.225081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:52.225081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:52.225081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 327/654] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:52.225081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06eebb8-aaf2-4c1a-a463-d8793c4186bd None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:52.231452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-f0fa698d-9895-4cdb-9e29-225ef9cee08c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 21:52:52.231452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:52.231452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:52.231452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:52.231452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:52.231452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:52.231452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:52.231452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:52.231452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:52.231452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:52.231452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:52.231452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:52.231452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:52:52.231452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:52:52.231452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:52:52.231452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:52:52.240167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:52.240167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:52.240167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:52:52.240167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:52.240167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:52:52.240167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:52.240167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:52.240167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:52.240167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:52.240167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:52.240167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:52.240167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:52.240167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:52.240167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:52.240167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:52.240167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:52.240167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:52.240167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:52.241124 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:52.241124 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:52.241124 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:52:52.241124 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:52:52.241124 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:52:52.241124 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:52:52.241124 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:52:52.241124 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:52:52.241124 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 21:52:52.241124 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:52.241124 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 328/655] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:52:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:52.241124 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa698d-9895-4cdb-9e29-225ef9cee08c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:52.252106 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:52.349918 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa698d-9895-4cdb-9e29-225ef9cee08c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:52.356202 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06eebb8-aaf2-4c1a-a463-d8793c4186bd None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:52.400509 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64744f-d781-4674-b1e5-a624418d7afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:52.401909 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64744f-d781-4674-b1e5-a624418d7afb None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:52.402195 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64744f-d781-4674-b1e5-a624418d7afb None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:52.402579 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64744f-d781-4674-b1e5-a624418d7afb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:52.403062 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928bd41-5249-442a-bd28-e7013aec0870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:52.403449 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64744f-d781-4674-b1e5-a624418d7afb None admin] RBAC: Adding query filter params (role.id=372e9dc71b5a4a4daddc43ab384fa67b, scope.project.id=89b20e18525c473e94a2b263148f1f5f, user.id=902ca8f1d59547a0ab187b4748311f58) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:52.403753 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928bd41-5249-442a-bd28-e7013aec0870 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:52.403849 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64744f-d781-4674-b1e5-a624418d7afb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:52.404041 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928bd41-5249-442a-bd28-e7013aec0870 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:52.404321 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928bd41-5249-442a-bd28-e7013aec0870 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:52.405111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928bd41-5249-442a-bd28-e7013aec0870 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:52.405276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64744f-d781-4674-b1e5-a624418d7afb None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:52.405434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928bd41-5249-442a-bd28-e7013aec0870 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:52.406834 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928bd41-5249-442a-bd28-e7013aec0870 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:52.412482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 328/656] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:52:52 2022] GET /identity/v3/role_assignments?user.id=902ca8f1d59547a0ab187b4748311f58&scope.project.id=89b20e18525c473e94a2b263148f1f5f&role.id=372e9dc71b5a4a4daddc43ab384fa67b => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:52.418242 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64744f-d781-4674-b1e5-a624418d7afb None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:52.421405 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 329/657] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:52.427353 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928bd41-5249-442a-bd28-e7013aec0870 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:52.489567 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:52.543781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:52.570693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64744f-d781-4674-b1e5-a624418d7afb None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:52.577678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928bd41-5249-442a-bd28-e7013aec0870 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:52.625044 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689e2a4-a935-49b9-badd-60d18172e27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:52.625731 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689e2a4-a935-49b9-badd-60d18172e27d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:52.626019 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689e2a4-a935-49b9-badd-60d18172e27d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:52.626300 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689e2a4-a935-49b9-badd-60d18172e27d None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:52.627308 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689e2a4-a935-49b9-badd-60d18172e27d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:52.627979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b1bcd-3176-4eec-be1a-30ad65177bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:52.628106 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689e2a4-a935-49b9-badd-60d18172e27d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:52.628192 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b1bcd-3176-4eec-be1a-30ad65177bca None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:52.630362 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b1bcd-3176-4eec-be1a-30ad65177bca None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:52.630362 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b1bcd-3176-4eec-be1a-30ad65177bca None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:52.630362 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b1bcd-3176-4eec-be1a-30ad65177bca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:52.630362 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b1bcd-3176-4eec-be1a-30ad65177bca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:52.630648 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689e2a4-a935-49b9-badd-60d18172e27d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:52.631098 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b1bcd-3176-4eec-be1a-30ad65177bca None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:52.650439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 329/658] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:52.651681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b1bcd-3176-4eec-be1a-30ad65177bca None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:52.654107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 330/659] 10.222.0.35 () {56 vars in 1137 bytes} [Thu May 19 21:52:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:52.655134 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ca56e-76a7-44fd-bb05-a8ea43a131b0 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:52.655426 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ca56e-76a7-44fd-bb05-a8ea43a131b0 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:52.655702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ca56e-76a7-44fd-bb05-a8ea43a131b0 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:52.657331 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 331/660] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:52.660474 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ca56e-76a7-44fd-bb05-a8ea43a131b0 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:52.778437 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b1bcd-3176-4eec-be1a-30ad65177bca None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:52.786562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ca56e-76a7-44fd-bb05-a8ea43a131b0 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:52.788281 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:52.820150 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fe20c-8234-4a30-bf94-00dead415294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:52.821001 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fe20c-8234-4a30-bf94-00dead415294 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:52.821290 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fe20c-8234-4a30-bf94-00dead415294 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:52.821568 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fe20c-8234-4a30-bf94-00dead415294 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:52.828527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da9ee2-e24d-42b5-9f4e-194246231e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:52.829335 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da9ee2-e24d-42b5-9f4e-194246231e48 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:52.829620 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da9ee2-e24d-42b5-9f4e-194246231e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:52.829893 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da9ee2-e24d-42b5-9f4e-194246231e48 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:52.830291 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fe20c-8234-4a30-bf94-00dead415294 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:52.831738 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fe20c-8234-4a30-bf94-00dead415294 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:52.837653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da9ee2-e24d-42b5-9f4e-194246231e48 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:52.839194 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da9ee2-e24d-42b5-9f4e-194246231e48 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:52.846126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-a79fe20c-8234-4a30-bf94-00dead415294 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:52.846126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:52.846126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:52.846126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:52.846126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:52.846126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:52.846126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:52.846126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:52.846126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:52.846126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:52.846126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:52.846126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:52.846126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:52:52.846126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:52:52.846126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:52:52.846988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:52:52.846988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:52.846988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:52.846988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:52.846988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:52.846988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:52.846988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:52.846988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:52.846988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:52.846988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:52.846988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:52.846988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:52.846988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:52.846988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:52.846988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:52.846988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:52.846988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:52.848534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:52:52.848534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:52:52.848534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:52:52.848534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:52:52.848534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:52:52.848534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:52:52.848534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:52.848534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:52.848534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 330/661] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:52:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:52.848534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fe20c-8234-4a30-bf94-00dead415294 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:52.851732 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:52.859745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-60da9ee2-e24d-42b5-9f4e-194246231e48 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 21:52:52.859745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:52.859745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:52.859745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:52.859745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:52.859745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:52.859745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:52.859745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:52.859745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:52.859745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:52.859745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:52.859745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:52.859745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:52:52.859745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:52:52.859745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:52:52.859745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:52:52.860974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:52.860974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:52.860974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:52:52.860974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:52.860974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:52:52.860974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:52.860974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:52.860974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:52.860974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:52.860974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:52.860974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:52.860974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:52.860974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:52.860974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:52.860974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:52.860974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:52.860974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:52.860974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:52.862094 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:52.862094 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:52.862094 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:52:52.862094 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:52:52.862094 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:52:52.862094 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:52:52.862094 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:52:52.862094 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:52:52.862094 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 21:52:52.862094 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:52.862094 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 332/662] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 21:52:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:52.863824 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb8883-8d47-4ded-95d2-c5e4385090c1 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:52.864083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb8883-8d47-4ded-95d2-c5e4385090c1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:52.864670 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb8883-8d47-4ded-95d2-c5e4385090c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:52.888513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b9bb8883-8d47-4ded-95d2-c5e4385090c1 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:52.889831 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b9bb8883-8d47-4ded-95d2-c5e4385090c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:52.984365 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fe20c-8234-4a30-bf94-00dead415294 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:52.984588 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 333/663] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:52.988709 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb8883-8d47-4ded-95d2-c5e4385090c1 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:53.036448 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e8a3e-e99c-4fa7-be1b-6909171865cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:53.037367 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e8a3e-e99c-4fa7-be1b-6909171865cd None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:53.037655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e8a3e-e99c-4fa7-be1b-6909171865cd None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:53.037944 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e8a3e-e99c-4fa7-be1b-6909171865cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:53.091717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:53.101627 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb8883-8d47-4ded-95d2-c5e4385090c1 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:53.116379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e8a3e-e99c-4fa7-be1b-6909171865cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:53.117859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e8a3e-e99c-4fa7-be1b-6909171865cd None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:53.120300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:53.141836 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bd45e-9ccc-4940-8d83-9307ce530790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:53.142513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bd45e-9ccc-4940-8d83-9307ce530790 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:53.142798 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bd45e-9ccc-4940-8d83-9307ce530790 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:53.143294 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bd45e-9ccc-4940-8d83-9307ce530790 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:53.143873 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8bd45e-9ccc-4940-8d83-9307ce530790 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:53.144184 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8bd45e-9ccc-4940-8d83-9307ce530790 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:53.145691 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8bd45e-9ccc-4940-8d83-9307ce530790 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:53.162749 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 334/664] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:52:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:53.162749 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bd45e-9ccc-4940-8d83-9307ce530790 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:53.238720 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 331/665] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:52:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:52:53.238720 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e8a3e-e99c-4fa7-be1b-6909171865cd None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:53.289939 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bd45e-9ccc-4940-8d83-9307ce530790 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:53.328936 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251575b0-b91d-41ed-88f0-95d118860ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:53.329630 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251575b0-b91d-41ed-88f0-95d118860ebe None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:53.329915 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251575b0-b91d-41ed-88f0-95d118860ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:53.330194 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251575b0-b91d-41ed-88f0-95d118860ebe None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:53.331193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251575b0-b91d-41ed-88f0-95d118860ebe None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:53.331504 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251575b0-b91d-41ed-88f0-95d118860ebe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:53.333027 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251575b0-b91d-41ed-88f0-95d118860ebe None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:53.350538 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e8a3e-e99c-4fa7-be1b-6909171865cd None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:53.352278 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:53.358397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 335/666] 10.222.0.35 () {56 vars in 1139 bytes} [Thu May 19 21:52:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:53.359546 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251575b0-b91d-41ed-88f0-95d118860ebe None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:53.375873 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:53.399792 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e497c30-38d5-4fd0-a275-ae53fe4923aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:53.401153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e497c30-38d5-4fd0-a275-ae53fe4923aa None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:53.401456 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e497c30-38d5-4fd0-a275-ae53fe4923aa None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:53.401695 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e497c30-38d5-4fd0-a275-ae53fe4923aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:53.412813 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e497c30-38d5-4fd0-a275-ae53fe4923aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:53.421248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-4e497c30-38d5-4fd0-a275-ae53fe4923aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:53.421248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:53.421248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:53.421248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:53.421248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:53.421248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:53.421248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:53.421248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:53.421248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:53.421248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:53.421248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:53.421248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:53.421248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:53.421248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:53.421248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:53.421248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:53.422206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:53.422206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:53.422206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:53.422206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:53.422206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:53.422206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:53.422206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:53.422206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:53.422206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:53.422206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:53.422206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:53.422206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:53.422206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:53.422206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:53.422206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:53.422206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:53.423031 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:53.423031 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:53.423031 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:53.423031 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:53.423031 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:53.423031 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:53.423031 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:53.423031 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:53.423031 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:53.423031 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:53.423031 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:52:53.423031 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:53.423031 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 332/667] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 21:52:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:53.423729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e497c30-38d5-4fd0-a275-ae53fe4923aa None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:53.487508 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251575b0-b91d-41ed-88f0-95d118860ebe None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:53.528754 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785ce01-cd08-4b65-9987-f1e64f35a9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:53.529420 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785ce01-cd08-4b65-9987-f1e64f35a9ae None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:53.529702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785ce01-cd08-4b65-9987-f1e64f35a9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:53.530132 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785ce01-cd08-4b65-9987-f1e64f35a9ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:53.530816 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785ce01-cd08-4b65-9987-f1e64f35a9ae None admin] RBAC: Adding query filter params (role.id=372e9dc71b5a4a4daddc43ab384fa67b, scope.project.id=89b20e18525c473e94a2b263148f1f5f, user.id=bf64f4ec145742d78eee6c4a447515dc) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:53.531128 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785ce01-cd08-4b65-9987-f1e64f35a9ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:53.532600 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785ce01-cd08-4b65-9987-f1e64f35a9ae None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:53.536170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e497c30-38d5-4fd0-a275-ae53fe4923aa None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:53.539628 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 336/668] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:52:53 2022] GET /identity/v3/role_assignments?user.id=bf64f4ec145742d78eee6c4a447515dc&scope.project.id=89b20e18525c473e94a2b263148f1f5f&role.id=372e9dc71b5a4a4daddc43ab384fa67b => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:53.541408 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785ce01-cd08-4b65-9987-f1e64f35a9ae None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:53.589650 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7087def-75af-4ada-975c-efd30f390156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:53.590787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7087def-75af-4ada-975c-efd30f390156 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:53.591228 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7087def-75af-4ada-975c-efd30f390156 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:53.591658 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7087def-75af-4ada-975c-efd30f390156 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:53.607296 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7087def-75af-4ada-975c-efd30f390156 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:53.609749 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7087def-75af-4ada-975c-efd30f390156 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:53.637083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-e7087def-75af-4ada-975c-efd30f390156 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:53.637083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:53.637083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:53.637083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:53.637083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:53.637083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:53.637083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:53.637083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:53.637083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:53.637083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:53.637083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:53.637083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:53.637083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:53.637083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:53.637083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:53.638245 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:53.638245 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:53.638245 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:53.638245 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:53.638245 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:53.638245 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:53.638245 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:53.638245 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:53.638245 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:53.638245 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:53.638245 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:53.638245 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:53.638245 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:53.638245 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:53.638245 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:53.638245 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:53.638245 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:53.639321 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:53.639321 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:53.639321 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:53.639321 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:53.642202 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 333/669] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:53.643273 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7087def-75af-4ada-975c-efd30f390156 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:53.658104 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:53.671583 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:53.701532 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785ce01-cd08-4b65-9987-f1e64f35a9ae None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:53.754139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9aaea-8a12-4cbd-b69c-d9b0f979bf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:53.754889 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9aaea-8a12-4cbd-b69c-d9b0f979bf77 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:53.755176 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9aaea-8a12-4cbd-b69c-d9b0f979bf77 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:53.755450 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9aaea-8a12-4cbd-b69c-d9b0f979bf77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:53.782098 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7087def-75af-4ada-975c-efd30f390156 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:53.824722 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9560db-222e-4109-83ef-bcd40135bf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:53.826252 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9560db-222e-4109-83ef-bcd40135bf4c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:53.826749 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9560db-222e-4109-83ef-bcd40135bf4c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:53.827530 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9560db-222e-4109-83ef-bcd40135bf4c None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:53.828559 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9560db-222e-4109-83ef-bcd40135bf4c None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:53.829157 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9560db-222e-4109-83ef-bcd40135bf4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:53.831386 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9560db-222e-4109-83ef-bcd40135bf4c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:53.842053 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9aaea-8a12-4cbd-b69c-d9b0f979bf77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:53.843092 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 334/670] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 21:52:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:53.843507 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9aaea-8a12-4cbd-b69c-d9b0f979bf77 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:53.844225 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9560db-222e-4109-83ef-bcd40135bf4c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:53.942733 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:53.950792 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:53.979603 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9560db-222e-4109-83ef-bcd40135bf4c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:53.983645 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 337/671] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:52:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:52:53.984948 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9aaea-8a12-4cbd-b69c-d9b0f979bf77 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:54.021578 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d74bb-725f-44a5-8d4b-589482e405ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:54.022253 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d74bb-725f-44a5-8d4b-589482e405ae None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:54.022540 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d74bb-725f-44a5-8d4b-589482e405ae None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:54.022819 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d74bb-725f-44a5-8d4b-589482e405ae None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:54.023549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d74bb-725f-44a5-8d4b-589482e405ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:54.023858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d74bb-725f-44a5-8d4b-589482e405ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:54.025845 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d74bb-725f-44a5-8d4b-589482e405ae None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:54.038316 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 335/672] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:54.039153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d74bb-725f-44a5-8d4b-589482e405ae None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:54.102876 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9aaea-8a12-4cbd-b69c-d9b0f979bf77 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:54.143631 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c1df9-f03b-4fab-815b-ced204aab1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:54.144551 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c1df9-f03b-4fab-815b-ced204aab1ba None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:54.144834 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c1df9-f03b-4fab-815b-ced204aab1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:54.145104 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c1df9-f03b-4fab-815b-ced204aab1ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:54.149726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d74bb-725f-44a5-8d4b-589482e405ae None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:54.156247 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c1df9-f03b-4fab-815b-ced204aab1ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:54.157856 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c1df9-f03b-4fab-815b-ced204aab1ba None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:54.177441 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-124c1df9-f03b-4fab-815b-ced204aab1ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:54.177441 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:54.177441 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:54.177441 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:54.177441 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:54.177441 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:54.177441 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:54.177441 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:54.177441 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:54.177441 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:54.177441 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:54.177441 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:54.177441 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:54.177441 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:54.177441 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:54.178808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:54.178808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:54.178808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:54.178808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:54.178808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:54.178808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:54.178808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:54.178808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:54.178808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:54.178808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:54.178808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:54.178808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:54.178808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:54.178808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:54.178808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:54.178808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:54.178808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:54.181061 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:54.181061 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:54.181061 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:54.181061 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:54.181061 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 338/673] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:54.181061 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c1df9-f03b-4fab-815b-ced204aab1ba None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:54.186986 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5eabe-2f10-40d2-a2d1-4eb482456346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:54.187584 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5eabe-2f10-40d2-a2d1-4eb482456346 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:54.187905 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5eabe-2f10-40d2-a2d1-4eb482456346 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:54.188148 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5eabe-2f10-40d2-a2d1-4eb482456346 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:54.191131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:54.200296 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b5eabe-2f10-40d2-a2d1-4eb482456346 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:54.201836 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b5eabe-2f10-40d2-a2d1-4eb482456346 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:54.213223 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:54.220789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-12b5eabe-2f10-40d2-a2d1-4eb482456346 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:54.220789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:54.220789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:54.220789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:54.220789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:54.220789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:54.220789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:54.220789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:54.220789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:54.220789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:54.220789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:54.220789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:54.220789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:54.220789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:54.220789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:54.221763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:54.221763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:54.221763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:54.221763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:54.221763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:54.221763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:54.221763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:54.221763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:54.221763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:54.221763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:54.221763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:54.221763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:54.221763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:54.221763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:54.221763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:54.221763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:54.221763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:54.222613 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:54.222613 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:54.222613 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:54.222613 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:54.222613 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 336/674] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:54.223268 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5eabe-2f10-40d2-a2d1-4eb482456346 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:54.314593 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c1df9-f03b-4fab-815b-ced204aab1ba None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:54.335998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5eabe-2f10-40d2-a2d1-4eb482456346 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:54.362677 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa400923-354a-4728-a89b-0e77d040d819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:54.364086 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa400923-354a-4728-a89b-0e77d040d819 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:54.365170 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa400923-354a-4728-a89b-0e77d040d819 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:54.365930 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa400923-354a-4728-a89b-0e77d040d819 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:54.376475 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa400923-354a-4728-a89b-0e77d040d819 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:54.378932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa400923-354a-4728-a89b-0e77d040d819 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:54.386948 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd504d2-d363-4a08-9381-141795c25cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:54.387639 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd504d2-d363-4a08-9381-141795c25cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:54.387983 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd504d2-d363-4a08-9381-141795c25cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:54.388270 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd504d2-d363-4a08-9381-141795c25cf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:54.389091 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd504d2-d363-4a08-9381-141795c25cf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:54.389412 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd504d2-d363-4a08-9381-141795c25cf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:54.390807 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd504d2-d363-4a08-9381-141795c25cf8 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:54.396747 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-aa400923-354a-4728-a89b-0e77d040d819 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:54.396747 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:54.396747 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:54.396747 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:54.396747 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:54.396747 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:54.396747 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:54.396747 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:54.396747 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:54.396747 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:54.396747 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:54.396747 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:54.396747 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:52:54.396747 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:52:54.396747 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:52:54.397608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:52:54.397608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:54.397608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:54.397608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:54.397608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:54.397608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:54.397608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:54.397608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:54.397608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:54.397608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:54.397608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:54.397608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:54.397608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:54.397608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:54.397608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:54.397608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:54.397608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:54.398453 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:52:54.398453 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:52:54.398453 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:52:54.398453 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:52:54.398453 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:52:54.398453 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:52:54.398453 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:54.398453 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:54.402677 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 339/675] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:52:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:54.404130 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa400923-354a-4728-a89b-0e77d040d819 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:54.410400 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 337/676] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:54.411310 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd504d2-d363-4a08-9381-141795c25cf8 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:54.476918 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:54.532462 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:54.539971 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd504d2-d363-4a08-9381-141795c25cf8 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:54.556855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa400923-354a-4728-a89b-0e77d040d819 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:54.581502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4715d46-3a68-4718-b01b-9756f2e7aafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:54.583248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4715d46-3a68-4718-b01b-9756f2e7aafa None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:54.583758 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4715d46-3a68-4718-b01b-9756f2e7aafa None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:54.584561 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4715d46-3a68-4718-b01b-9756f2e7aafa None admin] PATH_INFO: `/v3/users/swift` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:54.597157 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4715d46-3a68-4718-b01b-9756f2e7aafa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:54.599135 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4715d46-3a68-4718-b01b-9756f2e7aafa None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:54.599815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc817ff-913b-494f-bf23-4283d8e0a7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:54.600813 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc817ff-913b-494f-bf23-4283d8e0a7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:54.601171 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc817ff-913b-494f-bf23-4283d8e0a7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:54.601563 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc817ff-913b-494f-bf23-4283d8e0a7b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:54.602383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc817ff-913b-494f-bf23-4283d8e0a7b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:54.602763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc817ff-913b-494f-bf23-4283d8e0a7b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:54.605052 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc817ff-913b-494f-bf23-4283d8e0a7b6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:54.619509 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-a4715d46-3a68-4718-b01b-9756f2e7aafa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 21:52:54.619509 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:54.619509 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:54.619509 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:54.619509 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:54.619509 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:54.619509 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:54.619509 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:54.619509 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:54.619509 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:54.619509 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:54.619509 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:54.619509 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:52:54.619509 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:52:54.619509 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:52:54.619509 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:52:54.621112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:54.621112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:54.621112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:52:54.621112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:54.621112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:52:54.621112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:54.621112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:54.621112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:54.621112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:54.621112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:54.621112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:54.621112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:54.621112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:54.621112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:54.621112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:54.621112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:54.621112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:54.621112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:54.622656 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:54.622656 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:54.622656 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:52:54.622656 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:52:54.622656 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:52:54.622656 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:52:54.622656 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:52:54.622656 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:52:54.622656 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 21:52:54.622656 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:54.623546 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 340/677] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:54.623546 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc817ff-913b-494f-bf23-4283d8e0a7b6 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:54.627108 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 338/678] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:52:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:54.628599 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4715d46-3a68-4718-b01b-9756f2e7aafa None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:54.756494 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc817ff-913b-494f-bf23-4283d8e0a7b6 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:54.762252 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4715d46-3a68-4718-b01b-9756f2e7aafa None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:54.773049 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:54.802766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb5629-fc24-4eb2-b3ed-1688a77dff67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:54.803683 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb5629-fc24-4eb2-b3ed-1688a77dff67 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:54.804038 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb5629-fc24-4eb2-b3ed-1688a77dff67 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:54.804380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb5629-fc24-4eb2-b3ed-1688a77dff67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:54.812187 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7bc78-0c8e-489e-9db3-4dae6f8803c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:54.812735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb5629-fc24-4eb2-b3ed-1688a77dff67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:54.813310 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7bc78-0c8e-489e-9db3-4dae6f8803c8 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:54.813763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7bc78-0c8e-489e-9db3-4dae6f8803c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:54.814205 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7bc78-0c8e-489e-9db3-4dae6f8803c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:54.814453 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb5629-fc24-4eb2-b3ed-1688a77dff67 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:54.815561 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7bc78-0c8e-489e-9db3-4dae6f8803c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:54.816043 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7bc78-0c8e-489e-9db3-4dae6f8803c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:54.818299 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7bc78-0c8e-489e-9db3-4dae6f8803c8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:54.830281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-b2fb5629-fc24-4eb2-b3ed-1688a77dff67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:54.830281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:54.830281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:54.830281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:54.830281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:54.830281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:54.830281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:54.830281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:54.830281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:54.830281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:54.830281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:54.830281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:54.830281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:52:54.830281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:52:54.830281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:52:54.831204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:52:54.831204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:54.831204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:54.831204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:54.831204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:54.831204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:54.831204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:54.831204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:54.831204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:54.831204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:54.831204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:54.831204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:54.831204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:54.831204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:54.831204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:54.831204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:54.831204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:54.832055 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:52:54.832055 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:52:54.832055 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:52:54.832055 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:52:54.832055 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:52:54.832055 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:52:54.832055 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:54.832055 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:54.832055 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 339/679] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:52:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:54.833156 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb5629-fc24-4eb2-b3ed-1688a77dff67 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:54.834696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 341/680] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:52:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:54.838338 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7bc78-0c8e-489e-9db3-4dae6f8803c8 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:54.850450 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:54.965388 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb5629-fc24-4eb2-b3ed-1688a77dff67 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:54.984486 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7bc78-0c8e-489e-9db3-4dae6f8803c8 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:55.005883 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432a0d1-c5f9-47fc-9ce7-26a96dc4b319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:55.006581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432a0d1-c5f9-47fc-9ce7-26a96dc4b319 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:55.006868 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432a0d1-c5f9-47fc-9ce7-26a96dc4b319 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:55.007235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432a0d1-c5f9-47fc-9ce7-26a96dc4b319 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:55.008183 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432a0d1-c5f9-47fc-9ce7-26a96dc4b319 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:55.008537 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432a0d1-c5f9-47fc-9ce7-26a96dc4b319 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:55.010581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432a0d1-c5f9-47fc-9ce7-26a96dc4b319 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:55.027206 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab340ea-ae1c-46cf-9c71-9a4935e2a0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:55.027889 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab340ea-ae1c-46cf-9c71-9a4935e2a0c7 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:55.028175 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab340ea-ae1c-46cf-9c71-9a4935e2a0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:55.028486 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab340ea-ae1c-46cf-9c71-9a4935e2a0c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:55.029950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab340ea-ae1c-46cf-9c71-9a4935e2a0c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:55.030285 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab340ea-ae1c-46cf-9c71-9a4935e2a0c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:55.031757 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab340ea-ae1c-46cf-9c71-9a4935e2a0c7 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:55.037738 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 340/681] 10.222.0.35 () {56 vars in 1135 bytes} [Thu May 19 21:52:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:55.037738 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432a0d1-c5f9-47fc-9ce7-26a96dc4b319 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:55.045585 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 342/682] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:52:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:55.050171 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541fbac-728e-413e-8ec8-62494024bf9c None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:55.050171 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541fbac-728e-413e-8ec8-62494024bf9c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:55.050171 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541fbac-728e-413e-8ec8-62494024bf9c None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:55.050171 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 343/683] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:55.050171 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541fbac-728e-413e-8ec8-62494024bf9c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:55.077422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:55.135194 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:55.168590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432a0d1-c5f9-47fc-9ce7-26a96dc4b319 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:55.175139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541fbac-728e-413e-8ec8-62494024bf9c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:55.204921 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6013d7-5fdc-4bcc-90e7-95b01da730bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:55.205580 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6013d7-5fdc-4bcc-90e7-95b01da730bf None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:55.205863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6013d7-5fdc-4bcc-90e7-95b01da730bf None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:55.206138 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6013d7-5fdc-4bcc-90e7-95b01da730bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:55.206975 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6013d7-5fdc-4bcc-90e7-95b01da730bf None admin] RBAC: Adding query filter params (role.id=372e9dc71b5a4a4daddc43ab384fa67b, scope.project.id=89b20e18525c473e94a2b263148f1f5f, user.id=85924e1dfe664f78af34565db18b0b55) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:55.207302 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6013d7-5fdc-4bcc-90e7-95b01da730bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:55.208856 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6013d7-5fdc-4bcc-90e7-95b01da730bf None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:55.214509 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59470282-d20c-4988-b475-a179efd9e62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:55.215706 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 341/684] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:52:55 2022] GET /identity/v3/role_assignments?user.id=85924e1dfe664f78af34565db18b0b55&scope.project.id=89b20e18525c473e94a2b263148f1f5f&role.id=372e9dc71b5a4a4daddc43ab384fa67b => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:55.216117 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59470282-d20c-4988-b475-a179efd9e62b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:55.216544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6013d7-5fdc-4bcc-90e7-95b01da730bf None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:55.216913 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59470282-d20c-4988-b475-a179efd9e62b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:55.217196 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59470282-d20c-4988-b475-a179efd9e62b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:55.327679 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59470282-d20c-4988-b475-a179efd9e62b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:55.331378 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59470282-d20c-4988-b475-a179efd9e62b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:55.376281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:55.390740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6013d7-5fdc-4bcc-90e7-95b01da730bf None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:55.440857 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:55.441827 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349f17d-6ec1-454d-9508-4b0c6d35aec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:55.442498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349f17d-6ec1-454d-9508-4b0c6d35aec7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:55.442775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349f17d-6ec1-454d-9508-4b0c6d35aec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:55.443079 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349f17d-6ec1-454d-9508-4b0c6d35aec7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:55.443986 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349f17d-6ec1-454d-9508-4b0c6d35aec7 None admin] RBAC: Adding query filter params (role.id=372e9dc71b5a4a4daddc43ab384fa67b, scope.project.id=89b20e18525c473e94a2b263148f1f5f, user.id=a571d6fe63334552b532aae15299ef9a) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:55.444291 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349f17d-6ec1-454d-9508-4b0c6d35aec7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:55.446999 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349f17d-6ec1-454d-9508-4b0c6d35aec7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:55.460789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 342/685] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:52:55 2022] GET /identity/v3/role_assignments?user.id=a571d6fe63334552b532aae15299ef9a&scope.project.id=89b20e18525c473e94a2b263148f1f5f&role.id=372e9dc71b5a4a4daddc43ab384fa67b => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:55.462083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248e275-76a2-4cc9-a31f-c9cfc323c7f6 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:55.462376 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248e275-76a2-4cc9-a31f-c9cfc323c7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:55.462951 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248e275-76a2-4cc9-a31f-c9cfc323c7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:55.496087 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 344/686] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:52:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:52:55.499746 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-0248e275-76a2-4cc9-a31f-c9cfc323c7f6 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:55.501387 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0248e275-76a2-4cc9-a31f-c9cfc323c7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:55.505689 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59470282-d20c-4988-b475-a179efd9e62b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:55.602225 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 343/687] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:55.646282 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59470282-d20c-4988-b475-a179efd9e62b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:55.648130 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0248e275-76a2-4cc9-a31f-c9cfc323c7f6 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:55.694215 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2e2af-cce9-42ce-9615-0f0b9e39781c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:55.694925 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2e2af-cce9-42ce-9615-0f0b9e39781c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:55.695211 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2e2af-cce9-42ce-9615-0f0b9e39781c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:55.695486 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2e2af-cce9-42ce-9615-0f0b9e39781c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:55.707703 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2e2af-cce9-42ce-9615-0f0b9e39781c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:55.709580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2e2af-cce9-42ce-9615-0f0b9e39781c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:55.734988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-09f2e2af-cce9-42ce-9615-0f0b9e39781c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:55.734988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:55.734988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:55.734988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:55.734988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:55.734988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:55.734988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:55.734988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:55.734988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:55.734988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:55.734988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:55.734988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:55.734988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:55.734988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:55.734988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:55.735932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:55.735932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:55.735932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:55.735932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:55.735932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:55.735932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:55.735932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:55.735932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:55.735932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:55.735932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:55.735932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:55.735932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:55.735932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:55.735932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:55.735932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:55.735932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:55.735932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:55.736854 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:55.736854 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:55.736854 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:55.736854 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:55.736854 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 345/688] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:55.737131 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2e2af-cce9-42ce-9615-0f0b9e39781c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:55.759944 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:55.764594 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:55.785439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0248e275-76a2-4cc9-a31f-c9cfc323c7f6 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:55.824946 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd2c9d-d7b2-4eed-a31f-dc0b66ea7fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:55.826524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd2c9d-d7b2-4eed-a31f-dc0b66ea7fad None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:55.827050 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd2c9d-d7b2-4eed-a31f-dc0b66ea7fad None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:55.827530 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd2c9d-d7b2-4eed-a31f-dc0b66ea7fad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:55.845125 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd2c9d-d7b2-4eed-a31f-dc0b66ea7fad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:52:55.854607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-01dd2c9d-d7b2-4eed-a31f-dc0b66ea7fad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:52:55.854607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:55.854607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:55.854607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:55.854607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:55.854607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:55.854607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:55.854607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:55.854607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:55.854607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:55.854607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:55.854607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:55.854607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:52:55.854607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:52:55.854607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:52:55.854607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:52:55.855744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:52:55.855744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:52:55.855744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:52:55.855744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:52:55.855744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:55.855744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:55.855744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:55.855744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:55.855744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:55.855744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:55.855744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:55.855744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:55.855744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:55.855744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:55.855744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:55.855744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:55.857061 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:55.857061 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:55.857061 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:55.857061 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:55.857061 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:52:55.857061 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:52:55.857061 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:52:55.857061 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:52:55.857061 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:52:55.857061 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:52:55.857061 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:52:55.857061 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:55.859284 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2e2af-cce9-42ce-9615-0f0b9e39781c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:55.859773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 344/689] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:52:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:52:55.866084 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd2c9d-d7b2-4eed-a31f-dc0b66ea7fad None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:55.905482 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb724514-9c80-49bb-8670-b9fee90ba254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:55.906173 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb724514-9c80-49bb-8670-b9fee90ba254 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:55.906460 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb724514-9c80-49bb-8670-b9fee90ba254 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:55.906740 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb724514-9c80-49bb-8670-b9fee90ba254 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:55.907496 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb724514-9c80-49bb-8670-b9fee90ba254 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:55.907807 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb724514-9c80-49bb-8670-b9fee90ba254 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:55.909269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb724514-9c80-49bb-8670-b9fee90ba254 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:55.926979 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 346/690] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:52:55.927982 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb724514-9c80-49bb-8670-b9fee90ba254 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:56.002772 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd2c9d-d7b2-4eed-a31f-dc0b66ea7fad None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:56.018722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:56.041822 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb724514-9c80-49bb-8670-b9fee90ba254 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:56.044614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eed7ee-d61b-4225-af32-3d7920fcec96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:56.046325 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eed7ee-d61b-4225-af32-3d7920fcec96 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:56.047118 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eed7ee-d61b-4225-af32-3d7920fcec96 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:56.047835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eed7ee-d61b-4225-af32-3d7920fcec96 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:56.049407 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eed7ee-d61b-4225-af32-3d7920fcec96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:56.050152 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eed7ee-d61b-4225-af32-3d7920fcec96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:56.051974 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eed7ee-d61b-4225-af32-3d7920fcec96 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:56.062217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 345/691] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:52:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:52:56.067943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eed7ee-d61b-4225-af32-3d7920fcec96 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:56.079480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2a164-9bcb-4b45-bd95-d977a7ccb514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:56.079939 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:56.080299 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2a164-9bcb-4b45-bd95-d977a7ccb514 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:56.081131 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2a164-9bcb-4b45-bd95-d977a7ccb514 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:56.081390 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2a164-9bcb-4b45-bd95-d977a7ccb514 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:56.089219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2a164-9bcb-4b45-bd95-d977a7ccb514 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:56.090707 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2a164-9bcb-4b45-bd95-d977a7ccb514 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:56.106823 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-5dd2a164-9bcb-4b45-bd95-d977a7ccb514 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:56.106823 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:56.106823 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:56.106823 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:56.106823 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:56.106823 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:56.106823 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:56.106823 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:56.106823 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:56.106823 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:56.106823 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:56.106823 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:56.106823 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:52:56.106823 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:52:56.106823 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:52:56.107775 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:52:56.107775 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:56.107775 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:56.107775 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:56.107775 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:56.107775 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:56.107775 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:56.107775 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:56.107775 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:56.107775 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:56.107775 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:56.107775 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:56.107775 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:56.107775 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:56.107775 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:56.107775 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:56.107775 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:56.108949 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:52:56.108949 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:52:56.108949 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:52:56.108949 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:52:56.108949 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:52:56.108949 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:52:56.108949 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:56.108949 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:56.108949 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 347/692] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:52:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:56.114140 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2a164-9bcb-4b45-bd95-d977a7ccb514 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:56.195557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eed7ee-d61b-4225-af32-3d7920fcec96 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:56.231972 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2a164-9bcb-4b45-bd95-d977a7ccb514 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:56.235924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f3b24-48b8-42e3-a24e-5f5b0b262dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:56.237045 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f3b24-48b8-42e3-a24e-5f5b0b262dca None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:56.237538 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f3b24-48b8-42e3-a24e-5f5b0b262dca None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:56.238035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f3b24-48b8-42e3-a24e-5f5b0b262dca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:56.252549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f3b24-48b8-42e3-a24e-5f5b0b262dca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:56.255746 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f3b24-48b8-42e3-a24e-5f5b0b262dca None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:56.270594 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff927d99-8fd5-4ebd-83b7-ee4e756f9de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:56.271189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff927d99-8fd5-4ebd-83b7-ee4e756f9de1 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:56.271474 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff927d99-8fd5-4ebd-83b7-ee4e756f9de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:56.271752 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff927d99-8fd5-4ebd-83b7-ee4e756f9de1 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:56.272670 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff927d99-8fd5-4ebd-83b7-ee4e756f9de1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:56.272993 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff927d99-8fd5-4ebd-83b7-ee4e756f9de1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:56.274436 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff927d99-8fd5-4ebd-83b7-ee4e756f9de1 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:56.279560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-cc3f3b24-48b8-42e3-a24e-5f5b0b262dca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:56.279560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:56.279560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:56.279560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:56.279560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:56.279560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:56.279560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:56.279560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:56.279560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:56.279560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:56.279560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:56.279560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:56.279560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:56.279560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:56.279560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:56.280447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:56.280447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:56.280447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:56.280447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:56.280447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:56.280447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:56.280447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:56.280447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:56.280447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:56.280447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:56.280447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:56.280447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:56.280447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:56.280447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:56.280447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:56.280447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:56.280447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:56.281489 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:56.281489 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:56.281489 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:56.281489 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:56.287815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 346/693] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:52:56.289439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 348/694] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:52:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:56.289600 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf0c32-17f5-4263-bf17-8ca86687543c None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:56.290010 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf0c32-17f5-4263-bf17-8ca86687543c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:56.290422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf0c32-17f5-4263-bf17-8ca86687543c None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:56.292937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 347/695] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:56.300566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff927d99-8fd5-4ebd-83b7-ee4e756f9de1 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:56.300566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:56.300822 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf0c32-17f5-4263-bf17-8ca86687543c None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:56.383250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:56.444352 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff927d99-8fd5-4ebd-83b7-ee4e756f9de1 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:56.445089 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf0c32-17f5-4263-bf17-8ca86687543c None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:56.483142 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9fb4b0-934a-48ba-a7b0-1c8dc0062b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:56.483958 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9fb4b0-934a-48ba-a7b0-1c8dc0062b42 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:56.484312 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9fb4b0-934a-48ba-a7b0-1c8dc0062b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:56.484692 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9fb4b0-934a-48ba-a7b0-1c8dc0062b42 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:56.485502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9fb4b0-934a-48ba-a7b0-1c8dc0062b42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:56.485880 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9fb4b0-934a-48ba-a7b0-1c8dc0062b42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:56.487342 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9fb4b0-934a-48ba-a7b0-1c8dc0062b42 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:56.495969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972157a-5569-4acd-972e-1eef5dbab68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:56.496996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972157a-5569-4acd-972e-1eef5dbab68e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:56.497512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972157a-5569-4acd-972e-1eef5dbab68e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:56.497975 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972157a-5569-4acd-972e-1eef5dbab68e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:56.499841 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0972157a-5569-4acd-972e-1eef5dbab68e None admin] RBAC: Adding query filter params (role.id=372e9dc71b5a4a4daddc43ab384fa67b, scope.project.id=89b20e18525c473e94a2b263148f1f5f, user.id=86a4208619f84f16b735871ee114e660) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:56.500395 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0972157a-5569-4acd-972e-1eef5dbab68e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:56.506223 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 349/696] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:56.506223 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a586daa-0535-49cb-9dda-94703211ac6a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:56.506223 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a586daa-0535-49cb-9dda-94703211ac6a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:56.506223 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a586daa-0535-49cb-9dda-94703211ac6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:56.506830 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0972157a-5569-4acd-972e-1eef5dbab68e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:56.520035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 348/697] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:52:56 2022] GET /identity/v3/role_assignments?user.id=86a4208619f84f16b735871ee114e660&scope.project.id=89b20e18525c473e94a2b263148f1f5f&role.id=372e9dc71b5a4a4daddc43ab384fa67b => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:56.521325 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972157a-5569-4acd-972e-1eef5dbab68e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:56.537745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0a586daa-0535-49cb-9dda-94703211ac6a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:56.539076 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0a586daa-0535-49cb-9dda-94703211ac6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:56.656013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972157a-5569-4acd-972e-1eef5dbab68e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:56.687229 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:56.689710 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:56.704654 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a743d6-8d34-47f4-8681-64bccfdd560c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:56.705965 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a743d6-8d34-47f4-8681-64bccfdd560c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:56.706433 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a743d6-8d34-47f4-8681-64bccfdd560c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:56.707174 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a743d6-8d34-47f4-8681-64bccfdd560c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:56.719021 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a743d6-8d34-47f4-8681-64bccfdd560c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:56.721317 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a743d6-8d34-47f4-8681-64bccfdd560c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:56.730508 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 350/698] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:56.738089 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-68a743d6-8d34-47f4-8681-64bccfdd560c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 21:52:56.738089 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:56.738089 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:56.738089 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:56.738089 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:56.738089 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:56.738089 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:56.738089 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:56.738089 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:56.738089 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:56.738089 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:56.738089 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:56.738089 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:52:56.738089 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:52:56.738089 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:52:56.738089 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:52:56.739072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:56.739072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:56.739072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:52:56.739072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:56.739072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:52:56.739072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:52:56.739072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:56.739072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:56.739072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:56.739072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:56.739072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:56.739072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:56.739072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:56.739072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:56.739072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:56.739072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:56.739072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:56.739072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:56.740267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:56.740267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:56.740267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:52:56.740267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:52:56.740267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:52:56.740267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:52:56.740267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:52:56.740267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:52:56.740267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 21:52:56.740267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:56.742741 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 349/699] 10.222.0.35 () {56 vars in 1093 bytes} [Thu May 19 21:52:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:56.748594 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a586daa-0535-49cb-9dda-94703211ac6a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:56.771475 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a743d6-8d34-47f4-8681-64bccfdd560c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:56.892694 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a586daa-0535-49cb-9dda-94703211ac6a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:56.902612 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a743d6-8d34-47f4-8681-64bccfdd560c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:56.931908 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69590f29-22ef-463f-911c-4c3dfa947292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:56.932845 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69590f29-22ef-463f-911c-4c3dfa947292 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:56.933219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69590f29-22ef-463f-911c-4c3dfa947292 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:56.933747 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69590f29-22ef-463f-911c-4c3dfa947292 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:56.934706 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69590f29-22ef-463f-911c-4c3dfa947292 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:56.935052 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69590f29-22ef-463f-911c-4c3dfa947292 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:56.936666 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69590f29-22ef-463f-911c-4c3dfa947292 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:56.940956 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18bcc5-2016-45f0-a936-0d4807bbd5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:56.942047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18bcc5-2016-45f0-a936-0d4807bbd5c2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:56.942535 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18bcc5-2016-45f0-a936-0d4807bbd5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:56.943031 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18bcc5-2016-45f0-a936-0d4807bbd5c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:56.955508 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a18bcc5-2016-45f0-a936-0d4807bbd5c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:56.957318 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a18bcc5-2016-45f0-a936-0d4807bbd5c2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:56.957848 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 351/700] 10.222.0.35 () {56 vars in 1133 bytes} [Thu May 19 21:52:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:56.969542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69590f29-22ef-463f-911c-4c3dfa947292 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:56.984617 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-9a18bcc5-2016-45f0-a936-0d4807bbd5c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:56.984617 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:56.984617 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:56.984617 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:56.984617 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:56.984617 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:56.984617 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:56.984617 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:56.984617 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:56.984617 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:56.984617 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:56.984617 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:56.984617 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:56.984617 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:56.984617 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:56.985549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:56.985549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:56.985549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:56.985549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:56.985549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:56.985549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:56.985549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:56.985549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:56.985549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:56.985549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:56.985549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:56.985549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:56.985549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:56.985549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:56.985549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:56.985549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:56.985549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:56.986416 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:56.986416 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:56.986416 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:56.986416 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:56.986416 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 350/701] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:52:56.993412 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18bcc5-2016-45f0-a936-0d4807bbd5c2 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:57.040833 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:57.052543 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:57.144806 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69590f29-22ef-463f-911c-4c3dfa947292 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:57.149872 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18bcc5-2016-45f0-a936-0d4807bbd5c2 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:57.192334 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce007e-0c3e-4ff1-9e3f-9373e828ba30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:57.193042 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce007e-0c3e-4ff1-9e3f-9373e828ba30 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:57.193327 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce007e-0c3e-4ff1-9e3f-9373e828ba30 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:57.193603 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce007e-0c3e-4ff1-9e3f-9373e828ba30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:57.203979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cac94-0d5c-47df-8f41-2b761ba00a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:57.204690 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cac94-0d5c-47df-8f41-2b761ba00a8e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:57.205386 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cac94-0d5c-47df-8f41-2b761ba00a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:57.205386 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cac94-0d5c-47df-8f41-2b761ba00a8e None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:57.205970 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cac94-0d5c-47df-8f41-2b761ba00a8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:57.206280 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cac94-0d5c-47df-8f41-2b761ba00a8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:57.207675 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cac94-0d5c-47df-8f41-2b761ba00a8e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:57.231323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 351/702] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:57.237176 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cac94-0d5c-47df-8f41-2b761ba00a8e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:57.300036 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce007e-0c3e-4ff1-9e3f-9373e828ba30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:57.302170 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce007e-0c3e-4ff1-9e3f-9373e828ba30 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:57.425726 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:57.478688 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:57.491572 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cac94-0d5c-47df-8f41-2b761ba00a8e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:57.556848 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3931d-1090-4f89-a2b9-a1ad103f85d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:57.557883 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3931d-1090-4f89-a2b9-a1ad103f85d0 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:57.558377 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3931d-1090-4f89-a2b9-a1ad103f85d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:57.558837 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3931d-1090-4f89-a2b9-a1ad103f85d0 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:57.560183 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3931d-1090-4f89-a2b9-a1ad103f85d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:57.562933 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3931d-1090-4f89-a2b9-a1ad103f85d0 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:57.589986 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 352/703] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 21:52:57 2022] POST /identity/v3/users => generated 254 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:52:57.596189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 352/704] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:52:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:52:57.602844 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3931d-1090-4f89-a2b9-a1ad103f85d0 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:57.773112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3931d-1090-4f89-a2b9-a1ad103f85d0 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:57.825613 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fddb0e-7d4f-47fe-a341-ddad72585eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:57.826361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fddb0e-7d4f-47fe-a341-ddad72585eca None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:57.826651 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fddb0e-7d4f-47fe-a341-ddad72585eca None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:57.826931 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fddb0e-7d4f-47fe-a341-ddad72585eca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:57.839544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fddb0e-7d4f-47fe-a341-ddad72585eca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:57.841081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fddb0e-7d4f-47fe-a341-ddad72585eca None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:57.860846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-c3fddb0e-7d4f-47fe-a341-ddad72585eca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:57.860846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:57.860846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:57.860846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:57.860846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:57.860846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:57.860846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:57.860846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:57.860846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:57.860846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:57.860846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:57.860846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:57.860846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:52:57.860846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:52:57.860846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:52:57.861787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:52:57.861787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:57.861787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:57.861787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:57.861787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:57.861787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:57.861787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:57.861787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:57.861787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:57.861787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:57.861787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:57.861787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:57.861787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:57.861787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:57.861787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:57.861787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:57.861787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:57.862640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:52:57.862640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:52:57.862640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:52:57.862640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:57.862640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 353/705] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:52:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:57.868504 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce007e-0c3e-4ff1-9e3f-9373e828ba30 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:58.000391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce007e-0c3e-4ff1-9e3f-9373e828ba30 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:58.049778 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439cc51d-2fbb-49a9-9b7d-58230599c794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:58.050471 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cc51d-2fbb-49a9-9b7d-58230599c794 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:58.050755 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cc51d-2fbb-49a9-9b7d-58230599c794 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:58.051035 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cc51d-2fbb-49a9-9b7d-58230599c794 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:58.051788 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439cc51d-2fbb-49a9-9b7d-58230599c794 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:58.052097 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439cc51d-2fbb-49a9-9b7d-58230599c794 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:58.053792 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439cc51d-2fbb-49a9-9b7d-58230599c794 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:58.067570 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 353/706] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:58.082007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fddb0e-7d4f-47fe-a341-ddad72585eca None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:58.084970 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:58.173414 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfc582-cec4-4ded-9369-2a2de05d3daa None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:58.173708 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfc582-cec4-4ded-9369-2a2de05d3daa None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:58.173989 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfc582-cec4-4ded-9369-2a2de05d3daa None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:58.185312 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 354/707] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:58 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:58.191463 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aebb54-6130-4d12-ab58-fe9674873dfa None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:58.191844 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aebb54-6130-4d12-ab58-fe9674873dfa None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:58.192256 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aebb54-6130-4d12-ab58-fe9674873dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:58.207652 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:58.208014 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fddb0e-7d4f-47fe-a341-ddad72585eca None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:58.218027 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-08aebb54-6130-4d12-ab58-fe9674873dfa None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:58.219358 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-08aebb54-6130-4d12-ab58-fe9674873dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:58.247173 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509e046-baf0-4292-a05c-5540214e10cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:58.247978 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509e046-baf0-4292-a05c-5540214e10cc None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:58.248260 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509e046-baf0-4292-a05c-5540214e10cc None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:58.248580 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509e046-baf0-4292-a05c-5540214e10cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:58.255786 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509e046-baf0-4292-a05c-5540214e10cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:58.257300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509e046-baf0-4292-a05c-5540214e10cc None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:58.273129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-8509e046-baf0-4292-a05c-5540214e10cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:58.273129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:58.273129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:58.273129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:58.273129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:58.273129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:58.273129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:58.273129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:58.273129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:58.273129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:58.273129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:58.273129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:58.273129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:52:58.273129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:52:58.273129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:52:58.274081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:52:58.274081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:58.274081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:58.274081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:58.274081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:58.274081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:58.274081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:58.274081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:58.274081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:58.274081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:58.274081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:58.274081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:58.274081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:58.274081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:58.274081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:58.274081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:58.274081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:58.274959 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:52:58.274959 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:52:58.274959 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:52:58.274959 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:52:58.274959 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:52:58.274959 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:52:58.274959 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:52:58.274959 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:58.274959 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 354/708] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:52:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:58.276090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b540ced-5d5f-486a-a973-ed05cc2eee0f None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:58.276286 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b540ced-5d5f-486a-a973-ed05cc2eee0f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:58.287733 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b540ced-5d5f-486a-a973-ed05cc2eee0f None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:58.287733 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 355/709] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:58.287733 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88236b-176a-4636-a788-f39ae3f3ef69 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:58.287733 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88236b-176a-4636-a788-f39ae3f3ef69 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:58.287733 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88236b-176a-4636-a788-f39ae3f3ef69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:58.306480 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4f88236b-176a-4636-a788-f39ae3f3ef69 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:58.307671 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4f88236b-176a-4636-a788-f39ae3f3ef69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:58.324527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 355/710] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:52:58.335037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aebb54-6130-4d12-ab58-fe9674873dfa None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:58.377109 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:58.388675 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 356/711] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:58.389644 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88236b-176a-4636-a788-f39ae3f3ef69 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:58.495811 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aebb54-6130-4d12-ab58-fe9674873dfa None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:58.520391 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88236b-176a-4636-a788-f39ae3f3ef69 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:58.534062 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d08507-c18f-40cb-b720-24688062c7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:58.534966 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d08507-c18f-40cb-b720-24688062c7ba None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:58.535441 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d08507-c18f-40cb-b720-24688062c7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:58.535885 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d08507-c18f-40cb-b720-24688062c7ba None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:58.536896 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d08507-c18f-40cb-b720-24688062c7ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:58.537390 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d08507-c18f-40cb-b720-24688062c7ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:58.539078 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d08507-c18f-40cb-b720-24688062c7ba None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:58.548605 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:58.559845 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 356/712] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:52:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:58.561205 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d08507-c18f-40cb-b720-24688062c7ba None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:58.569474 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ea14d-0006-45d5-9d5a-732990eb8af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:58.570312 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ea14d-0006-45d5-9d5a-732990eb8af1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:58.570599 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ea14d-0006-45d5-9d5a-732990eb8af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:58.570879 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ea14d-0006-45d5-9d5a-732990eb8af1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:58.571560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ea14d-0006-45d5-9d5a-732990eb8af1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:58.574053 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ea14d-0006-45d5-9d5a-732990eb8af1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:58.590797 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-439ea14d-0006-45d5-9d5a-732990eb8af1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 21:52:58.590797 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:58.590797 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:52:58.590797 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:52:58.590797 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:52:58.590797 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:52:58.590797 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:52:58.590797 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:52:58.590797 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 21:52:58.590797 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:58.590797 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:52:58.590797 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:58.590797 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:58.590797 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:58.590797 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:58.590797 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:58.591924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:58.591924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:58.591924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:58.591924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:58.591924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:58.591924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:58.591924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:58.591924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:52:58.591924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:52:58.591924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:52:58.591924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:52:58.591924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:58.591924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:58.591924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:58.591924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:58.591924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:58.597503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:58.597503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:58.597503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:52:58.597503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:58.597503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:58.597503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:58.597503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:58.597503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:58.597503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:58.597503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:58.597503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:58.597503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:52:58.597503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:52:58.597503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 21:52:58.597503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:52:58.597503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 357/713] 10.222.0.35 () {56 vars in 1129 bytes} [Thu May 19 21:52:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:58.598417 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ea14d-0006-45d5-9d5a-732990eb8af1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:58.665511 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:58.686045 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d08507-c18f-40cb-b720-24688062c7ba None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:58.718758 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ea14d-0006-45d5-9d5a-732990eb8af1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:58.724217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b33529-1501-4d33-87df-e421ae0d0f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:58.725494 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b33529-1501-4d33-87df-e421ae0d0f5e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:58.725979 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b33529-1501-4d33-87df-e421ae0d0f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:58.726903 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b33529-1501-4d33-87df-e421ae0d0f5e None admin] PATH_INFO: `/v3/services/network` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:58.727775 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b33529-1501-4d33-87df-e421ae0d0f5e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:58.730777 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b33529-1501-4d33-87df-e421ae0d0f5e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:58.750192 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-c4b33529-1501-4d33-87df-e421ae0d0f5e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 21:52:58.750192 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:58.750192 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:52:58.750192 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:52:58.750192 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:52:58.750192 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:52:58.750192 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:52:58.750192 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:52:58.750192 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 21:52:58.750192 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:58.750192 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:52:58.750192 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:58.750192 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:52:58.750192 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:52:58.750192 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:52:58.750192 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:52:58.750192 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:52:58.751269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:52:58.751269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:52:58.751269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:52:58.751269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:52:58.751269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:52:58.751269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:52:58.751269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:52:58.751269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:52:58.751269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:52:58.751269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:52:58.751269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:52:58.751269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:52:58.751269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:52:58.751269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:52:58.751269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:52:58.751269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:52:58.752083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:52:58.752083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:52:58.752083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:52:58.752083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:52:58.752083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:52:58.752083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:52:58.752083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:52:58.752083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:52:58.752083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:52:58.752083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:52:58.752083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:52:58.752083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:52:58.752083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 21:52:58.752083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:52:58.754986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 357/714] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:52:58 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:52:58.756237 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b33529-1501-4d33-87df-e421ae0d0f5e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:58.760192 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fba83-a907-4faa-8d26-a38ce3770c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:58.761778 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fba83-a907-4faa-8d26-a38ce3770c55 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:58.761778 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fba83-a907-4faa-8d26-a38ce3770c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:58.761778 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fba83-a907-4faa-8d26-a38ce3770c55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:58.762875 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127fba83-a907-4faa-8d26-a38ce3770c55 None admin] RBAC: Adding query filter params (role.id=04369f3c13174671a298fcd8175998d8, scope.project.id=89b20e18525c473e94a2b263148f1f5f, user.id=902ca8f1d59547a0ab187b4748311f58) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:58.763341 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127fba83-a907-4faa-8d26-a38ce3770c55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:58.765140 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127fba83-a907-4faa-8d26-a38ce3770c55 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:58.776652 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 358/715] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:52:58 2022] GET /identity/v3/role_assignments?user.id=902ca8f1d59547a0ab187b4748311f58&scope.project.id=89b20e18525c473e94a2b263148f1f5f&role.id=04369f3c13174671a298fcd8175998d8 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:58.776652 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fba83-a907-4faa-8d26-a38ce3770c55 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:58.863267 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:58.896219 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fba83-a907-4faa-8d26-a38ce3770c55 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:58.922114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:58.941891 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a117ea-af74-43ff-89d8-6c112d6c90db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:58.942955 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a117ea-af74-43ff-89d8-6c112d6c90db None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:58.943066 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b33529-1501-4d33-87df-e421ae0d0f5e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:58.943602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a117ea-af74-43ff-89d8-6c112d6c90db None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:58.944080 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a117ea-af74-43ff-89d8-6c112d6c90db None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:58.945107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a117ea-af74-43ff-89d8-6c112d6c90db None admin] RBAC: Adding query filter params (name=network) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:58.945640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a117ea-af74-43ff-89d8-6c112d6c90db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:58.947340 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a117ea-af74-43ff-89d8-6c112d6c90db None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:58.953386 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 359/716] 10.222.0.35 () {56 vars in 1112 bytes} [Thu May 19 21:52:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:58.961605 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a117ea-af74-43ff-89d8-6c112d6c90db None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:59.016350 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba302e6-c81a-42f6-bc54-ad6521637196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:59.017087 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba302e6-c81a-42f6-bc54-ad6521637196 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:59.017398 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba302e6-c81a-42f6-bc54-ad6521637196 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:59.017673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba302e6-c81a-42f6-bc54-ad6521637196 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:59.018410 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba302e6-c81a-42f6-bc54-ad6521637196 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:59.018714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba302e6-c81a-42f6-bc54-ad6521637196 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:59.020143 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba302e6-c81a-42f6-bc54-ad6521637196 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:59.032222 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 358/717] 10.222.0.35 () {56 vars in 1124 bytes} [Thu May 19 21:52:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:59.042179 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba302e6-c81a-42f6-bc54-ad6521637196 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:59.152841 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a117ea-af74-43ff-89d8-6c112d6c90db None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:59.196330 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db8c9b-5402-49a1-ab0f-ddaa91cfe43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:59.197576 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db8c9b-5402-49a1-ab0f-ddaa91cfe43d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:59.197873 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db8c9b-5402-49a1-ab0f-ddaa91cfe43d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:59.198137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db8c9b-5402-49a1-ab0f-ddaa91cfe43d None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:59.199246 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db8c9b-5402-49a1-ab0f-ddaa91cfe43d None admin] RBAC: Adding query filter params (type=network) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:59.199687 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db8c9b-5402-49a1-ab0f-ddaa91cfe43d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:59.201120 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db8c9b-5402-49a1-ab0f-ddaa91cfe43d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:59.207755 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 360/718] 10.222.0.35 () {56 vars in 1112 bytes} [Thu May 19 21:52:58 2022] GET /identity/v3/services?type=network => generated 124 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:59.220946 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba302e6-c81a-42f6-bc54-ad6521637196 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:52:59.251666 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:59.268187 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2024d5-469c-4e45-9307-4f3d8bec89ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:52:59.268964 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2024d5-469c-4e45-9307-4f3d8bec89ef None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:59.269248 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2024d5-469c-4e45-9307-4f3d8bec89ef None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:59.269521 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2024d5-469c-4e45-9307-4f3d8bec89ef None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:59.270271 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2024d5-469c-4e45-9307-4f3d8bec89ef None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:52:59.270575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2024d5-469c-4e45-9307-4f3d8bec89ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:52:59.272033 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2024d5-469c-4e45-9307-4f3d8bec89ef None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:52:59.279729 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 359/719] 10.222.0.35 () {56 vars in 1124 bytes} [Thu May 19 21:52:59 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:52:59.714181 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4af72-cd04-4b1b-a52e-20764266a700 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:59.714700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4af72-cd04-4b1b-a52e-20764266a700 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:59.715210 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4af72-cd04-4b1b-a52e-20764266a700 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:59.718277 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 361/720] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:52:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:52:59.725299 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79829af-5c68-44ca-8120-158482887106 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:52:59.725796 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79829af-5c68-44ca-8120-158482887106 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:52:59.725874 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79829af-5c68-44ca-8120-158482887106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:52:59.758910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-f79829af-5c68-44ca-8120-158482887106 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:52:59.760754 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f79829af-5c68-44ca-8120-158482887106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:52:59.861997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 360/721] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:52:59.897525 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4af72-cd04-4b1b-a52e-20764266a700 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:52:59.970536 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:00.049864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4af72-cd04-4b1b-a52e-20764266a700 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:00.112224 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17111ce2-6137-4142-a0fb-006de828a4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:00.113080 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17111ce2-6137-4142-a0fb-006de828a4ea None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:00.113364 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17111ce2-6137-4142-a0fb-006de828a4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:00.113640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17111ce2-6137-4142-a0fb-006de828a4ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:00.133376 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17111ce2-6137-4142-a0fb-006de828a4ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:53:00.141969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-17111ce2-6137-4142-a0fb-006de828a4ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:53:00.141969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:00.141969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:00.141969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:00.141969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:00.141969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:00.141969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:00.141969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:00.141969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:00.141969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:00.141969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:00.141969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:00.141969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:53:00.141969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:53:00.141969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:53:00.141969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:53:00.142904 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:53:00.142904 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:53:00.142904 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:53:00.142904 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:53:00.142904 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:00.142904 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:00.142904 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:00.142904 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:00.142904 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:00.142904 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:00.142904 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:00.142904 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:00.142904 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:00.142904 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:00.142904 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:00.142904 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:00.143713 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:00.143713 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:00.143713 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:00.143713 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:00.143713 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:53:00.143713 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:53:00.143713 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:53:00.143713 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:53:00.143713 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:53:00.143713 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:53:00.143713 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:53:00.143713 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:00.145524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 362/722] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:52:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:00.151184 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79829af-5c68-44ca-8120-158482887106 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:00.305052 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79829af-5c68-44ca-8120-158482887106 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:00.340639 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:00.373211 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7082f2-53f7-49a6-95b7-0025db3d8521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:00.374240 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7082f2-53f7-49a6-95b7-0025db3d8521 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:00.374680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7082f2-53f7-49a6-95b7-0025db3d8521 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:00.375107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7082f2-53f7-49a6-95b7-0025db3d8521 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:00.376037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7082f2-53f7-49a6-95b7-0025db3d8521 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:00.376532 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7082f2-53f7-49a6-95b7-0025db3d8521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:00.378083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7082f2-53f7-49a6-95b7-0025db3d8521 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:00.391776 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 361/723] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:53:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:00.398046 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17111ce2-6137-4142-a0fb-006de828a4ea None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:00.544694 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17111ce2-6137-4142-a0fb-006de828a4ea None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:00.554045 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:00.596091 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25841c-894d-4b8d-92f5-570e97530a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:00.596849 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25841c-894d-4b8d-92f5-570e97530a38 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:00.597133 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25841c-894d-4b8d-92f5-570e97530a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:00.597409 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25841c-894d-4b8d-92f5-570e97530a38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:00.609780 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25841c-894d-4b8d-92f5-570e97530a38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:00.611266 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25841c-894d-4b8d-92f5-570e97530a38 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:00.629615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-4b25841c-894d-4b8d-92f5-570e97530a38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:00.629615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:00.629615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:00.629615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:00.629615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:00.629615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:00.629615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:00.629615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:00.629615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:00.629615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:00.629615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:00.629615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:00.629615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:53:00.629615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:53:00.629615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:53:00.630563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:53:00.630563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:00.630563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:00.630563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:00.630563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:00.630563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:00.630563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:00.630563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:00.630563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:00.630563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:00.630563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:00.630563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:00.630563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:00.630563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:00.630563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:00.630563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:00.630563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:00.631514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:53:00.631514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:53:00.631514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:00.631514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:00.631514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 363/724] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:00.637371 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7082f2-53f7-49a6-95b7-0025db3d8521 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:00.680321 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e8546-3e15-4345-b51c-8934582c93aa None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:00.680668 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e8546-3e15-4345-b51c-8934582c93aa None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:00.680912 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e8546-3e15-4345-b51c-8934582c93aa None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:00.682787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 364/725] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:53:00.688828 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96deec73-3683-4648-a5f1-dc61ad95691e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:00.689126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96deec73-3683-4648-a5f1-dc61ad95691e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:00.689394 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96deec73-3683-4648-a5f1-dc61ad95691e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:00.707875 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-96deec73-3683-4648-a5f1-dc61ad95691e None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:00.709111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-96deec73-3683-4648-a5f1-dc61ad95691e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:00.793051 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 365/726] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 21:53:00.795602 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7082f2-53f7-49a6-95b7-0025db3d8521 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:00.817633 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96deec73-3683-4648-a5f1-dc61ad95691e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:00.855974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0a7e0-6f0f-407a-9730-b3d41c33ea0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:00.856609 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0a7e0-6f0f-407a-9730-b3d41c33ea0f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:00.856893 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0a7e0-6f0f-407a-9730-b3d41c33ea0f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:00.857169 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0a7e0-6f0f-407a-9730-b3d41c33ea0f None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:00.857902 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0a7e0-6f0f-407a-9730-b3d41c33ea0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:00.858206 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0a7e0-6f0f-407a-9730-b3d41c33ea0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:00.859580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0a7e0-6f0f-407a-9730-b3d41c33ea0f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:00.873062 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 362/727] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:00.878084 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0a7e0-6f0f-407a-9730-b3d41c33ea0f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:00.956133 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:00.969111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:00.987435 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96deec73-3683-4648-a5f1-dc61ad95691e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:01.035463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b3548-5707-494d-903e-8b216470421e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:01.036729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b3548-5707-494d-903e-8b216470421e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:01.037016 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b3548-5707-494d-903e-8b216470421e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:01.037348 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b3548-5707-494d-903e-8b216470421e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:01.054745 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b3548-5707-494d-903e-8b216470421e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:53:01.064516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-b11b3548-5707-494d-903e-8b216470421e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:53:01.064516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:01.064516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:01.064516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:01.064516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:01.064516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:01.064516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:01.064516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:01.064516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:01.064516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:01.064516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:01.064516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:01.064516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:53:01.064516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:53:01.064516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:53:01.064516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:53:01.065482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:53:01.065482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:53:01.065482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:53:01.065482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:53:01.065482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:01.065482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:01.065482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:01.065482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:01.065482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:01.065482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:01.065482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:01.065482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:01.065482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:01.065482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:01.065482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:01.065482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:01.066296 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:01.066296 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:01.066296 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:01.066296 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:01.066296 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:53:01.066296 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:53:01.066296 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:53:01.066296 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:53:01.066296 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:53:01.066296 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:53:01.066296 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:53:01.066296 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:01.066296 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 366/728] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 21:53:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:53:01.073156 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b3548-5707-494d-903e-8b216470421e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:01.086471 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0a7e0-6f0f-407a-9730-b3d41c33ea0f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:01.172116 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23731ff1-6dc9-4c63-911c-6a42c008dc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:01.172864 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23731ff1-6dc9-4c63-911c-6a42c008dc89 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:01.173148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23731ff1-6dc9-4c63-911c-6a42c008dc89 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:01.173423 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23731ff1-6dc9-4c63-911c-6a42c008dc89 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:01.186287 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23731ff1-6dc9-4c63-911c-6a42c008dc89 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:01.187755 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23731ff1-6dc9-4c63-911c-6a42c008dc89 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:01.224940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-23731ff1-6dc9-4c63-911c-6a42c008dc89 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 21:53:01.224940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:01.224940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:01.224940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:01.224940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:01.224940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:01.224940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:01.224940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:01.224940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:01.224940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:01.224940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:01.224940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:01.224940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:53:01.224940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:53:01.224940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:53:01.224940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:53:01.225910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:01.225910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:01.225910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:53:01.225910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:01.225910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:53:01.225910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:01.225910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:01.225910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:01.225910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:01.225910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:01.225910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:01.225910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:01.225910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:01.225910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:01.225910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:01.225910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:01.225910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:01.225910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:01.226815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:01.226815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:01.226815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:53:01.226815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:53:01.226815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:53:01.226815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:53:01.226815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:53:01.226815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:53:01.226815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 21:53:01.226815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:01.233532 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 363/729] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:53:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:53:01.234475 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23731ff1-6dc9-4c63-911c-6a42c008dc89 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:01.419705 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b3548-5707-494d-903e-8b216470421e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:01.434763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:01.438496 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23731ff1-6dc9-4c63-911c-6a42c008dc89 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:01.496799 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225ddee-aecf-428f-951e-e47683a95ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:01.498974 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225ddee-aecf-428f-951e-e47683a95ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:01.499424 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225ddee-aecf-428f-951e-e47683a95ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:01.500885 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225ddee-aecf-428f-951e-e47683a95ea4 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:01.502551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225ddee-aecf-428f-951e-e47683a95ea4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:01.504441 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225ddee-aecf-428f-951e-e47683a95ea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:01.507044 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225ddee-aecf-428f-951e-e47683a95ea4 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:01.520838 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 367/730] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 21:53:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:01.530468 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091647f-d5e4-4666-91d6-5a525f38c49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:01.530468 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091647f-d5e4-4666-91d6-5a525f38c49c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:01.530468 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091647f-d5e4-4666-91d6-5a525f38c49c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:01.530468 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091647f-d5e4-4666-91d6-5a525f38c49c None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:01.530839 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091647f-d5e4-4666-91d6-5a525f38c49c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:01.530839 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091647f-d5e4-4666-91d6-5a525f38c49c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:01.530839 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091647f-d5e4-4666-91d6-5a525f38c49c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:01.531046 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225ddee-aecf-428f-951e-e47683a95ea4 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:01.561751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 364/731] 10.222.0.35 () {56 vars in 1135 bytes} [Thu May 19 21:53:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:01.563695 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:01.572524 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091647f-d5e4-4666-91d6-5a525f38c49c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:01.707990 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225ddee-aecf-428f-951e-e47683a95ea4 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:01.711121 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091647f-d5e4-4666-91d6-5a525f38c49c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:01.751309 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae5e9b-a3db-41ec-82f7-ca676b96e953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:01.751972 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae5e9b-a3db-41ec-82f7-ca676b96e953 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:01.752258 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae5e9b-a3db-41ec-82f7-ca676b96e953 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:01.752581 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae5e9b-a3db-41ec-82f7-ca676b96e953 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:01.756132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458987da-a1a9-4653-ab26-bf306d92986a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:01.758139 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458987da-a1a9-4653-ab26-bf306d92986a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:01.758621 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458987da-a1a9-4653-ab26-bf306d92986a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:01.759101 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458987da-a1a9-4653-ab26-bf306d92986a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:01.775962 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458987da-a1a9-4653-ab26-bf306d92986a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:01.779045 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458987da-a1a9-4653-ab26-bf306d92986a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:01.790045 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:01.809569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-458987da-a1a9-4653-ab26-bf306d92986a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:01.809569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:01.809569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:01.809569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:01.809569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:01.809569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:01.809569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:01.809569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:01.809569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:01.809569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:01.809569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:01.809569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:01.809569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:53:01.809569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:53:01.809569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:53:01.810532 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:53:01.810532 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:01.810532 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:01.810532 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:01.810532 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:01.810532 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:01.810532 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:01.810532 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:01.810532 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:01.810532 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:01.810532 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:01.810532 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:01.810532 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:01.810532 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:01.810532 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:01.810532 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:01.810532 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:01.811412 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:53:01.811412 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:53:01.811412 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:01.811412 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:01.814291 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 368/732] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:01.816116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55df403-79bd-476c-95ac-a42652ae9702 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:01.816602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55df403-79bd-476c-95ac-a42652ae9702 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:01.817437 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55df403-79bd-476c-95ac-a42652ae9702 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:01.819172 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 369/733] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:01.820912 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55df403-79bd-476c-95ac-a42652ae9702 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:01.839926 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae5e9b-a3db-41ec-82f7-ca676b96e953 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:01.842086 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae5e9b-a3db-41ec-82f7-ca676b96e953 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:01.916964 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:01.962770 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 365/734] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:53:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:53:01.964733 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565914b-82c2-4e2f-848f-9df75cb7a582 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:01.965243 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565914b-82c2-4e2f-848f-9df75cb7a582 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:01.965724 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565914b-82c2-4e2f-848f-9df75cb7a582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:01.981234 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55df403-79bd-476c-95ac-a42652ae9702 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:01.992756 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a565914b-82c2-4e2f-848f-9df75cb7a582 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:01.994899 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a565914b-82c2-4e2f-848f-9df75cb7a582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:02.032668 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bdcbe-8de6-4417-94ca-c8be035b8278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:02.033407 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bdcbe-8de6-4417-94ca-c8be035b8278 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:02.033699 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bdcbe-8de6-4417-94ca-c8be035b8278 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:02.033978 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bdcbe-8de6-4417-94ca-c8be035b8278 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:02.034744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505bdcbe-8de6-4417-94ca-c8be035b8278 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:02.035055 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505bdcbe-8de6-4417-94ca-c8be035b8278 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:02.036977 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505bdcbe-8de6-4417-94ca-c8be035b8278 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:02.053353 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 370/735] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:02.054353 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bdcbe-8de6-4417-94ca-c8be035b8278 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:02.065249 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:02.083046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 366/736] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:53:02.084385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565914b-82c2-4e2f-848f-9df75cb7a582 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:02.179404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bdcbe-8de6-4417-94ca-c8be035b8278 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:02.195814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565914b-82c2-4e2f-848f-9df75cb7a582 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:02.209594 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:02.221736 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97debd-19c3-49e7-8816-4a8640fce382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:02.222519 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97debd-19c3-49e7-8816-4a8640fce382 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:02.222808 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97debd-19c3-49e7-8816-4a8640fce382 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:02.223083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97debd-19c3-49e7-8816-4a8640fce382 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:02.234383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97debd-19c3-49e7-8816-4a8640fce382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:02.235751 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97debd-19c3-49e7-8816-4a8640fce382 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:02.240291 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da42814-5b80-4834-9dff-877d0f22f520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:02.241426 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da42814-5b80-4834-9dff-877d0f22f520 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:02.241861 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da42814-5b80-4834-9dff-877d0f22f520 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:02.242303 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da42814-5b80-4834-9dff-877d0f22f520 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:02.251967 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da42814-5b80-4834-9dff-877d0f22f520 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:02.253764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da42814-5b80-4834-9dff-877d0f22f520 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:02.255448 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-ba97debd-19c3-49e7-8816-4a8640fce382 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:02.255448 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:02.255448 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:02.255448 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:02.255448 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:02.255448 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:02.255448 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:02.255448 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:02.255448 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:02.255448 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:02.255448 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:02.255448 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:02.255448 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:53:02.255448 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:53:02.255448 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:53:02.256534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:53:02.256534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:02.256534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:02.256534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:02.256534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:02.256534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:02.256534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:02.256534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:02.256534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:02.256534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:02.256534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:02.256534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:02.256534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:02.256534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:02.256534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:02.256534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:02.256534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:02.257391 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:53:02.257391 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:53:02.257391 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:02.257391 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:02.260560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 371/737] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:02.261451 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97debd-19c3-49e7-8816-4a8640fce382 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:02.274434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-2da42814-5b80-4834-9dff-877d0f22f520 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 21:53:02.274434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:02.274434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:02.274434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:02.274434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:02.274434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:02.274434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:02.274434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:02.274434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:02.274434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:02.274434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:02.274434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:02.274434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:53:02.274434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:53:02.274434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:53:02.274434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:53:02.276383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:02.276383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:02.276383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:53:02.276383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:02.276383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:53:02.276383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:02.276383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:02.276383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:02.276383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:02.276383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:02.276383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:02.276383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:02.276383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:02.276383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:02.276383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:02.276383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:02.276383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:02.276383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:02.277391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:02.277391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:02.277391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:53:02.277391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:53:02.277391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:53:02.277391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:53:02.277391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:53:02.277391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:53:02.277391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 21:53:02.277391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:02.277391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 367/738] 10.222.0.35 () {56 vars in 1117 bytes} [Thu May 19 21:53:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:02.278432 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfe9e8-b63c-470c-a16d-ceef8ccf9e19 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:02.278501 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfe9e8-b63c-470c-a16d-ceef8ccf9e19 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:02.278743 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfe9e8-b63c-470c-a16d-ceef8ccf9e19 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:02.280031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 368/739] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:02.280906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfe9e8-b63c-470c-a16d-ceef8ccf9e19 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:02.333444 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:02.379496 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97debd-19c3-49e7-8816-4a8640fce382 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:02.391055 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfe9e8-b63c-470c-a16d-ceef8ccf9e19 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:02.414440 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974e3ae-02f2-479f-a5ab-8dbb050438a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:02.415254 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974e3ae-02f2-479f-a5ab-8dbb050438a7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:02.415534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974e3ae-02f2-479f-a5ab-8dbb050438a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:02.416553 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974e3ae-02f2-479f-a5ab-8dbb050438a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:02.426973 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974e3ae-02f2-479f-a5ab-8dbb050438a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:53:02.431879 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e1dc6-6bc6-4db6-bf2c-254be124453f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:02.432614 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e1dc6-6bc6-4db6-bf2c-254be124453f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:02.432860 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e1dc6-6bc6-4db6-bf2c-254be124453f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:02.433133 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e1dc6-6bc6-4db6-bf2c-254be124453f None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:02.433867 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e1dc6-6bc6-4db6-bf2c-254be124453f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:02.434174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e1dc6-6bc6-4db6-bf2c-254be124453f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:02.435397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-2974e3ae-02f2-479f-a5ab-8dbb050438a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:53:02.435397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:02.435397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:02.435397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:02.435397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:02.435397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:02.435397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:02.435397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:02.435397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:02.435397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:02.435397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:02.435397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:02.435397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:53:02.435397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:53:02.435397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:53:02.435397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:53:02.436307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:53:02.436307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:53:02.436307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:53:02.436307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:53:02.436307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:02.436307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:02.436307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:02.436307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:02.436307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:02.436307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:02.436307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:02.436307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:02.436307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:02.436307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:02.436307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:02.436307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:02.437164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:02.437164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:02.437164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:02.437164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:02.437164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:53:02.437164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:53:02.437164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:53:02.437164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:53:02.437164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:53:02.437164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:53:02.437164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:53:02.437164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:02.438122 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e1dc6-6bc6-4db6-bf2c-254be124453f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:02.438195 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 372/740] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:53:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:02.438195 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b1fc2-a3a6-48c3-9560-04d145ea91e6 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:02.438195 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b1fc2-a3a6-48c3-9560-04d145ea91e6 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:02.438376 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b1fc2-a3a6-48c3-9560-04d145ea91e6 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:02.439576 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 373/741] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:02.440251 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b1fc2-a3a6-48c3-9560-04d145ea91e6 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:02.455070 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 369/742] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:02.456461 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9abfe-1d18-42a5-b83b-5bc5ae8f536f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:02.456741 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9abfe-1d18-42a5-b83b-5bc5ae8f536f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:02.457020 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9abfe-1d18-42a5-b83b-5bc5ae8f536f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:02.474462 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7fd9abfe-1d18-42a5-b83b-5bc5ae8f536f None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:02.475596 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7fd9abfe-1d18-42a5-b83b-5bc5ae8f536f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:02.480807 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:02.547112 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 370/743] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:53:02.547952 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9abfe-1d18-42a5-b83b-5bc5ae8f536f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:02.555822 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b1fc2-a3a6-48c3-9560-04d145ea91e6 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:02.591709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1b6eb-f559-4edc-b2db-f132e49460a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:02.592376 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1b6eb-f559-4edc-b2db-f132e49460a7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:02.592684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1b6eb-f559-4edc-b2db-f132e49460a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:02.592955 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1b6eb-f559-4edc-b2db-f132e49460a7 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:02.593786 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1b6eb-f559-4edc-b2db-f132e49460a7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:02.594089 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1b6eb-f559-4edc-b2db-f132e49460a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:02.595019 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:02.595518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1b6eb-f559-4edc-b2db-f132e49460a7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:02.616129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 374/744] 10.222.0.35 () {56 vars in 1149 bytes} [Thu May 19 21:53:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:02.617408 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72109c8-c0b1-4994-a0cf-bdc61c3c0fb8 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:02.617700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72109c8-c0b1-4994-a0cf-bdc61c3c0fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:02.617967 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72109c8-c0b1-4994-a0cf-bdc61c3c0fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:02.635197 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c72109c8-c0b1-4994-a0cf-bdc61c3c0fb8 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:02.636384 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c72109c8-c0b1-4994-a0cf-bdc61c3c0fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:02.668032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9abfe-1d18-42a5-b83b-5bc5ae8f536f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:02.703986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c3fa6-9701-4779-b103-8fe5c6202f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:02.704819 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 375/745] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 21:53:02.704954 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c3fa6-9701-4779-b103-8fe5c6202f2c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:02.704954 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c3fa6-9701-4779-b103-8fe5c6202f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:02.705232 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c3fa6-9701-4779-b103-8fe5c6202f2c None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:02.705569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72109c8-c0b1-4994-a0cf-bdc61c3c0fb8 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:02.705991 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c3fa6-9701-4779-b103-8fe5c6202f2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:02.706299 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c3fa6-9701-4779-b103-8fe5c6202f2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:02.707744 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c3fa6-9701-4779-b103-8fe5c6202f2c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:02.717403 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 371/746] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:53:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:02.718246 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c3fa6-9701-4779-b103-8fe5c6202f2c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:02.738357 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:02.824149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72109c8-c0b1-4994-a0cf-bdc61c3c0fb8 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:02.824961 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:02.828033 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c3fa6-9701-4779-b103-8fe5c6202f2c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:02.859711 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c22ba7-69df-45f2-ad17-a530f77860d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:02.860541 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c22ba7-69df-45f2-ad17-a530f77860d2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:02.860831 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c22ba7-69df-45f2-ad17-a530f77860d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:02.861108 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c22ba7-69df-45f2-ad17-a530f77860d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:02.862896 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f814b-e42d-4d99-85d8-4668ecd3d80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:02.864813 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f814b-e42d-4d99-85d8-4668ecd3d80b None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:02.865366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f814b-e42d-4d99-85d8-4668ecd3d80b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:02.865698 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f814b-e42d-4d99-85d8-4668ecd3d80b None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:02.866476 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8f814b-e42d-4d99-85d8-4668ecd3d80b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:02.867871 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8f814b-e42d-4d99-85d8-4668ecd3d80b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:02.868504 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c22ba7-69df-45f2-ad17-a530f77860d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:02.871121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c22ba7-69df-45f2-ad17-a530f77860d2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:02.883728 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 372/747] 10.222.0.35 () {60 vars in 1141 bytes} [Thu May 19 21:53:02 2022] POST /identity/v3/services => generated 251 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:53:02.884680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f814b-e42d-4d99-85d8-4668ecd3d80b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:02.887590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-f7c22ba7-69df-45f2-ad17-a530f77860d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:02.887590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:02.887590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:02.887590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:02.887590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:02.887590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:02.887590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:02.887590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:02.887590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:02.887590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:02.887590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:02.887590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:02.887590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:53:02.887590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:53:02.887590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:53:02.888602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:53:02.888602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:02.888602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:02.888602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:02.888602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:02.888602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:02.888602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:02.888602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:02.888602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:02.888602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:02.888602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:02.888602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:02.888602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:02.888602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:02.888602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:02.888602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:02.888602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:02.889516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:53:02.889516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:53:02.889516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:53:02.889516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:53:02.889516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:53:02.889516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:53:02.889516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:02.889516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:02.889516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 376/748] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:53:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:02.889984 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c22ba7-69df-45f2-ad17-a530f77860d2 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:03.004129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:03.024477 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c22ba7-69df-45f2-ad17-a530f77860d2 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:03.046252 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f814b-e42d-4d99-85d8-4668ecd3d80b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:03.066795 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bb119-62bf-46e8-9065-30fb8b40c22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:03.067611 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bb119-62bf-46e8-9065-30fb8b40c22d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:03.067892 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bb119-62bf-46e8-9065-30fb8b40c22d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:03.068167 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bb119-62bf-46e8-9065-30fb8b40c22d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:03.085104 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73bb119-62bf-46e8-9065-30fb8b40c22d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:03.087026 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73bb119-62bf-46e8-9065-30fb8b40c22d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:03.092852 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a3177-90dc-4410-a87a-579c70604998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:03.093517 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a3177-90dc-4410-a87a-579c70604998 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:03.093802 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a3177-90dc-4410-a87a-579c70604998 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:03.094080 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a3177-90dc-4410-a87a-579c70604998 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:03.108539 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-a73bb119-62bf-46e8-9065-30fb8b40c22d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:03.108539 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:03.108539 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:03.108539 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:03.108539 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:03.108539 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:03.108539 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:03.108539 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:03.108539 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:03.108539 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:03.108539 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:03.108539 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:03.108539 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:53:03.108539 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:53:03.108539 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:53:03.109454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:53:03.109454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:03.109454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:03.109454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:03.109454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:03.109454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:03.109454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:03.109454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:03.109454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:03.109454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:03.109454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:03.109454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:03.109454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:03.109454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:03.109454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:03.109454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:03.109454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:03.110551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:53:03.110551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:53:03.110551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:03.110551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:03.110551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 377/749] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:03.110551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bb119-62bf-46e8-9065-30fb8b40c22d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:03.124697 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:03.174479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a3177-90dc-4410-a87a-579c70604998 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:03.183144 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a3177-90dc-4410-a87a-579c70604998 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:03.227626 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bb119-62bf-46e8-9065-30fb8b40c22d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:03.264287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e38e4c-a4b7-4c60-bdf9-1ea501999c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:03.264913 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e38e4c-a4b7-4c60-bdf9-1ea501999c9f None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:03.265204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e38e4c-a4b7-4c60-bdf9-1ea501999c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:03.265485 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e38e4c-a4b7-4c60-bdf9-1ea501999c9f None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:03.266217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e38e4c-a4b7-4c60-bdf9-1ea501999c9f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:03.267597 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e38e4c-a4b7-4c60-bdf9-1ea501999c9f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:03.271566 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:03.283945 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 378/750] 10.222.0.35 () {60 vars in 1141 bytes} [Thu May 19 21:53:03 2022] POST /identity/v3/services => generated 240 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:53:03.284983 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e38e4c-a4b7-4c60-bdf9-1ea501999c9f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:03.334319 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 373/751] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:53:02 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 21:53:03.335583 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a3177-90dc-4410-a87a-579c70604998 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:03.423919 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:03.452201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e38e4c-a4b7-4c60-bdf9-1ea501999c9f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:03.480099 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a3177-90dc-4410-a87a-579c70604998 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:03.510789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c9dc6-9c68-4c86-98ff-ce03699b44c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:03.511465 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c9dc6-9c68-4c86-98ff-ce03699b44c2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:03.511749 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c9dc6-9c68-4c86-98ff-ce03699b44c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:03.512051 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c9dc6-9c68-4c86-98ff-ce03699b44c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:03.512924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c9dc6-9c68-4c86-98ff-ce03699b44c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:03.513235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c9dc6-9c68-4c86-98ff-ce03699b44c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:03.514818 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c9dc6-9c68-4c86-98ff-ce03699b44c2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:03.527601 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171b1c8-0026-4c31-8fe1-6a6fcc3b47c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:03.528295 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171b1c8-0026-4c31-8fe1-6a6fcc3b47c9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:03.528847 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171b1c8-0026-4c31-8fe1-6a6fcc3b47c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:03.528970 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 379/752] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:53:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:03.529049 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171b1c8-0026-4c31-8fe1-6a6fcc3b47c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:03.530208 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c9dc6-9c68-4c86-98ff-ce03699b44c2 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:03.530318 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171b1c8-0026-4c31-8fe1-6a6fcc3b47c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:03.530318 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171b1c8-0026-4c31-8fe1-6a6fcc3b47c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:03.531478 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171b1c8-0026-4c31-8fe1-6a6fcc3b47c9 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:03.550373 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 374/753] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:03.551259 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171b1c8-0026-4c31-8fe1-6a6fcc3b47c9 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:03.602996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:03.669830 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c9dc6-9c68-4c86-98ff-ce03699b44c2 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:03.687312 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171b1c8-0026-4c31-8fe1-6a6fcc3b47c9 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:03.706680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:03.711284 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b117e05-423e-456c-8b3a-9948cf1f278b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:03.712098 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b117e05-423e-456c-8b3a-9948cf1f278b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:03.712383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b117e05-423e-456c-8b3a-9948cf1f278b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:03.713289 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b117e05-423e-456c-8b3a-9948cf1f278b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:03.726181 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b117e05-423e-456c-8b3a-9948cf1f278b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:03.727946 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b117e05-423e-456c-8b3a-9948cf1f278b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:03.729517 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1e05e-c7ae-4eab-8709-2b23bb76da6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:03.730465 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1e05e-c7ae-4eab-8709-2b23bb76da6a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:03.730945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1e05e-c7ae-4eab-8709-2b23bb76da6a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:03.731451 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1e05e-c7ae-4eab-8709-2b23bb76da6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:03.732517 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1e05e-c7ae-4eab-8709-2b23bb76da6a None admin] RBAC: Adding query filter params (role.id=04369f3c13174671a298fcd8175998d8, scope.project.id=89b20e18525c473e94a2b263148f1f5f, user.id=86a4208619f84f16b735871ee114e660) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:03.733045 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1e05e-c7ae-4eab-8709-2b23bb76da6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:03.734770 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1e05e-c7ae-4eab-8709-2b23bb76da6a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:03.747762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-0b117e05-423e-456c-8b3a-9948cf1f278b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:03.747762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:03.747762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:03.747762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:03.747762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:03.747762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:03.747762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:03.747762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:03.747762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:03.747762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:03.747762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:03.747762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:03.747762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:53:03.747762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:53:03.747762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:53:03.748762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:53:03.748762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:03.748762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:03.748762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:03.748762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:03.748762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:03.748762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:03.748762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:03.748762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:03.748762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:03.748762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:03.748762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:03.748762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:03.748762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:03.748762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:03.748762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:03.748762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:03.749608 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:53:03.749608 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:53:03.749608 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:03.749608 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:03.750385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 375/755] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:53:03 2022] GET /identity/v3/role_assignments?user.id=86a4208619f84f16b735871ee114e660&scope.project.id=89b20e18525c473e94a2b263148f1f5f&role.id=04369f3c13174671a298fcd8175998d8 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:03.751608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1e05e-c7ae-4eab-8709-2b23bb76da6a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:03.753978 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 380/755] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:03.755231 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b117e05-423e-456c-8b3a-9948cf1f278b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:03.874482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b117e05-423e-456c-8b3a-9948cf1f278b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:03.876992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:03.915990 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b4866-3377-4bf4-ad3c-8f8a50c80d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:03.916994 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b4866-3377-4bf4-ad3c-8f8a50c80d5d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:03.917477 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b4866-3377-4bf4-ad3c-8f8a50c80d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:03.917944 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b4866-3377-4bf4-ad3c-8f8a50c80d5d None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:03.919033 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b4866-3377-4bf4-ad3c-8f8a50c80d5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:03.919644 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b4866-3377-4bf4-ad3c-8f8a50c80d5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:03.921293 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b4866-3377-4bf4-ad3c-8f8a50c80d5d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:03.926473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1e05e-c7ae-4eab-8709-2b23bb76da6a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:03.936771 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 381/756] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:03.942779 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b4866-3377-4bf4-ad3c-8f8a50c80d5d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:03.966768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf64f6-04a6-4a39-ab3a-5738b843ade8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:03.967700 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf64f6-04a6-4a39-ab3a-5738b843ade8 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:03.968233 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf64f6-04a6-4a39-ab3a-5738b843ade8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:03.968736 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf64f6-04a6-4a39-ab3a-5738b843ade8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:03.978672 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf64f6-04a6-4a39-ab3a-5738b843ade8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:03.980066 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf64f6-04a6-4a39-ab3a-5738b843ade8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:03.996678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-77cf64f6-04a6-4a39-ab3a-5738b843ade8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 21:53:03.996678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:03.996678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:03.996678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:03.996678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:03.996678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:03.996678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:03.996678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:03.996678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:03.996678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:03.996678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:03.996678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:03.996678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:53:03.996678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:53:03.996678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:53:03.996678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:53:03.997789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:03.997789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:03.997789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:53:03.997789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:03.997789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:53:03.997789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:03.997789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:03.997789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:03.997789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:03.997789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:03.997789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:03.997789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:03.997789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:03.997789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:03.997789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:03.997789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:03.997789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:03.997789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:03.998695 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:03.998695 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:03.998695 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:53:03.998695 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:53:03.998695 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:53:03.998695 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:53:03.998695 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:53:03.998695 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:53:03.998695 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 21:53:03.998695 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:03.998695 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 376/757] 10.222.0.35 () {56 vars in 1093 bytes} [Thu May 19 21:53:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:04.004001 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf64f6-04a6-4a39-ab3a-5738b843ade8 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:04.068299 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:04.085944 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b4866-3377-4bf4-ad3c-8f8a50c80d5d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:04.138416 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa882447-6ca9-4350-acd7-e16581af34b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:04.139716 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa882447-6ca9-4350-acd7-e16581af34b7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:04.140226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa882447-6ca9-4350-acd7-e16581af34b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:04.140739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa882447-6ca9-4350-acd7-e16581af34b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:04.149023 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa882447-6ca9-4350-acd7-e16581af34b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:04.149237 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf64f6-04a6-4a39-ab3a-5738b843ade8 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:04.151580 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa882447-6ca9-4350-acd7-e16581af34b7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:04.170013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-aa882447-6ca9-4350-acd7-e16581af34b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:04.170013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:04.170013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:04.170013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:04.170013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:04.170013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:04.170013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:04.170013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:04.170013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:04.170013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:04.170013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:04.170013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:04.170013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:53:04.170013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:53:04.170013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:53:04.170976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:53:04.170976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:04.170976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:04.170976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:04.170976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:04.170976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:04.170976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:04.170976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:04.170976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:04.170976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:04.170976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:04.170976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:04.170976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:04.170976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:04.170976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:04.170976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:04.170976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:04.171869 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:53:04.171869 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:53:04.171869 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:53:04.171869 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:53:04.171869 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:53:04.171869 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:53:04.171869 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:04.171869 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:04.174463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 382/758] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:53:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:04.180189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa882447-6ca9-4350-acd7-e16581af34b7 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:04.192507 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45717d-f208-431f-88d1-4395d469b2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:04.193252 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45717d-f208-431f-88d1-4395d469b2e0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:04.193470 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45717d-f208-431f-88d1-4395d469b2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:04.193830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45717d-f208-431f-88d1-4395d469b2e0 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:04.194677 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45717d-f208-431f-88d1-4395d469b2e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:04.194985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45717d-f208-431f-88d1-4395d469b2e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:04.196481 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45717d-f208-431f-88d1-4395d469b2e0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:04.210616 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:04.219947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 377/759] 10.222.0.35 () {56 vars in 1133 bytes} [Thu May 19 21:53:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:04.221366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45717d-f208-431f-88d1-4395d469b2e0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:04.300425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa882447-6ca9-4350-acd7-e16581af34b7 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:04.343257 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbd2ee-1164-4da8-ac8a-0e498c57513b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:04.344278 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbd2ee-1164-4da8-ac8a-0e498c57513b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:04.344790 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbd2ee-1164-4da8-ac8a-0e498c57513b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:04.345299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbd2ee-1164-4da8-ac8a-0e498c57513b None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:04.346352 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbd2ee-1164-4da8-ac8a-0e498c57513b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:04.346896 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbd2ee-1164-4da8-ac8a-0e498c57513b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:04.348573 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbd2ee-1164-4da8-ac8a-0e498c57513b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:04.356979 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:04.366938 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45717d-f208-431f-88d1-4395d469b2e0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:04.367528 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 383/760] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:53:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:04.369894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbd2ee-1164-4da8-ac8a-0e498c57513b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:04.461717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5ed8a-9fc0-4778-957e-87d21128936a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:04.463100 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5ed8a-9fc0-4778-957e-87d21128936a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:04.463949 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5ed8a-9fc0-4778-957e-87d21128936a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:04.464301 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5ed8a-9fc0-4778-957e-87d21128936a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:04.469902 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:04.489597 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5ed8a-9fc0-4778-957e-87d21128936a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:04.491365 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5ed8a-9fc0-4778-957e-87d21128936a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:04.492071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbd2ee-1164-4da8-ac8a-0e498c57513b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:04.527165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-7dc5ed8a-9fc0-4778-957e-87d21128936a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:04.527165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:04.527165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:04.527165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:04.527165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:04.527165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:04.527165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:04.527165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:04.527165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:04.527165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:04.527165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:04.527165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:04.527165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:53:04.527165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:53:04.527165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:53:04.528127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:53:04.528127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:04.528127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:04.528127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:04.528127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:04.528127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:04.528127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:04.528127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:04.528127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:04.528127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:04.528127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:04.528127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:04.528127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:04.528127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:04.528127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:04.528127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:04.528127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:04.529062 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:53:04.529062 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:53:04.529062 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:04.529062 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:04.533026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 378/761] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:04.533651 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367cb82-b128-4ef6-996a-8738a5c83216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:04.534602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367cb82-b128-4ef6-996a-8738a5c83216 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:04.535121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367cb82-b128-4ef6-996a-8738a5c83216 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:04.535598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367cb82-b128-4ef6-996a-8738a5c83216 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:04.536775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367cb82-b128-4ef6-996a-8738a5c83216 None admin] RBAC: Adding query filter params (role.id=372e9dc71b5a4a4daddc43ab384fa67b, scope.project.id=89b20e18525c473e94a2b263148f1f5f, user.id=6d4c4b75552b4c739079f328a6efba40) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:04.537376 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367cb82-b128-4ef6-996a-8738a5c83216 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:04.537486 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5ed8a-9fc0-4778-957e-87d21128936a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:04.539317 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367cb82-b128-4ef6-996a-8738a5c83216 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:04.546650 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 384/762] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:53:04 2022] GET /identity/v3/role_assignments?user.id=6d4c4b75552b4c739079f328a6efba40&scope.project.id=89b20e18525c473e94a2b263148f1f5f&role.id=372e9dc71b5a4a4daddc43ab384fa67b => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:04.655427 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5ed8a-9fc0-4778-957e-87d21128936a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:04.695511 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaac2d8-4cd1-4170-8c7c-c43e253dd3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:04.696199 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaac2d8-4cd1-4170-8c7c-c43e253dd3ac None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:04.696513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaac2d8-4cd1-4170-8c7c-c43e253dd3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:04.696898 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaac2d8-4cd1-4170-8c7c-c43e253dd3ac None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:04.697670 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaac2d8-4cd1-4170-8c7c-c43e253dd3ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:04.697978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaac2d8-4cd1-4170-8c7c-c43e253dd3ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:04.699402 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaac2d8-4cd1-4170-8c7c-c43e253dd3ac None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:04.717992 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 379/763] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:04.719338 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367cb82-b128-4ef6-996a-8738a5c83216 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:04.846789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367cb82-b128-4ef6-996a-8738a5c83216 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:04.903346 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac7956-fbeb-4400-8a2f-cdd982ecc5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:04.904162 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac7956-fbeb-4400-8a2f-cdd982ecc5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:04.904461 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac7956-fbeb-4400-8a2f-cdd982ecc5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:04.904735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac7956-fbeb-4400-8a2f-cdd982ecc5d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:04.914015 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac7956-fbeb-4400-8a2f-cdd982ecc5d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:04.915477 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac7956-fbeb-4400-8a2f-cdd982ecc5d0 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:04.933259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-06ac7956-fbeb-4400-8a2f-cdd982ecc5d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:04.933259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:04.933259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:04.933259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:04.933259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:04.933259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:04.933259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:04.933259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:04.933259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:04.933259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:04.933259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:04.933259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:04.933259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:53:04.933259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:53:04.933259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:53:04.934171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:53:04.934171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:04.934171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:04.934171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:04.934171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:04.934171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:04.934171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:04.934171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:04.934171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:04.934171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:04.934171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:04.934171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:04.934171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:04.934171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:04.934171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:04.934171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:04.934171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:04.935022 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:53:04.935022 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:53:04.935022 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:53:04.935022 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:53:04.935022 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:53:04.935022 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:53:04.935022 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:04.935022 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:04.937247 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 385/764] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:53:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:04.945701 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaac2d8-4cd1-4170-8c7c-c43e253dd3ac None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:04.969123 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:05.084626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaac2d8-4cd1-4170-8c7c-c43e253dd3ac None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:05.122428 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8a3fb-1c5b-4138-9c7b-5716536c0c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:05.123094 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8a3fb-1c5b-4138-9c7b-5716536c0c47 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:05.123374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8a3fb-1c5b-4138-9c7b-5716536c0c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:05.123645 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8a3fb-1c5b-4138-9c7b-5716536c0c47 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:05.124470 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8a3fb-1c5b-4138-9c7b-5716536c0c47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:05.124779 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8a3fb-1c5b-4138-9c7b-5716536c0c47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:05.126211 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8a3fb-1c5b-4138-9c7b-5716536c0c47 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:05.143956 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 380/765] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:53:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:05.145323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac7956-fbeb-4400-8a2f-cdd982ecc5d0 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:05.170069 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:05.323063 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac7956-fbeb-4400-8a2f-cdd982ecc5d0 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:05.381186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a5ef8-adcc-49ec-ad61-1051140ccab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:05.382116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a5ef8-adcc-49ec-ad61-1051140ccab4 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:05.382398 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a5ef8-adcc-49ec-ad61-1051140ccab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:05.382668 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a5ef8-adcc-49ec-ad61-1051140ccab4 None admin] PATH_INFO: `/v3/projects/89b20e18525c473e94a2b263148f1f5f/users/902ca8f1d59547a0ab187b4748311f58/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:05.385743 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a5ef8-adcc-49ec-ad61-1051140ccab4 None admin] RBAC: Authorizing `identity:create_grant(project_id=89b20e18525c473e94a2b263148f1f5f, user_id=902ca8f1d59547a0ab187b4748311f58, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:05.387046 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a5ef8-adcc-49ec-ad61-1051140ccab4 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:05.407857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 386/766] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 21:53:05 2022] PUT /identity/v3/projects/89b20e18525c473e94a2b263148f1f5f/users/902ca8f1d59547a0ab187b4748311f58/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:53:05.660649 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aaa361-794e-403e-8c0a-72672b8aa721 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:05.660845 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aaa361-794e-403e-8c0a-72672b8aa721 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:05.661110 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aaa361-794e-403e-8c0a-72672b8aa721 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:05.662813 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 381/767] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:05.678824 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f645b7-da99-4488-a484-f2247966cc9f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:05.679507 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f645b7-da99-4488-a484-f2247966cc9f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:05.679507 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f645b7-da99-4488-a484-f2247966cc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:05.705170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-55f645b7-da99-4488-a484-f2247966cc9f None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:05.706384 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-55f645b7-da99-4488-a484-f2247966cc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:05.778721 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:05.788226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 387/768] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:53:05.811325 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aaa361-794e-403e-8c0a-72672b8aa721 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:05.912999 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:05.951312 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aaa361-794e-403e-8c0a-72672b8aa721 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:05.987316 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b981f5f-6610-4fca-91ed-3d4e55725f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:05.988210 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b981f5f-6610-4fca-91ed-3d4e55725f0c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:05.988528 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b981f5f-6610-4fca-91ed-3d4e55725f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:05.988807 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b981f5f-6610-4fca-91ed-3d4e55725f0c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:05.989487 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b981f5f-6610-4fca-91ed-3d4e55725f0c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:05.991134 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b981f5f-6610-4fca-91ed-3d4e55725f0c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:06.004910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-6b981f5f-6610-4fca-91ed-3d4e55725f0c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 21:53:06.004910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:06.004910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:53:06.004910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:53:06.004910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:53:06.004910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:53:06.004910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:53:06.004910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:06.004910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 21:53:06.004910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:06.004910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:53:06.004910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:06.004910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:06.004910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:06.004910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:06.004910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:06.005903 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:06.005903 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:06.005903 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:06.005903 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:06.005903 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:06.005903 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:06.005903 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:06.005903 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:53:06.005903 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:53:06.005903 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:53:06.005903 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:53:06.005903 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:06.005903 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:06.005903 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:06.005903 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:06.005903 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:06.006751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:06.006751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:06.006751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:06.006751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:06.006751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:06.006751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:06.006751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:06.006751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:06.006751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:06.006751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:06.006751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:06.006751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:53:06.006751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:06.006751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 21:53:06.006751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:06.011403 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 382/769] 10.222.0.35 () {56 vars in 1129 bytes} [Thu May 19 21:53:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:06.012875 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f645b7-da99-4488-a484-f2247966cc9f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:06.144506 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f645b7-da99-4488-a484-f2247966cc9f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:06.196374 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870fa8f-9d06-4a2b-863d-261a36bd2a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:06.197199 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870fa8f-9d06-4a2b-863d-261a36bd2a97 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:06.197481 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870fa8f-9d06-4a2b-863d-261a36bd2a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:06.197960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870fa8f-9d06-4a2b-863d-261a36bd2a97 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:06.198478 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870fa8f-9d06-4a2b-863d-261a36bd2a97 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:06.198782 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870fa8f-9d06-4a2b-863d-261a36bd2a97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:06.200181 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870fa8f-9d06-4a2b-863d-261a36bd2a97 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:06.209287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 388/770] 10.222.0.35 () {56 vars in 1124 bytes} [Thu May 19 21:53:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:06.215506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b981f5f-6610-4fca-91ed-3d4e55725f0c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:06.327910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b981f5f-6610-4fca-91ed-3d4e55725f0c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:06.369206 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13238a32-0c81-4cd4-8c22-b259a06ce69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:06.369895 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13238a32-0c81-4cd4-8c22-b259a06ce69c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:06.370176 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13238a32-0c81-4cd4-8c22-b259a06ce69c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:06.370544 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13238a32-0c81-4cd4-8c22-b259a06ce69c None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:06.376422 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13238a32-0c81-4cd4-8c22-b259a06ce69c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:06.376422 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13238a32-0c81-4cd4-8c22-b259a06ce69c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:06.376422 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13238a32-0c81-4cd4-8c22-b259a06ce69c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:06.380754 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:06.383184 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 383/771] 10.222.0.35 () {56 vars in 1124 bytes} [Thu May 19 21:53:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:06.384590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870fa8f-9d06-4a2b-863d-261a36bd2a97 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:06.438973 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74168f9b-34a4-497a-8d3d-1ee3db0d246a None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:06.439286 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74168f9b-34a4-497a-8d3d-1ee3db0d246a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:06.439537 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74168f9b-34a4-497a-8d3d-1ee3db0d246a None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:06.441276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 384/772] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:53:06.453931 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f2acf-156f-43fc-b754-7f52f5fe060e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:06.454189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f2acf-156f-43fc-b754-7f52f5fe060e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:06.454397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f2acf-156f-43fc-b754-7f52f5fe060e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:06.480350 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7e2f2acf-156f-43fc-b754-7f52f5fe060e None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:06.482898 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7e2f2acf-156f-43fc-b754-7f52f5fe060e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:06.497377 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:06.576129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870fa8f-9d06-4a2b-863d-261a36bd2a97 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:06.613282 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 385/773] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:53:06.615349 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c6815-2b98-4414-adb3-70f86b5196cd None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:06.615537 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c6815-2b98-4414-adb3-70f86b5196cd None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:06.615784 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c6815-2b98-4414-adb3-70f86b5196cd None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:06.618704 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 386/774] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:06.627151 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7e593-0dda-43ff-915a-436127d8f739 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:06.627623 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7e593-0dda-43ff-915a-436127d8f739 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:06.628003 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7e593-0dda-43ff-915a-436127d8f739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:06.654090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7522136-8ae4-410c-a8e3-eb6876999ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:06.654769 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7522136-8ae4-410c-a8e3-eb6876999ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:06.655051 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7522136-8ae4-410c-a8e3-eb6876999ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:06.655321 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7522136-8ae4-410c-a8e3-eb6876999ff0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:06.656119 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7522136-8ae4-410c-a8e3-eb6876999ff0 None admin] RBAC: Adding query filter params (interface=public, service_id=c9d406e67c344fc4ab3b676790d13ee1, region_id=RegionOne) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:06.656579 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7522136-8ae4-410c-a8e3-eb6876999ff0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:06.667930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7522136-8ae4-410c-a8e3-eb6876999ff0 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:06.694696 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 389/775] 10.222.0.35 () {56 vars in 1251 bytes} [Thu May 19 21:53:06 2022] GET /identity/v3/endpoints?service_id=c9d406e67c344fc4ab3b676790d13ee1&interface=public®ion_id=RegionOne => generated 194 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:06.700426 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7522136-8ae4-410c-a8e3-eb6876999ff0 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:06.826512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7522136-8ae4-410c-a8e3-eb6876999ff0 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:06.830048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-10e7e593-0dda-43ff-915a-436127d8f739 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:06.831287 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-10e7e593-0dda-43ff-915a-436127d8f739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:06.855785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:06.867712 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda6952-f8b6-41bd-8e0a-d45935c8110e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:06.867712 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda6952-f8b6-41bd-8e0a-d45935c8110e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:06.867712 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda6952-f8b6-41bd-8e0a-d45935c8110e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:06.867712 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda6952-f8b6-41bd-8e0a-d45935c8110e None admin] PATH_INFO: `/v3/services/network` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:06.868336 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda6952-f8b6-41bd-8e0a-d45935c8110e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:06.870531 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda6952-f8b6-41bd-8e0a-d45935c8110e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:06.891735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-4cda6952-f8b6-41bd-8e0a-d45935c8110e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 21:53:06.891735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:06.891735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:53:06.891735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:53:06.891735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:53:06.891735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:53:06.891735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:53:06.891735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:06.891735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 21:53:06.891735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:06.891735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:53:06.891735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:06.891735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:06.891735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:06.891735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:06.891735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:06.891735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:06.892815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:06.892815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:06.892815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:06.892815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:06.892815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:06.892815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:06.892815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:53:06.892815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:53:06.892815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:53:06.892815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:53:06.892815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:06.892815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:06.892815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:06.892815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:06.892815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:06.892815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:06.893624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:06.893624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:06.893624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:06.893624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:06.893624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:06.893624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:06.893624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:06.893624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:06.893624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:06.893624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:06.893624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:53:06.893624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:06.893624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 21:53:06.893624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:06.900472 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 390/776] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:53:06 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:06.900472 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda6952-f8b6-41bd-8e0a-d45935c8110e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:06.995041 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 387/777] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:53:06.995692 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7e593-0dda-43ff-915a-436127d8f739 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:07.045056 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda6952-f8b6-41bd-8e0a-d45935c8110e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:07.119666 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:07.119969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2979e0f-be5a-4f44-b45a-597ff01b326a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:07.120863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2979e0f-be5a-4f44-b45a-597ff01b326a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:07.121146 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2979e0f-be5a-4f44-b45a-597ff01b326a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:07.121425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2979e0f-be5a-4f44-b45a-597ff01b326a None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:07.122118 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2979e0f-be5a-4f44-b45a-597ff01b326a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:07.123502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2979e0f-be5a-4f44-b45a-597ff01b326a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:07.145192 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 391/778] 10.222.0.35 () {56 vars in 1087 bytes} [Thu May 19 21:53:06 2022] GET /identity/v3/services => generated 772 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:07.145192 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2979e0f-be5a-4f44-b45a-597ff01b326a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:07.215401 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7e593-0dda-43ff-915a-436127d8f739 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:07.292380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:07.305489 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d494d-a20a-4999-929a-7c6786f4318e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:07.306262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d494d-a20a-4999-929a-7c6786f4318e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:07.306542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d494d-a20a-4999-929a-7c6786f4318e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:07.306811 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d494d-a20a-4999-929a-7c6786f4318e None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:07.307554 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d494d-a20a-4999-929a-7c6786f4318e None admin] RBAC: Adding query filter params (name=network) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:07.307858 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d494d-a20a-4999-929a-7c6786f4318e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:07.309328 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d494d-a20a-4999-929a-7c6786f4318e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:07.320919 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 388/779] 10.222.0.35 () {56 vars in 1112 bytes} [Thu May 19 21:53:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:07.328232 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d494d-a20a-4999-929a-7c6786f4318e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:07.416207 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2979e0f-be5a-4f44-b45a-597ff01b326a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:07.473740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbeb4e8-fd0f-4c27-816d-c83df4f85fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:07.475238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeb4e8-fd0f-4c27-816d-c83df4f85fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:07.475732 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeb4e8-fd0f-4c27-816d-c83df4f85fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:07.476210 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeb4e8-fd0f-4c27-816d-c83df4f85fc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:07.481151 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d494d-a20a-4999-929a-7c6786f4318e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:07.489301 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbeb4e8-fd0f-4c27-816d-c83df4f85fc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:53:07.498802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-3bbeb4e8-fd0f-4c27-816d-c83df4f85fc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:53:07.498802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:07.498802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:07.498802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:07.498802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:07.498802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:07.498802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:07.498802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:07.498802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:07.498802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:07.498802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:07.498802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:07.498802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:53:07.498802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:53:07.498802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:53:07.498802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:53:07.500053 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:53:07.500053 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:53:07.500053 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:53:07.500053 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:53:07.500053 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:07.500053 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:07.500053 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:07.500053 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:07.500053 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:07.500053 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:07.500053 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:07.500053 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:07.500053 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:07.500053 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:07.500053 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:07.500053 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:07.501199 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:07.501199 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:07.501199 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:07.501199 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:07.501199 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:53:07.501199 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:53:07.501199 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:53:07.501199 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:53:07.501199 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:53:07.501199 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:53:07.501199 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:53:07.501199 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:07.501199 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 392/780] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:53:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:07.502344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37107e9-82da-4c09-9bed-7ea8428f5ca3 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:07.502344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37107e9-82da-4c09-9bed-7ea8428f5ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:07.502344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37107e9-82da-4c09-9bed-7ea8428f5ca3 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:07.503553 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 393/781] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:07.510383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37107e9-82da-4c09-9bed-7ea8428f5ca3 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:07.528782 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:07.534034 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913ca0c-70fa-411c-9c73-bd1b3898a122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:07.534738 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913ca0c-70fa-411c-9c73-bd1b3898a122 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:07.535135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913ca0c-70fa-411c-9c73-bd1b3898a122 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:07.535423 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913ca0c-70fa-411c-9c73-bd1b3898a122 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:07.536248 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913ca0c-70fa-411c-9c73-bd1b3898a122 None admin] RBAC: Adding query filter params (type=network) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:07.536630 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913ca0c-70fa-411c-9c73-bd1b3898a122 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:07.538879 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913ca0c-70fa-411c-9c73-bd1b3898a122 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:07.546761 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 389/782] 10.222.0.35 () {56 vars in 1112 bytes} [Thu May 19 21:53:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:07.553977 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00728a-ddd0-42d9-8176-590addcc425b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:07.554262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00728a-ddd0-42d9-8176-590addcc425b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:07.554606 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00728a-ddd0-42d9-8176-590addcc425b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:07.577373 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-cd00728a-ddd0-42d9-8176-590addcc425b None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:07.578999 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cd00728a-ddd0-42d9-8176-590addcc425b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:07.653827 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37107e9-82da-4c09-9bed-7ea8428f5ca3 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:07.660566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 390/783] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:53:07.661443 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00728a-ddd0-42d9-8176-590addcc425b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:07.671712 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:07.696054 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630374d9-f9e7-4b17-aebc-cd890b6bc6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:07.698035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630374d9-f9e7-4b17-aebc-cd890b6bc6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:07.698665 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630374d9-f9e7-4b17-aebc-cd890b6bc6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:07.699130 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630374d9-f9e7-4b17-aebc-cd890b6bc6b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:07.700046 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630374d9-f9e7-4b17-aebc-cd890b6bc6b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:07.700549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630374d9-f9e7-4b17-aebc-cd890b6bc6b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:07.702163 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630374d9-f9e7-4b17-aebc-cd890b6bc6b0 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:07.714711 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 394/784] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:53:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:07.715865 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630374d9-f9e7-4b17-aebc-cd890b6bc6b0 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:07.796702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00728a-ddd0-42d9-8176-590addcc425b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:07.815253 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:07.827848 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630374d9-f9e7-4b17-aebc-cd890b6bc6b0 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:07.835894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170e9f8-2487-41bb-baba-1a789002cddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:07.836604 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170e9f8-2487-41bb-baba-1a789002cddf None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:07.836889 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170e9f8-2487-41bb-baba-1a789002cddf None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:07.837166 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170e9f8-2487-41bb-baba-1a789002cddf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:07.838794 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170e9f8-2487-41bb-baba-1a789002cddf None admin] RBAC: Adding query filter params (interface=public, service_id=64769563945e419eafd30a7e7ab568f5, region_id=RegionOne) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:07.838929 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170e9f8-2487-41bb-baba-1a789002cddf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:07.840264 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170e9f8-2487-41bb-baba-1a789002cddf None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:07.852560 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 391/785] 10.222.0.35 () {56 vars in 1251 bytes} [Thu May 19 21:53:07 2022] GET /identity/v3/endpoints?service_id=64769563945e419eafd30a7e7ab568f5&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:07.852560 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170e9f8-2487-41bb-baba-1a789002cddf None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:07.875160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c46f4-33d2-43bd-bd9f-639dde71b1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:07.876379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c46f4-33d2-43bd-bd9f-639dde71b1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:07.876919 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c46f4-33d2-43bd-bd9f-639dde71b1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:07.877417 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c46f4-33d2-43bd-bd9f-639dde71b1d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:07.889676 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c46f4-33d2-43bd-bd9f-639dde71b1d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:53:07.897817 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-7a6c46f4-33d2-43bd-bd9f-639dde71b1d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:53:07.897817 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:07.897817 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:07.897817 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:07.897817 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:07.897817 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:07.897817 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:07.897817 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:07.897817 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:07.897817 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:07.897817 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:07.897817 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:07.897817 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:53:07.897817 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:53:07.897817 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:53:07.897817 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:53:07.898773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:53:07.898773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:53:07.898773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:53:07.898773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:53:07.898773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:07.898773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:07.898773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:07.898773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:07.898773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:07.898773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:07.898773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:07.898773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:07.898773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:07.898773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:07.898773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:07.898773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:07.899605 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:07.899605 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:07.899605 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:07.899605 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:07.899605 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:53:07.899605 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:53:07.899605 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:53:07.899605 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:53:07.899605 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:53:07.899605 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:53:07.899605 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:53:07.899605 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:07.902546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 395/786] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 21:53:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:07.903590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c46f4-33d2-43bd-bd9f-639dde71b1d9 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:07.943041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:07.970332 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170e9f8-2487-41bb-baba-1a789002cddf None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:08.009149 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e495ccf-5f29-4e8f-a209-7a078bbedada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:08.010504 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e495ccf-5f29-4e8f-a209-7a078bbedada None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:08.010504 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e495ccf-5f29-4e8f-a209-7a078bbedada None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:08.010668 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e495ccf-5f29-4e8f-a209-7a078bbedada None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:08.021151 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c46f4-33d2-43bd-bd9f-639dde71b1d9 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:08.022507 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e495ccf-5f29-4e8f-a209-7a078bbedada None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:08.024022 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e495ccf-5f29-4e8f-a209-7a078bbedada None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:08.043566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-4e495ccf-5f29-4e8f-a209-7a078bbedada None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:08.043566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:08.043566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:08.043566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:08.043566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:08.043566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:08.043566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:08.043566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:08.043566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:08.043566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:08.043566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:08.043566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:08.043566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:53:08.043566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:53:08.043566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:53:08.044593 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:53:08.044593 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:08.044593 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:08.044593 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:08.044593 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:08.044593 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:08.044593 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:08.044593 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:08.044593 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:08.044593 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:08.044593 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:08.044593 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:08.044593 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:08.044593 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:08.044593 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:08.044593 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:08.044593 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:08.045489 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:53:08.045489 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:53:08.045489 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:08.045489 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:08.045489 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 392/787] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:08.046216 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e495ccf-5f29-4e8f-a209-7a078bbedada None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:08.063846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1aa969-84d9-4aae-9891-f7b64d9e5489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:08.064909 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1aa969-84d9-4aae-9891-f7b64d9e5489 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:08.065403 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1aa969-84d9-4aae-9891-f7b64d9e5489 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:08.065911 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1aa969-84d9-4aae-9891-f7b64d9e5489 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:08.066837 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1aa969-84d9-4aae-9891-f7b64d9e5489 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:08.068613 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1aa969-84d9-4aae-9891-f7b64d9e5489 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:08.080535 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 396/788] 10.222.0.35 () {56 vars in 1087 bytes} [Thu May 19 21:53:07 2022] GET /identity/v3/services => generated 772 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:08.080964 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:08.082059 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1aa969-84d9-4aae-9891-f7b64d9e5489 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:08.162467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e495ccf-5f29-4e8f-a209-7a078bbedada None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:08.213010 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5bbf2-0355-43be-b4d8-b5c5e6e5c486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:08.213826 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5bbf2-0355-43be-b4d8-b5c5e6e5c486 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:08.214111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5bbf2-0355-43be-b4d8-b5c5e6e5c486 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:08.214385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5bbf2-0355-43be-b4d8-b5c5e6e5c486 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:08.215194 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5bbf2-0355-43be-b4d8-b5c5e6e5c486 None admin] RBAC: Adding query filter params (name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:08.215502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5bbf2-0355-43be-b4d8-b5c5e6e5c486 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:08.216999 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5bbf2-0355-43be-b4d8-b5c5e6e5c486 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:08.227905 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 393/789] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 21:53:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:08.234781 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5bbf2-0355-43be-b4d8-b5c5e6e5c486 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:08.286855 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1aa969-84d9-4aae-9891-f7b64d9e5489 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:08.289699 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:08.349133 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b14ba-31cc-4cd9-bfb3-ccc499640f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:08.349810 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b14ba-31cc-4cd9-bfb3-ccc499640f41 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:08.350091 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b14ba-31cc-4cd9-bfb3-ccc499640f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:08.350361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b14ba-31cc-4cd9-bfb3-ccc499640f41 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:08.351094 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b14ba-31cc-4cd9-bfb3-ccc499640f41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:08.351397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b14ba-31cc-4cd9-bfb3-ccc499640f41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:08.352847 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b14ba-31cc-4cd9-bfb3-ccc499640f41 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:08.359647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:08.374606 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5bbf2-0355-43be-b4d8-b5c5e6e5c486 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:08.388911 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 397/790] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:08.392984 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b14ba-31cc-4cd9-bfb3-ccc499640f41 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:08.438352 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97a365-3dc5-4ddc-b264-ecd20636f1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:08.439494 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97a365-3dc5-4ddc-b264-ecd20636f1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:08.439935 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97a365-3dc5-4ddc-b264-ecd20636f1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:08.440484 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97a365-3dc5-4ddc-b264-ecd20636f1b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:08.458324 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97a365-3dc5-4ddc-b264-ecd20636f1b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:08.460024 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97a365-3dc5-4ddc-b264-ecd20636f1b9 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:08.480384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-9e97a365-3dc5-4ddc-b264-ecd20636f1b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:08.480384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:08.480384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:08.480384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:08.480384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:08.480384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:08.480384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:08.480384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:08.480384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:08.480384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:08.480384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:08.480384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:08.480384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:53:08.480384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:53:08.480384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:53:08.481350 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:53:08.481350 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:08.481350 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:08.481350 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:08.481350 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:08.481350 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:08.481350 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:08.481350 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:08.481350 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:08.481350 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:08.481350 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:08.481350 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:08.481350 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:08.481350 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:08.481350 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:08.481350 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:08.481350 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:08.482211 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:53:08.482211 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:53:08.482211 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:08.482211 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:08.484163 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 394/791] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:08.485972 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768da2f-b244-4a97-9b33-da2abd7608e4 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:08.486457 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768da2f-b244-4a97-9b33-da2abd7608e4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:08.486905 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768da2f-b244-4a97-9b33-da2abd7608e4 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:08.488868 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 395/792] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:08.489913 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768da2f-b244-4a97-9b33-da2abd7608e4 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:08.526825 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b14ba-31cc-4cd9-bfb3-ccc499640f41 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:08.571182 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c1232-6f48-4a2f-acc8-121e1f04de41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:08.572359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c1232-6f48-4a2f-acc8-121e1f04de41 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:08.572790 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c1232-6f48-4a2f-acc8-121e1f04de41 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:08.573075 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c1232-6f48-4a2f-acc8-121e1f04de41 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:08.589397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c1232-6f48-4a2f-acc8-121e1f04de41 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:08.589397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c1232-6f48-4a2f-acc8-121e1f04de41 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:08.614910 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-824c1232-6f48-4a2f-acc8-121e1f04de41 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 21:53:08.614910 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:08.614910 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:08.614910 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:08.614910 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:08.614910 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:08.614910 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:08.614910 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:08.614910 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:08.614910 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:08.614910 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:08.614910 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:08.614910 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:53:08.614910 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:53:08.614910 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:53:08.614910 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:53:08.616166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:08.616166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:08.616166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:53:08.616166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:08.616166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:53:08.616166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:08.616166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:08.616166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:08.616166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:08.616166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:08.616166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:08.616166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:08.616166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:08.616166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:08.616166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:08.616166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:08.616166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:08.616166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:08.617116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:08.617116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:08.617116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:53:08.617116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:53:08.617116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:53:08.617116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:53:08.617116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:53:08.617116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:53:08.617116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 21:53:08.617116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:08.617662 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 398/793] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:53:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:53:08.619457 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf553ad2-9bf0-4b0f-9007-5cc2f706d98a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:08.622457 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf553ad2-9bf0-4b0f-9007-5cc2f706d98a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:08.622457 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf553ad2-9bf0-4b0f-9007-5cc2f706d98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:08.637287 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768da2f-b244-4a97-9b33-da2abd7608e4 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:08.647617 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-bf553ad2-9bf0-4b0f-9007-5cc2f706d98a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:08.650446 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-bf553ad2-9bf0-4b0f-9007-5cc2f706d98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:08.669100 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:08.688277 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e9025-2078-4947-9e0a-fd7430a84f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:08.689279 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e9025-2078-4947-9e0a-fd7430a84f08 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:08.689563 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e9025-2078-4947-9e0a-fd7430a84f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:08.689841 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e9025-2078-4947-9e0a-fd7430a84f08 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:08.690576 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e9025-2078-4947-9e0a-fd7430a84f08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:08.690889 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e9025-2078-4947-9e0a-fd7430a84f08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:08.697513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e9025-2078-4947-9e0a-fd7430a84f08 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:08.711007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 396/794] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:08.711966 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e9025-2078-4947-9e0a-fd7430a84f08 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:08.720906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:08.756702 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 399/795] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:53:08.758942 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf553ad2-9bf0-4b0f-9007-5cc2f706d98a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:08.860308 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e9025-2078-4947-9e0a-fd7430a84f08 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:08.881315 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf553ad2-9bf0-4b0f-9007-5cc2f706d98a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:08.910867 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099d968-f8d2-40d1-8f80-90665a516c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:08.912110 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099d968-f8d2-40d1-8f80-90665a516c65 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:08.912542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099d968-f8d2-40d1-8f80-90665a516c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:08.912826 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099d968-f8d2-40d1-8f80-90665a516c65 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:08.913947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099d968-f8d2-40d1-8f80-90665a516c65 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:08.914260 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099d968-f8d2-40d1-8f80-90665a516c65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:08.917319 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099d968-f8d2-40d1-8f80-90665a516c65 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:08.919950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc80e3-2837-4ffe-a455-734589525444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:08.920893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc80e3-2837-4ffe-a455-734589525444 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:08.921267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc80e3-2837-4ffe-a455-734589525444 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:08.921637 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc80e3-2837-4ffe-a455-734589525444 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:08.929414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc80e3-2837-4ffe-a455-734589525444 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:08.930944 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc80e3-2837-4ffe-a455-734589525444 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:08.939009 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 397/796] 10.222.0.35 () {56 vars in 1135 bytes} [Thu May 19 21:53:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:08.939905 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099d968-f8d2-40d1-8f80-90665a516c65 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:08.952498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-6cdc80e3-2837-4ffe-a455-734589525444 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 21:53:08.952498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:08.952498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:08.952498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:08.952498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:08.952498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:08.952498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:08.952498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:08.952498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:08.952498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:08.952498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:08.952498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:08.952498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:53:08.952498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:53:08.952498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:53:08.952498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:53:08.953493 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:08.953493 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:08.953493 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:53:08.953493 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:08.953493 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:53:08.953493 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:08.953493 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:08.953493 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:08.953493 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:08.953493 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:08.953493 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:08.953493 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:08.953493 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:08.953493 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:08.953493 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:08.953493 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:08.953493 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:08.953493 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:08.954383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:08.954383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:08.954383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:53:08.954383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:53:08.954383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:53:08.954383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:53:08.954383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:53:08.954383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:53:08.954383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 21:53:08.954383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:08.954383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 400/797] 10.222.0.35 () {56 vars in 1117 bytes} [Thu May 19 21:53:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:08.954964 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc80e3-2837-4ffe-a455-734589525444 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:08.972161 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:09.034252 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:09.080312 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099d968-f8d2-40d1-8f80-90665a516c65 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:09.095671 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc80e3-2837-4ffe-a455-734589525444 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:09.121094 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d19b94-b775-4200-9d09-845bc08ddb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:09.121975 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d19b94-b775-4200-9d09-845bc08ddb09 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:09.122337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d19b94-b775-4200-9d09-845bc08ddb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:09.122653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d19b94-b775-4200-9d09-845bc08ddb09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:09.135071 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d19b94-b775-4200-9d09-845bc08ddb09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:53:09.144797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-10d19b94-b775-4200-9d09-845bc08ddb09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:53:09.144797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:09.144797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:09.144797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:09.144797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:09.144797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:09.144797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:09.144797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:09.144797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:09.144797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:09.144797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:09.144797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:09.144797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:53:09.144797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:53:09.144797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:53:09.144797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:53:09.145939 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:53:09.145939 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:53:09.145939 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:53:09.145939 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:53:09.145939 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:09.145939 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:09.145939 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:09.145939 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:09.145939 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:09.145939 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:09.145939 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:09.145939 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:09.145939 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:09.145939 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:09.145939 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:09.145939 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:09.146894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:09.146894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:09.146894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:09.146894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:09.146894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:53:09.146894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:53:09.146894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:53:09.146894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:53:09.146894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:53:09.146894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:53:09.146894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:53:09.146894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:09.146894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 398/798] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:53:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:09.147700 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d19b94-b775-4200-9d09-845bc08ddb09 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:09.149072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a436d9f-6448-4635-9d7d-597cbfb0be37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:09.151483 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a436d9f-6448-4635-9d7d-597cbfb0be37 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:09.152014 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a436d9f-6448-4635-9d7d-597cbfb0be37 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:09.153408 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a436d9f-6448-4635-9d7d-597cbfb0be37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:09.169278 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a436d9f-6448-4635-9d7d-597cbfb0be37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:09.171246 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a436d9f-6448-4635-9d7d-597cbfb0be37 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:09.194546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-8a436d9f-6448-4635-9d7d-597cbfb0be37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:09.194546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:09.194546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:09.194546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:09.194546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:09.194546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:09.194546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:09.194546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:09.194546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:09.194546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:09.194546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:09.194546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:09.194546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:53:09.194546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:53:09.194546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:53:09.195568 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:53:09.195568 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:09.195568 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:09.195568 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:09.195568 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:09.195568 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:09.195568 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:09.195568 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:09.195568 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:09.195568 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:09.195568 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:09.195568 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:09.195568 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:09.195568 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:09.195568 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:09.195568 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:09.195568 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:09.196442 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:53:09.196442 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:53:09.196442 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:09.196442 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:09.200581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 401/799] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:09.201443 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a436d9f-6448-4635-9d7d-597cbfb0be37 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:09.268209 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:09.295843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d19b94-b775-4200-9d09-845bc08ddb09 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:09.313605 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a436d9f-6448-4635-9d7d-597cbfb0be37 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:09.333768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:09.349489 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3f2e2-0db7-44ff-8791-cbd564d3fbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:09.350333 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3f2e2-0db7-44ff-8791-cbd564d3fbc2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:09.350717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3f2e2-0db7-44ff-8791-cbd564d3fbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:09.351004 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3f2e2-0db7-44ff-8791-cbd564d3fbc2 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:09.351850 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3f2e2-0db7-44ff-8791-cbd564d3fbc2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:09.352315 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3f2e2-0db7-44ff-8791-cbd564d3fbc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:09.355581 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3f2e2-0db7-44ff-8791-cbd564d3fbc2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:09.362775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c141677-e70d-4447-9c69-74b12240ea1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:09.370096 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c141677-e70d-4447-9c69-74b12240ea1d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:09.370587 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c141677-e70d-4447-9c69-74b12240ea1d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:09.371086 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c141677-e70d-4447-9c69-74b12240ea1d None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:09.372033 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c141677-e70d-4447-9c69-74b12240ea1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:09.372557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c141677-e70d-4447-9c69-74b12240ea1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:09.374146 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c141677-e70d-4447-9c69-74b12240ea1d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:09.377213 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 399/800] 10.222.0.35 () {56 vars in 1149 bytes} [Thu May 19 21:53:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:09.378334 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3f2e2-0db7-44ff-8791-cbd564d3fbc2 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:09.389953 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 402/801] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:53:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:09.391259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c141677-e70d-4447-9c69-74b12240ea1d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:09.509231 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c141677-e70d-4447-9c69-74b12240ea1d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:09.537757 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3f2e2-0db7-44ff-8791-cbd564d3fbc2 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:09.538399 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:09.552722 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd656d96-758b-4333-b1d1-c270ef7a240a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:09.553886 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd656d96-758b-4333-b1d1-c270ef7a240a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:09.554404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd656d96-758b-4333-b1d1-c270ef7a240a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:09.554880 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd656d96-758b-4333-b1d1-c270ef7a240a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:09.575632 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd656d96-758b-4333-b1d1-c270ef7a240a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:09.578087 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd656d96-758b-4333-b1d1-c270ef7a240a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:09.582766 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4712c5-452e-459d-b32d-10f07339f865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:09.584004 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4712c5-452e-459d-b32d-10f07339f865 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:09.584601 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4712c5-452e-459d-b32d-10f07339f865 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:09.585088 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4712c5-452e-459d-b32d-10f07339f865 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:09.586293 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4712c5-452e-459d-b32d-10f07339f865 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:09.587069 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4712c5-452e-459d-b32d-10f07339f865 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:09.589112 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4712c5-452e-459d-b32d-10f07339f865 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:09.599344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-dd656d96-758b-4333-b1d1-c270ef7a240a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:09.599344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:09.599344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:09.599344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:09.599344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:09.599344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:09.599344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:09.599344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:09.599344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:09.599344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:09.599344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:09.599344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:09.599344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:53:09.599344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:53:09.599344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:53:09.600301 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:53:09.600301 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:09.600301 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:09.600301 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:09.600301 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:09.600301 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:09.600301 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:09.600301 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:09.600301 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:09.600301 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:09.600301 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:09.600301 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:09.600301 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:09.600301 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:09.600301 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:09.600301 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:09.600301 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:09.601198 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:53:09.601198 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:53:09.601198 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:09.601198 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:09.604566 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 403/802] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:09.607811 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd656d96-758b-4333-b1d1-c270ef7a240a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:09.610640 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 400/803] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:09.614027 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4712c5-452e-459d-b32d-10f07339f865 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:09.678190 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:09.744661 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd656d96-758b-4333-b1d1-c270ef7a240a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:09.768367 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4712c5-452e-459d-b32d-10f07339f865 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:09.780029 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be53742-dfd0-4176-8342-8bc04f6c851c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:09.780958 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be53742-dfd0-4176-8342-8bc04f6c851c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:09.781244 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be53742-dfd0-4176-8342-8bc04f6c851c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:09.781519 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be53742-dfd0-4176-8342-8bc04f6c851c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:09.794240 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be53742-dfd0-4176-8342-8bc04f6c851c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:09.795976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be53742-dfd0-4176-8342-8bc04f6c851c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:09.805790 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac0ef0-11ac-473c-ad29-420b328d682a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:09.807018 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac0ef0-11ac-473c-ad29-420b328d682a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:09.807364 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac0ef0-11ac-473c-ad29-420b328d682a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:09.807783 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac0ef0-11ac-473c-ad29-420b328d682a None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:09.808539 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac0ef0-11ac-473c-ad29-420b328d682a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:09.808846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac0ef0-11ac-473c-ad29-420b328d682a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:09.810196 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac0ef0-11ac-473c-ad29-420b328d682a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:09.816153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-3be53742-dfd0-4176-8342-8bc04f6c851c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:09.816153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:09.816153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:09.816153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:09.816153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:09.816153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:09.816153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:09.816153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:09.816153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:09.816153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:09.816153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:09.816153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:09.816153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:53:09.816153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:53:09.816153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:53:09.817190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:53:09.817190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:09.817190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:09.817190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:09.817190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:09.817190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:09.817190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:09.817190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:09.817190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:09.817190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:09.817190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:09.817190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:09.817190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:09.817190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:09.817190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:09.817190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:09.817190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:09.818308 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:53:09.818308 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:53:09.818308 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:09.818308 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:09.819962 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 404/804] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:09.820917 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be53742-dfd0-4176-8342-8bc04f6c851c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:09.828000 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 401/805] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:09.829481 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a0d33-e3bd-4819-93d9-6808fbdf45b2 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:09.829846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a0d33-e3bd-4819-93d9-6808fbdf45b2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:09.830133 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a0d33-e3bd-4819-93d9-6808fbdf45b2 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:09.835433 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 402/806] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:09.835433 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a0d33-e3bd-4819-93d9-6808fbdf45b2 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:09.861865 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:09.952911 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be53742-dfd0-4176-8342-8bc04f6c851c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:09.959351 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a0d33-e3bd-4819-93d9-6808fbdf45b2 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:09.961115 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:09.991736 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f089328-0b7c-4d77-b57b-4962b01b9e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:09.992651 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f089328-0b7c-4d77-b57b-4962b01b9e92 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:09.992945 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f089328-0b7c-4d77-b57b-4962b01b9e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:09.993225 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f089328-0b7c-4d77-b57b-4962b01b9e92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:10.001498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f089328-0b7c-4d77-b57b-4962b01b9e92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:10.002975 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5b099-e0fc-4c47-81e8-0f293cdc77d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:10.003146 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f089328-0b7c-4d77-b57b-4962b01b9e92 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:10.003646 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5b099-e0fc-4c47-81e8-0f293cdc77d0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:10.003930 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5b099-e0fc-4c47-81e8-0f293cdc77d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:10.004206 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5b099-e0fc-4c47-81e8-0f293cdc77d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:10.004977 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5b099-e0fc-4c47-81e8-0f293cdc77d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:10.005284 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5b099-e0fc-4c47-81e8-0f293cdc77d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:10.006641 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5b099-e0fc-4c47-81e8-0f293cdc77d0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:10.017950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-1f089328-0b7c-4d77-b57b-4962b01b9e92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:10.017950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:10.017950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:10.017950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:10.017950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:10.017950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:10.017950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:10.017950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:10.017950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:10.017950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:10.017950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:10.017950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:10.017950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:53:10.017950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:53:10.017950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:53:10.028283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:53:10.028283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:10.028283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:10.028283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:10.028283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:10.028283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:10.028283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:10.028283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:10.028283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:10.028283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:10.028283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:10.028283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:10.028283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:10.028283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:10.028283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:10.028283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:10.028283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:10.029262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:53:10.029262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:53:10.029262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:53:10.029262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:53:10.029262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:53:10.029262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:53:10.029262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:10.029262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:10.029705 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 403/807] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:10.029778 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 405/808] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:53:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:10.029850 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5b099-e0fc-4c47-81e8-0f293cdc77d0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:10.029917 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd884bf-2a16-4d5b-9633-e4128f2d3570 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:10.029917 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd884bf-2a16-4d5b-9633-e4128f2d3570 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:10.029917 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd884bf-2a16-4d5b-9633-e4128f2d3570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:10.045282 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-fbd884bf-2a16-4d5b-9633-e4128f2d3570 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:10.046502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-fbd884bf-2a16-4d5b-9633-e4128f2d3570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:10.132830 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 406/809] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:53:10.133526 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd884bf-2a16-4d5b-9633-e4128f2d3570 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:10.146057 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5b099-e0fc-4c47-81e8-0f293cdc77d0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:10.160307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:10.187229 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe25a2-2305-4370-ba53-e0c13bcfb5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:10.188029 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe25a2-2305-4370-ba53-e0c13bcfb5ed None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:10.188317 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe25a2-2305-4370-ba53-e0c13bcfb5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:10.188620 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe25a2-2305-4370-ba53-e0c13bcfb5ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:10.195704 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe25a2-2305-4370-ba53-e0c13bcfb5ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:10.197728 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe25a2-2305-4370-ba53-e0c13bcfb5ed None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:10.217479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-0abe25a2-2305-4370-ba53-e0c13bcfb5ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:10.217479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:10.217479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:10.217479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:10.217479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:10.217479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:10.217479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:10.217479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:10.217479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:10.217479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:10.217479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:10.217479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:10.217479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:53:10.217479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:53:10.217479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:53:10.218477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:53:10.218477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:10.218477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:10.218477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:10.218477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:10.218477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:10.218477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:10.218477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:10.218477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:10.218477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:10.218477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:10.218477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:10.218477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:10.218477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:10.218477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:10.218477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:10.218477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:10.219351 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:53:10.219351 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:53:10.219351 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:53:10.219351 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:53:10.219351 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:53:10.219351 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:53:10.219351 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:10.219351 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:10.219351 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 404/810] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:53:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:10.219816 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe25a2-2305-4370-ba53-e0c13bcfb5ed None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:10.251374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:10.280768 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd884bf-2a16-4d5b-9633-e4128f2d3570 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:10.327684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c6acb-0be9-4d5c-a518-de65de4ab563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:10.328846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c6acb-0be9-4d5c-a518-de65de4ab563 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:10.329128 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c6acb-0be9-4d5c-a518-de65de4ab563 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:10.329402 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c6acb-0be9-4d5c-a518-de65de4ab563 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:10.339786 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c6acb-0be9-4d5c-a518-de65de4ab563 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:10.339786 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c6acb-0be9-4d5c-a518-de65de4ab563 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:10.347862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe25a2-2305-4370-ba53-e0c13bcfb5ed None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:10.353811 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-674c6acb-0be9-4d5c-a518-de65de4ab563 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 21:53:10.353811 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:10.353811 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:10.353811 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:10.353811 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:10.353811 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:10.353811 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:10.353811 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:10.353811 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:10.353811 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:10.353811 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:10.353811 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:10.353811 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:53:10.353811 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:53:10.353811 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:53:10.353811 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:53:10.354723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:10.354723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:10.354723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:53:10.354723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:10.354723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:53:10.354723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:10.354723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:10.354723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:10.354723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:10.354723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:10.354723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:10.354723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:10.354723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:10.354723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:10.354723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:10.354723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:10.354723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:10.354723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:10.355710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:10.355710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:10.355710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:53:10.355710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:53:10.355710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:53:10.355710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:53:10.355710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:53:10.355710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:53:10.355710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 21:53:10.355710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:10.355710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 407/811] 10.222.0.35 () {56 vars in 1093 bytes} [Thu May 19 21:53:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:10.356298 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c6acb-0be9-4d5c-a518-de65de4ab563 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:10.390015 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d865a-5dcc-4ffa-ab53-57bde33cf62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:10.390614 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d865a-5dcc-4ffa-ab53-57bde33cf62f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:10.390900 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d865a-5dcc-4ffa-ab53-57bde33cf62f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:10.391334 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d865a-5dcc-4ffa-ab53-57bde33cf62f None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:10.391984 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d865a-5dcc-4ffa-ab53-57bde33cf62f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:10.392278 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d865a-5dcc-4ffa-ab53-57bde33cf62f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:10.393789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d865a-5dcc-4ffa-ab53-57bde33cf62f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:10.406915 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 405/812] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:53:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:10.408291 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d865a-5dcc-4ffa-ab53-57bde33cf62f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:10.458833 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:10.485560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c6acb-0be9-4d5c-a518-de65de4ab563 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:10.507882 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:10.536948 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b55c28-2444-452b-a180-c43416876790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:10.537788 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b55c28-2444-452b-a180-c43416876790 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:10.538075 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b55c28-2444-452b-a180-c43416876790 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:10.538348 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b55c28-2444-452b-a180-c43416876790 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:10.538738 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d865a-5dcc-4ffa-ab53-57bde33cf62f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:10.539007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b55c28-2444-452b-a180-c43416876790 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:10.540396 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b55c28-2444-452b-a180-c43416876790 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:10.557065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-f3b55c28-2444-452b-a180-c43416876790 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 21:53:10.557065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:10.557065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:53:10.557065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:53:10.557065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:53:10.557065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:53:10.557065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:53:10.557065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:10.557065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 21:53:10.557065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:10.557065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:53:10.557065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:10.557065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:10.557065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:10.557065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:10.557065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:10.558226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:10.558226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:10.558226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:10.558226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:10.558226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:10.558226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:10.558226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:10.558226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:53:10.558226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:53:10.558226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:53:10.558226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:53:10.558226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:10.558226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:10.558226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:10.558226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:10.558226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:10.559121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:10.559121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:10.559121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:10.559121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:10.559121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:10.559121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:10.559121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:10.559121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:10.559121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:10.559121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:10.559121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:10.559121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:53:10.559121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:10.559121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 21:53:10.559121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:10.559121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 408/813] 10.222.0.35 () {56 vars in 1129 bytes} [Thu May 19 21:53:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:10.559966 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b55c28-2444-452b-a180-c43416876790 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:10.592116 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846d447-3d10-4416-bb80-920ae498ae8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:10.592848 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846d447-3d10-4416-bb80-920ae498ae8c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:10.593140 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846d447-3d10-4416-bb80-920ae498ae8c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:10.593420 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846d447-3d10-4416-bb80-920ae498ae8c None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:10.594348 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846d447-3d10-4416-bb80-920ae498ae8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:10.594544 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846d447-3d10-4416-bb80-920ae498ae8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:10.595989 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846d447-3d10-4416-bb80-920ae498ae8c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:10.609663 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 406/814] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:53:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:10.610480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846d447-3d10-4416-bb80-920ae498ae8c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:10.683708 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b55c28-2444-452b-a180-c43416876790 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:10.718795 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f9d09-402d-472a-be5a-a4a6d3d365b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:10.722660 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f9d09-402d-472a-be5a-a4a6d3d365b0 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:10.722974 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f9d09-402d-472a-be5a-a4a6d3d365b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:10.723117 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846d447-3d10-4416-bb80-920ae498ae8c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:10.723278 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f9d09-402d-472a-be5a-a4a6d3d365b0 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:10.724119 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f9d09-402d-472a-be5a-a4a6d3d365b0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:10.724448 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f9d09-402d-472a-be5a-a4a6d3d365b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:10.725923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f9d09-402d-472a-be5a-a4a6d3d365b0 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:10.742337 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:10.747497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 409/815] 10.222.0.35 () {56 vars in 1133 bytes} [Thu May 19 21:53:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:10.749048 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f9d09-402d-472a-be5a-a4a6d3d365b0 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:10.759009 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8cea9-8ec8-4a4d-9b1d-18c5289cc16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:10.760560 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8cea9-8ec8-4a4d-9b1d-18c5289cc16a None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:10.760918 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8cea9-8ec8-4a4d-9b1d-18c5289cc16a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:10.761208 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8cea9-8ec8-4a4d-9b1d-18c5289cc16a None admin] PATH_INFO: `/v3/projects/89b20e18525c473e94a2b263148f1f5f/users/86a4208619f84f16b735871ee114e660/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:10.763167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8cea9-8ec8-4a4d-9b1d-18c5289cc16a None admin] RBAC: Authorizing `identity:create_grant(project_id=89b20e18525c473e94a2b263148f1f5f, user_id=86a4208619f84f16b735871ee114e660, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:10.764631 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8cea9-8ec8-4a4d-9b1d-18c5289cc16a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:10.778141 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 407/816] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 21:53:10 2022] PUT /identity/v3/projects/89b20e18525c473e94a2b263148f1f5f/users/86a4208619f84f16b735871ee114e660/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:53:10.779494 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10593cf-04e1-4a48-8696-d0ff2a1afe69 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:10.779795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10593cf-04e1-4a48-8696-d0ff2a1afe69 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:10.780046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10593cf-04e1-4a48-8696-d0ff2a1afe69 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:10.784451 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 408/817] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:10.784451 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10593cf-04e1-4a48-8696-d0ff2a1afe69 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:10.791707 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:10.878498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f9d09-402d-472a-be5a-a4a6d3d365b0 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:10.925805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10593cf-04e1-4a48-8696-d0ff2a1afe69 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:10.926876 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62369d-c638-4543-b39d-fbf689183c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:10.927570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62369d-c638-4543-b39d-fbf689183c5d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:10.927857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62369d-c638-4543-b39d-fbf689183c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:10.928137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62369d-c638-4543-b39d-fbf689183c5d None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:10.928992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62369d-c638-4543-b39d-fbf689183c5d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:10.929298 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62369d-c638-4543-b39d-fbf689183c5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:10.930727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62369d-c638-4543-b39d-fbf689183c5d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:10.941456 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 410/818] 10.222.0.35 () {56 vars in 1124 bytes} [Thu May 19 21:53:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:10.941456 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62369d-c638-4543-b39d-fbf689183c5d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:10.972086 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8ab45-46f9-4908-a913-9bfe425e4117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:10.973152 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8ab45-46f9-4908-a913-9bfe425e4117 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:10.973433 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8ab45-46f9-4908-a913-9bfe425e4117 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:10.973706 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8ab45-46f9-4908-a913-9bfe425e4117 None admin] PATH_INFO: `/v3/projects/89b20e18525c473e94a2b263148f1f5f/users/6d4c4b75552b4c739079f328a6efba40/roles/372e9dc71b5a4a4daddc43ab384fa67b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:10.995598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8ab45-46f9-4908-a913-9bfe425e4117 None admin] RBAC: Authorizing `identity:create_grant(project_id=89b20e18525c473e94a2b263148f1f5f, user_id=6d4c4b75552b4c739079f328a6efba40, role_id=372e9dc71b5a4a4daddc43ab384fa67b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:10.997097 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8ab45-46f9-4908-a913-9bfe425e4117 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:11.014252 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:11.014552 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 409/819] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 21:53:10 2022] PUT /identity/v3/projects/89b20e18525c473e94a2b263148f1f5f/users/6d4c4b75552b4c739079f328a6efba40/roles/372e9dc71b5a4a4daddc43ab384fa67b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:53:11.015804 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62c931-f369-4668-9ce1-9adb45ec8a35 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:11.016101 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62c931-f369-4668-9ce1-9adb45ec8a35 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:11.016382 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62c931-f369-4668-9ce1-9adb45ec8a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:11.041536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8c62c931-f369-4668-9ce1-9adb45ec8a35 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:11.042931 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8c62c931-f369-4668-9ce1-9adb45ec8a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:11.083765 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62369d-c638-4543-b39d-fbf689183c5d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:11.102952 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:11.135628 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 410/820] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:53:11.136937 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62c931-f369-4668-9ce1-9adb45ec8a35 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:11.140208 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbe745-533e-43ed-9303-460766ac3cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:11.141369 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbe745-533e-43ed-9303-460766ac3cad None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:11.141851 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbe745-533e-43ed-9303-460766ac3cad None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:11.142324 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbe745-533e-43ed-9303-460766ac3cad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:11.236527 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfbe745-533e-43ed-9303-460766ac3cad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:11.237977 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfbe745-533e-43ed-9303-460766ac3cad None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:11.289081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62c931-f369-4668-9ce1-9adb45ec8a35 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:11.316968 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:11.344702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7573bc6-9c68-4c0b-aaf9-b7ee22e6be0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:11.345392 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7573bc6-9c68-4c0b-aaf9-b7ee22e6be0b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:11.345686 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7573bc6-9c68-4c0b-aaf9-b7ee22e6be0b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:11.345965 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7573bc6-9c68-4c0b-aaf9-b7ee22e6be0b None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:11.346691 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7573bc6-9c68-4c0b-aaf9-b7ee22e6be0b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:11.347000 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7573bc6-9c68-4c0b-aaf9-b7ee22e6be0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:11.350237 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7573bc6-9c68-4c0b-aaf9-b7ee22e6be0b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:11.357574 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 411/821] 10.222.0.35 () {56 vars in 1124 bytes} [Thu May 19 21:53:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:11.358564 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7573bc6-9c68-4c0b-aaf9-b7ee22e6be0b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:11.387228 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 411/822] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:53:10 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:53:11.388229 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbe745-533e-43ed-9303-460766ac3cad None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:11.428450 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:11.504208 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbe745-533e-43ed-9303-460766ac3cad None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:11.511849 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7573bc6-9c68-4c0b-aaf9-b7ee22e6be0b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:11.564605 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fad166-2708-48e2-bff9-cb76264551be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:11.565417 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fad166-2708-48e2-bff9-cb76264551be None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:11.565708 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fad166-2708-48e2-bff9-cb76264551be None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:11.565988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fad166-2708-48e2-bff9-cb76264551be None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:11.566873 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fad166-2708-48e2-bff9-cb76264551be None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:11.568390 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fad166-2708-48e2-bff9-cb76264551be None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:11.569467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10294a0-eefd-4b78-8f8c-d2b3c025bd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:11.570582 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10294a0-eefd-4b78-8f8c-d2b3c025bd1f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:11.571079 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10294a0-eefd-4b78-8f8c-d2b3c025bd1f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:11.571561 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10294a0-eefd-4b78-8f8c-d2b3c025bd1f None admin] PATH_INFO: `/v3/services/network` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:11.572684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10294a0-eefd-4b78-8f8c-d2b3c025bd1f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:11.574300 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10294a0-eefd-4b78-8f8c-d2b3c025bd1f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:11.588354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-c10294a0-eefd-4b78-8f8c-d2b3c025bd1f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 21:53:11.588354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:11.588354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:53:11.588354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:53:11.588354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:53:11.588354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:53:11.588354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:53:11.588354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:11.588354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 21:53:11.588354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:11.588354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:53:11.588354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:11.588354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:11.588354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:11.588354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:11.588354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:11.588354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:11.589393 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:11.589393 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:11.589393 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:11.589393 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:11.589393 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:11.589393 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:11.589393 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:53:11.589393 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:53:11.589393 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:53:11.589393 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:53:11.589393 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:11.589393 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:11.589393 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:11.589393 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:11.589393 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:11.589393 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:11.590207 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:11.590207 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:11.590207 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:11.590207 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:11.590207 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:11.590207 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:11.590207 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:11.590207 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:11.590207 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:11.590207 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:11.590207 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:53:11.590207 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:11.590207 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 21:53:11.590207 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:11.593422 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 412/823] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:53:11 2022] GET /identity/v3/services/network => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:11.594464 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10294a0-eefd-4b78-8f8c-d2b3c025bd1f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:11.599998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 412/824] 10.222.0.35 () {60 vars in 1144 bytes} [Thu May 19 21:53:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:53:11.602629 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fad166-2708-48e2-bff9-cb76264551be None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:11.638634 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:11.758098 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fad166-2708-48e2-bff9-cb76264551be None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:11.805239 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74595f39-aba2-4d4e-b230-905e2c7a7b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:11.806066 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74595f39-aba2-4d4e-b230-905e2c7a7b03 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:11.806913 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74595f39-aba2-4d4e-b230-905e2c7a7b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:11.807198 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74595f39-aba2-4d4e-b230-905e2c7a7b03 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:11.807929 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74595f39-aba2-4d4e-b230-905e2c7a7b03 None admin] RBAC: Adding query filter params (name=network) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:11.808238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74595f39-aba2-4d4e-b230-905e2c7a7b03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:11.809693 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10294a0-eefd-4b78-8f8c-d2b3c025bd1f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:11.809809 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74595f39-aba2-4d4e-b230-905e2c7a7b03 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:11.821041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 413/825] 10.222.0.35 () {56 vars in 1112 bytes} [Thu May 19 21:53:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:11.822722 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74595f39-aba2-4d4e-b230-905e2c7a7b03 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:11.836453 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:11.867331 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f8596-8a7f-4ac4-b061-ffec34da0730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:11.868174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f8596-8a7f-4ac4-b061-ffec34da0730 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:11.868509 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f8596-8a7f-4ac4-b061-ffec34da0730 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:11.869411 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f8596-8a7f-4ac4-b061-ffec34da0730 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:11.883385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f8596-8a7f-4ac4-b061-ffec34da0730 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:11.885209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f8596-8a7f-4ac4-b061-ffec34da0730 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:11.902680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-d00f8596-8a7f-4ac4-b061-ffec34da0730 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:11.902680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:11.902680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:11.902680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:11.902680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:11.902680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:11.902680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:11.902680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:11.902680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:11.902680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:11.902680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:11.902680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:11.902680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:53:11.902680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:53:11.902680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:53:11.903584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:53:11.903584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:11.903584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:11.903584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:11.903584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:11.903584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:11.903584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:11.903584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:11.903584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:11.903584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:11.903584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:11.903584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:11.903584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:11.903584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:11.903584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:11.903584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:11.903584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:11.904506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:53:11.904506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:53:11.904506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:11.904506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:11.905157 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 413/826] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:11.910863 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f8596-8a7f-4ac4-b061-ffec34da0730 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:11.929483 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:11.956123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74595f39-aba2-4d4e-b230-905e2c7a7b03 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:12.000418 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd4349-bd8a-45a0-ab2a-ddc2c1670670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:12.001133 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd4349-bd8a-45a0-ab2a-ddc2c1670670 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:12.001418 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd4349-bd8a-45a0-ab2a-ddc2c1670670 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:12.001744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd4349-bd8a-45a0-ab2a-ddc2c1670670 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:12.002627 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd4349-bd8a-45a0-ab2a-ddc2c1670670 None admin] RBAC: Adding query filter params (type=network) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:12.002938 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd4349-bd8a-45a0-ab2a-ddc2c1670670 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:12.004521 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd4349-bd8a-45a0-ab2a-ddc2c1670670 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:12.016495 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 414/827] 10.222.0.35 () {56 vars in 1112 bytes} [Thu May 19 21:53:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:12.018424 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd4349-bd8a-45a0-ab2a-ddc2c1670670 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:12.107337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f8596-8a7f-4ac4-b061-ffec34da0730 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:12.151131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd4349-bd8a-45a0-ab2a-ddc2c1670670 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:12.192497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152e555-5cde-4609-b175-281000f45cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:12.193585 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152e555-5cde-4609-b175-281000f45cfe None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:12.194090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152e555-5cde-4609-b175-281000f45cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:12.194639 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152e555-5cde-4609-b175-281000f45cfe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:12.195611 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152e555-5cde-4609-b175-281000f45cfe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:12.197528 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152e555-5cde-4609-b175-281000f45cfe None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:12.197718 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fea768-0cfa-43e0-8b5e-6bc2ae5b5e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:12.198384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fea768-0cfa-43e0-8b5e-6bc2ae5b5e07 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:12.198664 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fea768-0cfa-43e0-8b5e-6bc2ae5b5e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:12.198938 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fea768-0cfa-43e0-8b5e-6bc2ae5b5e07 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:12.199671 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fea768-0cfa-43e0-8b5e-6bc2ae5b5e07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:12.199973 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fea768-0cfa-43e0-8b5e-6bc2ae5b5e07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:12.201339 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fea768-0cfa-43e0-8b5e-6bc2ae5b5e07 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:12.216021 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:12.232812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 415/828] 10.222.0.35 () {60 vars in 1144 bytes} [Thu May 19 21:53:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:53:12.238934 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 414/829] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:12.245903 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152e555-5cde-4609-b175-281000f45cfe None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:12.381554 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152e555-5cde-4609-b175-281000f45cfe None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:12.443914 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868830b8-6516-4376-9013-a56438f1c7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:12.444968 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868830b8-6516-4376-9013-a56438f1c7ac None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:12.445251 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868830b8-6516-4376-9013-a56438f1c7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:12.445527 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868830b8-6516-4376-9013-a56438f1c7ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:12.454886 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868830b8-6516-4376-9013-a56438f1c7ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:12.456506 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868830b8-6516-4376-9013-a56438f1c7ac None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:12.480642 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-868830b8-6516-4376-9013-a56438f1c7ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:12.480642 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:12.480642 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:12.480642 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:12.480642 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:12.480642 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:12.480642 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:12.480642 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:12.480642 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:12.480642 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:12.480642 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:12.480642 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:12.480642 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:53:12.480642 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:53:12.480642 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:53:12.481604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:53:12.481604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:12.481604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:12.481604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:12.481604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:12.481604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:12.481604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:12.481604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:12.481604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:12.481604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:12.481604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:12.481604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:12.481604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:12.481604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:12.481604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:12.481604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:12.481604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:12.483017 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:53:12.483017 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:53:12.483017 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:53:12.483017 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:53:12.483017 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:53:12.483017 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:53:12.483017 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:12.483017 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:12.483017 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 416/830] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:53:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:12.489700 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fea768-0cfa-43e0-8b5e-6bc2ae5b5e07 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:12.529122 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:12.629389 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fea768-0cfa-43e0-8b5e-6bc2ae5b5e07 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:12.670780 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576cc461-d503-489a-b8ae-640c0bdea808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:12.671853 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cc461-d503-489a-b8ae-640c0bdea808 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:12.672357 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cc461-d503-489a-b8ae-640c0bdea808 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:12.672885 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cc461-d503-489a-b8ae-640c0bdea808 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:12.673910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576cc461-d503-489a-b8ae-640c0bdea808 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:12.674435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576cc461-d503-489a-b8ae-640c0bdea808 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:12.676080 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576cc461-d503-489a-b8ae-640c0bdea808 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:12.694814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 415/831] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:53:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:12.697564 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868830b8-6516-4376-9013-a56438f1c7ac None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:12.768042 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:12.824212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868830b8-6516-4376-9013-a56438f1c7ac None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:12.871225 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460a014-d437-41ed-901b-a6141c46a637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:12.871898 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460a014-d437-41ed-901b-a6141c46a637 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:12.872181 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460a014-d437-41ed-901b-a6141c46a637 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:12.872496 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460a014-d437-41ed-901b-a6141c46a637 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:12.873336 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8460a014-d437-41ed-901b-a6141c46a637 None admin] RBAC: Adding query filter params (role.id=04369f3c13174671a298fcd8175998d8, scope.project.id=89b20e18525c473e94a2b263148f1f5f, user.id=902ca8f1d59547a0ab187b4748311f58) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:12.873649 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8460a014-d437-41ed-901b-a6141c46a637 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:12.875083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8460a014-d437-41ed-901b-a6141c46a637 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:12.881969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 417/832] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:53:12 2022] GET /identity/v3/role_assignments?user.id=902ca8f1d59547a0ab187b4748311f58&scope.project.id=89b20e18525c473e94a2b263148f1f5f&role.id=04369f3c13174671a298fcd8175998d8 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:13.196430 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67095521-232e-49f4-8c2f-fc7d208fff76 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:13.197311 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67095521-232e-49f4-8c2f-fc7d208fff76 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:13.197747 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67095521-232e-49f4-8c2f-fc7d208fff76 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:13.199526 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 416/833] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:13.205621 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd209dcc-a796-432c-a948-a4dd76696276 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:13.206140 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd209dcc-a796-432c-a948-a4dd76696276 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:13.206238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd209dcc-a796-432c-a948-a4dd76696276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:13.224722 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-fd209dcc-a796-432c-a948-a4dd76696276 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:13.225946 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-fd209dcc-a796-432c-a948-a4dd76696276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:13.306027 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 418/834] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:53:13.329962 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67095521-232e-49f4-8c2f-fc7d208fff76 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:13.424260 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:13.445973 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67095521-232e-49f4-8c2f-fc7d208fff76 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:13.482377 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e76e45-aca5-4200-9f89-c4f620645975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:13.483091 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e76e45-aca5-4200-9f89-c4f620645975 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:13.483370 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e76e45-aca5-4200-9f89-c4f620645975 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:13.483370 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e76e45-aca5-4200-9f89-c4f620645975 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:13.500933 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e76e45-aca5-4200-9f89-c4f620645975 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:53:13.506337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-f5e76e45-aca5-4200-9f89-c4f620645975 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:53:13.506337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:13.506337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:13.506337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:13.506337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:13.506337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:13.506337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:13.506337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:13.506337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:13.506337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:13.506337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:13.506337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:13.506337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:53:13.506337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:53:13.506337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:53:13.506337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:53:13.508524 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:53:13.508524 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:53:13.508524 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:53:13.508524 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:53:13.508524 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:13.508524 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:13.508524 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:13.508524 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:13.508524 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:13.508524 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:13.508524 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:13.508524 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:13.508524 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:13.508524 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:13.508524 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:13.508524 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:13.511466 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:13.511466 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:13.511466 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:13.511466 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:13.511466 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:53:13.511466 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:53:13.511466 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:53:13.511466 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:53:13.511466 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:53:13.511466 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:53:13.511466 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:53:13.511466 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:13.511466 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 417/835] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:53:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:13.516861 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd209dcc-a796-432c-a948-a4dd76696276 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:13.572806 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:13.631982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd209dcc-a796-432c-a948-a4dd76696276 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:13.671520 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99bb73-179d-4c52-8792-888533a351fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:13.672581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99bb73-179d-4c52-8792-888533a351fb None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:13.673096 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99bb73-179d-4c52-8792-888533a351fb None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:13.673570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99bb73-179d-4c52-8792-888533a351fb None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:13.674540 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99bb73-179d-4c52-8792-888533a351fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:13.675076 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99bb73-179d-4c52-8792-888533a351fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:13.676690 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99bb73-179d-4c52-8792-888533a351fb None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:13.686871 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 419/836] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:53:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:13.692794 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e76e45-aca5-4200-9f89-c4f620645975 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:13.791890 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78157df-068b-4ae0-9384-bc3422148d83 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:13.792069 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78157df-068b-4ae0-9384-bc3422148d83 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:13.792325 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78157df-068b-4ae0-9384-bc3422148d83 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:13.794081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 420/837] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:13.799706 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb000f8-36c1-4b2c-a451-2705a7501345 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:13.800017 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb000f8-36c1-4b2c-a451-2705a7501345 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:13.800247 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb000f8-36c1-4b2c-a451-2705a7501345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:13.807550 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e76e45-aca5-4200-9f89-c4f620645975 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:13.818208 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-3bb000f8-36c1-4b2c-a451-2705a7501345 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:13.819401 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3bb000f8-36c1-4b2c-a451-2705a7501345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:13.846435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bbc5a-f06a-4f08-94bb-bd8d69391161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:13.847544 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bbc5a-f06a-4f08-94bb-bd8d69391161 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:13.848136 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bbc5a-f06a-4f08-94bb-bd8d69391161 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:13.848629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bbc5a-f06a-4f08-94bb-bd8d69391161 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:13.862339 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994bbc5a-f06a-4f08-94bb-bd8d69391161 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:13.864220 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994bbc5a-f06a-4f08-94bb-bd8d69391161 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:13.866845 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:13.886685 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-994bbc5a-f06a-4f08-94bb-bd8d69391161 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:13.886685 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:13.886685 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:13.886685 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:13.886685 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:13.886685 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:13.886685 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:13.886685 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:13.886685 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:13.886685 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:13.886685 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:13.886685 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:13.886685 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:53:13.886685 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:53:13.886685 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:53:13.887624 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:53:13.887624 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:13.887624 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:13.887624 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:13.887624 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:13.887624 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:13.887624 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:13.887624 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:13.887624 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:13.887624 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:13.887624 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:13.887624 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:13.887624 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:13.887624 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:13.887624 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:13.887624 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:13.887624 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:13.888507 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:53:13.888507 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:53:13.888507 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:13.888507 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:13.889913 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 418/838] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:13.895655 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bbc5a-f06a-4f08-94bb-bd8d69391161 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:13.908506 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 421/839] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:53:13.932924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb000f8-36c1-4b2c-a451-2705a7501345 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:13.987886 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:14.031346 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bbc5a-f06a-4f08-94bb-bd8d69391161 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:14.061415 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb000f8-36c1-4b2c-a451-2705a7501345 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:14.076522 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87ccce-47f3-40d1-9633-42072405c61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:14.077198 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87ccce-47f3-40d1-9633-42072405c61d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:14.077480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87ccce-47f3-40d1-9633-42072405c61d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:14.077753 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87ccce-47f3-40d1-9633-42072405c61d None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:14.078502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87ccce-47f3-40d1-9633-42072405c61d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:14.078951 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87ccce-47f3-40d1-9633-42072405c61d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:14.080782 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87ccce-47f3-40d1-9633-42072405c61d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:14.101472 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 419/840] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:14.104477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87ccce-47f3-40d1-9633-42072405c61d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:14.106322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231539ac-c5a1-4e34-ad21-9300a81370c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:14.107116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231539ac-c5a1-4e34-ad21-9300a81370c8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:14.107401 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231539ac-c5a1-4e34-ad21-9300a81370c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:14.107678 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231539ac-c5a1-4e34-ad21-9300a81370c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:14.122330 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231539ac-c5a1-4e34-ad21-9300a81370c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:53:14.132934 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-231539ac-c5a1-4e34-ad21-9300a81370c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:53:14.132934 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:14.132934 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:14.132934 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:14.132934 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:14.132934 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:14.132934 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:14.132934 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:14.132934 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:14.132934 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:14.132934 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:14.132934 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:14.132934 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:53:14.132934 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:53:14.132934 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:53:14.132934 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:53:14.133920 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:53:14.133920 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:53:14.133920 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:53:14.133920 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:53:14.133920 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:14.133920 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:14.133920 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:14.133920 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:14.133920 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:14.133920 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:14.133920 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:14.133920 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:14.133920 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:14.133920 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:14.133920 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:14.133920 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:14.134759 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:14.134759 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:14.134759 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:14.134759 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:14.134759 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:53:14.134759 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:53:14.134759 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:53:14.134759 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:53:14.134759 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:53:14.134759 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:53:14.134759 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:53:14.134759 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:14.142450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 422/841] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 21:53:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:53:14.143755 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231539ac-c5a1-4e34-ad21-9300a81370c8 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:14.197442 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:14.257508 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87ccce-47f3-40d1-9633-42072405c61d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:14.281625 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231539ac-c5a1-4e34-ad21-9300a81370c8 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:14.283983 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:14.302733 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc2dad-c54a-4b1e-b46d-94b81a288b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:14.304023 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc2dad-c54a-4b1e-b46d-94b81a288b8e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:14.304526 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc2dad-c54a-4b1e-b46d-94b81a288b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:14.304999 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc2dad-c54a-4b1e-b46d-94b81a288b8e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:14.315065 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc2dad-c54a-4b1e-b46d-94b81a288b8e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:14.317038 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc2dad-c54a-4b1e-b46d-94b81a288b8e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:14.330167 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770d2fc-2ad0-4852-b5c2-afd0864b165e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:14.330908 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770d2fc-2ad0-4852-b5c2-afd0864b165e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:14.331201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770d2fc-2ad0-4852-b5c2-afd0864b165e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:14.331477 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770d2fc-2ad0-4852-b5c2-afd0864b165e None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:14.332371 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770d2fc-2ad0-4852-b5c2-afd0864b165e None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:14.332711 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770d2fc-2ad0-4852-b5c2-afd0864b165e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:14.334292 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770d2fc-2ad0-4852-b5c2-afd0864b165e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:14.336798 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-12bc2dad-c54a-4b1e-b46d-94b81a288b8e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 21:53:14.336798 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:14.336798 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:14.336798 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:14.336798 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:14.336798 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:14.336798 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:14.336798 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:14.336798 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:14.336798 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:14.336798 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:14.336798 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:14.336798 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:53:14.336798 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:53:14.336798 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:53:14.336798 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:53:14.338374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:14.338374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:14.338374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:53:14.338374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:14.338374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:53:14.338374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:14.338374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:14.338374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:14.338374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:14.338374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:14.338374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:14.338374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:14.338374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:14.338374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:14.338374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:14.338374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:14.338374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:14.338374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:14.339332 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:14.339332 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:14.339332 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:53:14.339332 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:53:14.339332 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:53:14.339332 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:53:14.339332 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:53:14.339332 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:53:14.339332 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 21:53:14.339332 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:14.346416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 420/842] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:53:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:14.347675 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc2dad-c54a-4b1e-b46d-94b81a288b8e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:14.350307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 423/843] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 21:53:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:14.351992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab09203-58cf-4d68-949b-b1baa8401488 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:14.352288 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab09203-58cf-4d68-949b-b1baa8401488 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:14.352627 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab09203-58cf-4d68-949b-b1baa8401488 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:14.355874 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 424/844] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:14.356661 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab09203-58cf-4d68-949b-b1baa8401488 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:14.461359 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc2dad-c54a-4b1e-b46d-94b81a288b8e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:14.475320 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab09203-58cf-4d68-949b-b1baa8401488 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:14.475710 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:14.501113 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3c5a8-ac94-486b-8d4d-86aa70ad7d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:14.501774 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3c5a8-ac94-486b-8d4d-86aa70ad7d87 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:14.502041 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3c5a8-ac94-486b-8d4d-86aa70ad7d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:14.502311 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3c5a8-ac94-486b-8d4d-86aa70ad7d87 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:14.503154 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3c5a8-ac94-486b-8d4d-86aa70ad7d87 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:14.503457 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3c5a8-ac94-486b-8d4d-86aa70ad7d87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:14.504912 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3c5a8-ac94-486b-8d4d-86aa70ad7d87 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:14.516229 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ddce0-b687-42ed-bce1-d673cebd3e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:14.517097 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ddce0-b687-42ed-bce1-d673cebd3e4b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:14.517385 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ddce0-b687-42ed-bce1-d673cebd3e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:14.517661 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ddce0-b687-42ed-bce1-d673cebd3e4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:14.523102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 421/845] 10.222.0.35 () {56 vars in 1135 bytes} [Thu May 19 21:53:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:14.524167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb0811-be5c-4337-9259-f252d71a88e7 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:14.524481 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb0811-be5c-4337-9259-f252d71a88e7 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:14.524760 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb0811-be5c-4337-9259-f252d71a88e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:14.534761 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ddce0-b687-42ed-bce1-d673cebd3e4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:14.536243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ddce0-b687-42ed-bce1-d673cebd3e4b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:14.547324 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c2fb0811-be5c-4337-9259-f252d71a88e7 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:14.548550 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c2fb0811-be5c-4337-9259-f252d71a88e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:14.555212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-668ddce0-b687-42ed-bce1-d673cebd3e4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:14.555212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:14.555212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:14.555212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:14.555212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:14.555212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:14.555212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:14.555212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:14.555212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:14.555212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:14.555212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:14.555212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:14.555212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:53:14.555212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:53:14.555212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:53:14.556131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:53:14.556131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:14.556131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:14.556131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:14.556131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:14.556131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:14.556131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:14.556131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:14.556131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:14.556131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:14.556131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:14.556131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:14.556131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:14.556131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:14.556131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:14.556131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:14.556131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:14.557295 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:53:14.557295 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:53:14.557295 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:14.557295 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:14.557295 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 425/846] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:14.557564 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ddce0-b687-42ed-bce1-d673cebd3e4b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:14.577742 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:14.632455 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 422/847] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:53:14.632455 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb0811-be5c-4337-9259-f252d71a88e7 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:14.683717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ddce0-b687-42ed-bce1-d673cebd3e4b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:14.721234 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419759e1-22ab-4987-a73a-92348703b45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:14.721928 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419759e1-22ab-4987-a73a-92348703b45f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:14.722210 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419759e1-22ab-4987-a73a-92348703b45f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:14.722485 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419759e1-22ab-4987-a73a-92348703b45f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:14.740214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb0811-be5c-4337-9259-f252d71a88e7 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:14.742304 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:14.782572 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367a8bc-0158-4ac4-a7e2-84dc23a35f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:14.783337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367a8bc-0158-4ac4-a7e2-84dc23a35f43 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:14.783520 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367a8bc-0158-4ac4-a7e2-84dc23a35f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:14.783779 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367a8bc-0158-4ac4-a7e2-84dc23a35f43 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:14.784553 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367a8bc-0158-4ac4-a7e2-84dc23a35f43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:14.784855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367a8bc-0158-4ac4-a7e2-84dc23a35f43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:14.786339 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367a8bc-0158-4ac4-a7e2-84dc23a35f43 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:14.799766 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 423/848] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:14.801186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419759e1-22ab-4987-a73a-92348703b45f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:14.802680 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419759e1-22ab-4987-a73a-92348703b45f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:14.804823 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367a8bc-0158-4ac4-a7e2-84dc23a35f43 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:14.822786 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:14.918266 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 426/849] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:53:14 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:53:14.920585 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367a8bc-0158-4ac4-a7e2-84dc23a35f43 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:14.923467 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419759e1-22ab-4987-a73a-92348703b45f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:14.959459 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c796bba-b0c5-4214-8eb7-a9c9083a4380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:14.960451 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c796bba-b0c5-4214-8eb7-a9c9083a4380 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:14.960653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c796bba-b0c5-4214-8eb7-a9c9083a4380 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:14.960931 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c796bba-b0c5-4214-8eb7-a9c9083a4380 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:14.961595 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c796bba-b0c5-4214-8eb7-a9c9083a4380 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:14.963232 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c796bba-b0c5-4214-8eb7-a9c9083a4380 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:14.976261 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-3c796bba-b0c5-4214-8eb7-a9c9083a4380 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 21:53:14.976261 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:14.976261 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:53:14.976261 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:53:14.976261 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:53:14.976261 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:53:14.976261 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:53:14.976261 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:14.976261 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 21:53:14.976261 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:14.976261 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:53:14.976261 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:14.976261 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:14.976261 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:14.976261 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:14.976261 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:14.976261 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:14.977497 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:14.977497 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:14.977497 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:14.977497 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:14.977497 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:14.977497 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:14.977497 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:53:14.977497 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:53:14.977497 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:53:14.977497 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:53:14.977497 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:14.977497 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:14.977497 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:14.977497 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:14.977497 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:14.977497 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:14.979129 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:14.979129 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:14.979129 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:14.979129 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:14.979129 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:14.979129 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:14.979129 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:14.979129 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:14.979129 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:14.979129 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:14.979129 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:53:14.979129 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:14.979129 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 21:53:14.979129 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:14.979129 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 424/850] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 21:53:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:14.980095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c796bba-b0c5-4214-8eb7-a9c9083a4380 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:15.013803 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:15.055332 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419759e1-22ab-4987-a73a-92348703b45f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:15.076385 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:15.096321 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d325d-37d0-4bad-839b-d6f818338d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:15.096684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c796bba-b0c5-4214-8eb7-a9c9083a4380 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:15.097167 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d325d-37d0-4bad-839b-d6f818338d00 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:15.097445 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d325d-37d0-4bad-839b-d6f818338d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:15.097719 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d325d-37d0-4bad-839b-d6f818338d00 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:15.106256 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d325d-37d0-4bad-839b-d6f818338d00 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:15.107823 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d325d-37d0-4bad-839b-d6f818338d00 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:15.126154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-4f2d325d-37d0-4bad-839b-d6f818338d00 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 21:53:15.126154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:15.126154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:15.126154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:15.126154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:15.126154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:15.126154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:15.126154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:15.126154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:15.126154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:15.126154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:15.126154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:15.126154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:53:15.126154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:53:15.126154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:53:15.126154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:53:15.127243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:15.127243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:15.127243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:53:15.127243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:15.127243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:53:15.127243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:15.127243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:15.127243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:15.127243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:15.127243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:15.127243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:15.127243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:15.127243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:15.127243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:15.127243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:15.127243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:15.127243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:15.127243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:15.133024 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:15.133024 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:15.133024 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:53:15.133024 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:53:15.133024 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:53:15.133024 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:53:15.133024 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:53:15.133024 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:53:15.133024 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 21:53:15.133024 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:15.133024 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 427/851] 10.222.0.35 () {56 vars in 1117 bytes} [Thu May 19 21:53:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:15.133024 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d325d-37d0-4bad-839b-d6f818338d00 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:15.150120 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5b94d-1ac9-457c-81d2-e9a1d430405b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:15.151231 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5b94d-1ac9-457c-81d2-e9a1d430405b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:15.151520 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5b94d-1ac9-457c-81d2-e9a1d430405b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:15.151801 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5b94d-1ac9-457c-81d2-e9a1d430405b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:15.167663 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5b94d-1ac9-457c-81d2-e9a1d430405b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:15.169308 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5b94d-1ac9-457c-81d2-e9a1d430405b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:15.187345 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-80d5b94d-1ac9-457c-81d2-e9a1d430405b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:15.187345 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:15.187345 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:15.187345 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:15.187345 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:15.187345 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:15.187345 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:15.187345 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:15.187345 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:15.187345 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:15.187345 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:15.187345 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:15.187345 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:53:15.187345 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:53:15.187345 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:53:15.188290 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:53:15.188290 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:15.188290 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:15.188290 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:15.188290 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:15.188290 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:15.188290 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:15.188290 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:15.188290 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:15.188290 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:15.188290 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:15.188290 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:15.188290 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:15.188290 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:15.188290 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:15.188290 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:15.188290 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:15.189223 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:53:15.189223 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:53:15.189223 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:15.189223 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:15.189223 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 425/852] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:15.190119 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5b94d-1ac9-457c-81d2-e9a1d430405b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:15.247756 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d325d-37d0-4bad-839b-d6f818338d00 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:15.285587 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50dad12-bba8-4664-a3b1-c1026b9c6b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:15.286339 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50dad12-bba8-4664-a3b1-c1026b9c6b0d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:15.286525 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50dad12-bba8-4664-a3b1-c1026b9c6b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:15.286803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50dad12-bba8-4664-a3b1-c1026b9c6b0d None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:15.287527 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50dad12-bba8-4664-a3b1-c1026b9c6b0d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:15.287814 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50dad12-bba8-4664-a3b1-c1026b9c6b0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:15.289223 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50dad12-bba8-4664-a3b1-c1026b9c6b0d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:15.289740 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:15.294572 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 428/853] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 21:53:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:15.295463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50dad12-bba8-4664-a3b1-c1026b9c6b0d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:15.331223 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5b94d-1ac9-457c-81d2-e9a1d430405b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:15.341155 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:15.367618 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388cd0c-87fa-45f9-80a4-13ce8c87f2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:15.368318 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388cd0c-87fa-45f9-80a4-13ce8c87f2f0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:15.369152 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388cd0c-87fa-45f9-80a4-13ce8c87f2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:15.369433 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388cd0c-87fa-45f9-80a4-13ce8c87f2f0 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:15.370320 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388cd0c-87fa-45f9-80a4-13ce8c87f2f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:15.370964 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388cd0c-87fa-45f9-80a4-13ce8c87f2f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:15.372080 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388cd0c-87fa-45f9-80a4-13ce8c87f2f0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:15.390765 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 426/854] 10.222.0.35 () {56 vars in 1149 bytes} [Thu May 19 21:53:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:15.391598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388cd0c-87fa-45f9-80a4-13ce8c87f2f0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:15.407347 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50dad12-bba8-4664-a3b1-c1026b9c6b0d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:15.445546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abbb8b-a90b-4862-8fdf-1d329bd3fc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:15.446212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abbb8b-a90b-4862-8fdf-1d329bd3fc2b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:15.446497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abbb8b-a90b-4862-8fdf-1d329bd3fc2b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:15.446834 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abbb8b-a90b-4862-8fdf-1d329bd3fc2b None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:15.448046 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abbb8b-a90b-4862-8fdf-1d329bd3fc2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:15.448359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abbb8b-a90b-4862-8fdf-1d329bd3fc2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:15.449757 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abbb8b-a90b-4862-8fdf-1d329bd3fc2b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:15.460796 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 429/855] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:15.462046 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ccc37-1e6a-4a82-bfd0-217732988f33 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:15.462390 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ccc37-1e6a-4a82-bfd0-217732988f33 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:15.462683 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ccc37-1e6a-4a82-bfd0-217732988f33 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:15.463924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 430/856] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:15.464633 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ccc37-1e6a-4a82-bfd0-217732988f33 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:15.504758 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388cd0c-87fa-45f9-80a4-13ce8c87f2f0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:15.539315 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40d4c6-bb67-4aff-9ce8-7d40a728d967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:15.539984 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40d4c6-bb67-4aff-9ce8-7d40a728d967 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:15.540262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40d4c6-bb67-4aff-9ce8-7d40a728d967 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:15.541103 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40d4c6-bb67-4aff-9ce8-7d40a728d967 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:15.541953 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40d4c6-bb67-4aff-9ce8-7d40a728d967 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:15.542117 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40d4c6-bb67-4aff-9ce8-7d40a728d967 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:15.543484 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40d4c6-bb67-4aff-9ce8-7d40a728d967 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:15.545748 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:15.557883 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 427/857] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 21:53:15 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:15.557883 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40d4c6-bb67-4aff-9ce8-7d40a728d967 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:15.580370 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:15.585409 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ccc37-1e6a-4a82-bfd0-217732988f33 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:15.631740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4e625-711f-442c-8b56-4ec2eba417cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:15.632441 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4e625-711f-442c-8b56-4ec2eba417cf None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:15.632730 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4e625-711f-442c-8b56-4ec2eba417cf None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:15.633005 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4e625-711f-442c-8b56-4ec2eba417cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:15.683336 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40d4c6-bb67-4aff-9ce8-7d40a728d967 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:15.726889 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129ecb4-ca5e-4194-af1f-23f593ad5ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:15.727628 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129ecb4-ca5e-4194-af1f-23f593ad5ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:15.727925 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129ecb4-ca5e-4194-af1f-23f593ad5ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:15.728206 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129ecb4-ca5e-4194-af1f-23f593ad5ea6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:15.736221 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129ecb4-ca5e-4194-af1f-23f593ad5ea6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:15.737757 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129ecb4-ca5e-4194-af1f-23f593ad5ea6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:15.741427 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4e625-711f-442c-8b56-4ec2eba417cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:15.742915 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4e625-711f-442c-8b56-4ec2eba417cf None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:15.754193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-a129ecb4-ca5e-4194-af1f-23f593ad5ea6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:15.754193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:15.754193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:15.754193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:15.754193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:15.754193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:15.754193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:15.754193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:15.754193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:15.754193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:15.754193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:15.754193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:15.754193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:53:15.754193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:53:15.754193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:53:15.755148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:53:15.755148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:15.755148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:15.755148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:15.755148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:15.755148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:15.755148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:15.755148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:15.755148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:15.755148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:15.755148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:15.755148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:15.755148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:15.755148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:15.755148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:15.755148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:15.755148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:15.757054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:53:15.757054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:53:15.757054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:53:15.757054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:53:15.757054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:53:15.757054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:53:15.757054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:15.757054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:15.757054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 428/858] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:53:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:15.757054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9a3ee-c5c1-4f55-a147-e09b4ee5df27 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:15.757054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9a3ee-c5c1-4f55-a147-e09b4ee5df27 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:15.757628 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9a3ee-c5c1-4f55-a147-e09b4ee5df27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:15.779849 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-99d9a3ee-c5c1-4f55-a147-e09b4ee5df27 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:15.781199 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-99d9a3ee-c5c1-4f55-a147-e09b4ee5df27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:15.845779 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:15.860669 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:15.862629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 429/859] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:53:15.863739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9a3ee-c5c1-4f55-a147-e09b4ee5df27 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:15.864896 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 431/860] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:53:15 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:53:15.874947 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4e625-711f-442c-8b56-4ec2eba417cf None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:15.986367 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9a3ee-c5c1-4f55-a147-e09b4ee5df27 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:15.998353 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4e625-711f-442c-8b56-4ec2eba417cf None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:16.028789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20dc32-3beb-428d-becb-473e08e3ce2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:16.029711 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20dc32-3beb-428d-becb-473e08e3ce2b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:16.030180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20dc32-3beb-428d-becb-473e08e3ce2b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:16.030464 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20dc32-3beb-428d-becb-473e08e3ce2b None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:16.031286 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20dc32-3beb-428d-becb-473e08e3ce2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:16.031596 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20dc32-3beb-428d-becb-473e08e3ce2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:16.033055 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20dc32-3beb-428d-becb-473e08e3ce2b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:16.038429 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09b09a-b85b-4d45-94d3-e244606fa0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:16.039225 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09b09a-b85b-4d45-94d3-e244606fa0be None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:16.046457 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09b09a-b85b-4d45-94d3-e244606fa0be None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:16.046457 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09b09a-b85b-4d45-94d3-e244606fa0be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:16.046699 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 430/861] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:53:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:16.046935 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20dc32-3beb-428d-becb-473e08e3ce2b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:16.066471 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09b09a-b85b-4d45-94d3-e244606fa0be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:16.067950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09b09a-b85b-4d45-94d3-e244606fa0be None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:16.086276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-5b09b09a-b85b-4d45-94d3-e244606fa0be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:16.086276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:16.086276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:16.086276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:16.086276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:16.086276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:16.086276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:16.086276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:16.086276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:16.086276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:16.086276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:16.086276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:16.086276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:53:16.086276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:53:16.086276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:53:16.087269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:53:16.087269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:16.087269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:16.087269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:16.087269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:16.087269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:16.087269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:16.087269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:16.087269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:16.087269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:16.087269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:16.087269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:16.087269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:16.087269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:16.087269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:16.087269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:16.087269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:16.093931 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:53:16.093931 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:53:16.093931 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:16.093931 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:16.093931 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 432/862] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:16.093931 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09b09a-b85b-4d45-94d3-e244606fa0be None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:16.111155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:16.153195 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:16.172827 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20dc32-3beb-428d-becb-473e08e3ce2b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:16.205505 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09b09a-b85b-4d45-94d3-e244606fa0be None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:16.215242 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c20271-7644-40b9-ad98-dd2290aa6096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:16.216072 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c20271-7644-40b9-ad98-dd2290aa6096 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:16.216347 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c20271-7644-40b9-ad98-dd2290aa6096 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:16.216834 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c20271-7644-40b9-ad98-dd2290aa6096 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:16.217323 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c20271-7644-40b9-ad98-dd2290aa6096 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:16.218700 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c20271-7644-40b9-ad98-dd2290aa6096 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:16.232465 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-e9c20271-7644-40b9-ad98-dd2290aa6096 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 21:53:16.232465 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:16.232465 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:53:16.232465 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:53:16.232465 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:53:16.232465 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:53:16.232465 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:53:16.232465 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:16.232465 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 21:53:16.232465 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:16.232465 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:53:16.232465 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:16.232465 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:16.232465 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:16.232465 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:16.232465 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:16.233598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:16.233598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:16.233598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:16.233598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:16.233598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:16.233598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:16.233598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:16.233598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:53:16.233598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:53:16.233598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:53:16.233598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:53:16.233598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:16.233598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:16.233598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:16.233598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:16.233598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:16.234613 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:16.234613 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:16.234613 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:16.234613 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:16.234613 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:16.234613 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:16.234613 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:16.234613 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:16.234613 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:16.234613 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:16.234613 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:16.234613 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:53:16.234613 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:16.234613 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 21:53:16.234613 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:16.239112 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 431/863] 10.222.0.35 () {56 vars in 1132 bytes} [Thu May 19 21:53:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:16.239490 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c20271-7644-40b9-ad98-dd2290aa6096 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:16.248017 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35dd087-e104-4efb-944e-0f4b17a71280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:16.248911 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dd087-e104-4efb-944e-0f4b17a71280 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:16.249875 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dd087-e104-4efb-944e-0f4b17a71280 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:16.250252 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dd087-e104-4efb-944e-0f4b17a71280 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:16.251207 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35dd087-e104-4efb-944e-0f4b17a71280 None admin] RBAC: Adding query filter params (role.id=04369f3c13174671a298fcd8175998d8, scope.project.id=89b20e18525c473e94a2b263148f1f5f, user.id=86a4208619f84f16b735871ee114e660) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:16.251955 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35dd087-e104-4efb-944e-0f4b17a71280 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:16.253911 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35dd087-e104-4efb-944e-0f4b17a71280 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:16.261390 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 433/864] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:53:16 2022] GET /identity/v3/role_assignments?user.id=86a4208619f84f16b735871ee114e660&scope.project.id=89b20e18525c473e94a2b263148f1f5f&role.id=04369f3c13174671a298fcd8175998d8 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:16.261390 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35dd087-e104-4efb-944e-0f4b17a71280 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:16.394794 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c20271-7644-40b9-ad98-dd2290aa6096 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:16.404608 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35dd087-e104-4efb-944e-0f4b17a71280 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:16.420897 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:16.428359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:16.453275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe1201-2e81-4d7e-b2f6-0862c4fe7b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:16.453970 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe1201-2e81-4d7e-b2f6-0862c4fe7b83 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:16.454260 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe1201-2e81-4d7e-b2f6-0862c4fe7b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:16.454542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe1201-2e81-4d7e-b2f6-0862c4fe7b83 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:16.455293 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe1201-2e81-4d7e-b2f6-0862c4fe7b83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:16.460228 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0f004-918e-43d7-ba90-b80785473e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:16.462118 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0f004-918e-43d7-ba90-b80785473e7c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:16.463927 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0f004-918e-43d7-ba90-b80785473e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:16.464886 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0f004-918e-43d7-ba90-b80785473e7c None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:16.465055 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe1201-2e81-4d7e-b2f6-0862c4fe7b83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:16.466644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe1201-2e81-4d7e-b2f6-0862c4fe7b83 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:16.467115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0f004-918e-43d7-ba90-b80785473e7c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:16.467979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0f004-918e-43d7-ba90-b80785473e7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:16.471192 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0f004-918e-43d7-ba90-b80785473e7c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:16.482996 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 432/865] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:16.483439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 434/866] 10.222.0.35 () {56 vars in 1126 bytes} [Thu May 19 21:53:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:16.487541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe1201-2e81-4d7e-b2f6-0862c4fe7b83 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:16.491367 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0f004-918e-43d7-ba90-b80785473e7c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:16.629085 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0f004-918e-43d7-ba90-b80785473e7c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:16.644514 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe1201-2e81-4d7e-b2f6-0862c4fe7b83 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:16.675426 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd1dc6-8447-4d99-a307-5c4ef334c956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:16.676525 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd1dc6-8447-4d99-a307-5c4ef334c956 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:16.677089 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd1dc6-8447-4d99-a307-5c4ef334c956 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:16.677535 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd1dc6-8447-4d99-a307-5c4ef334c956 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:16.686719 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd1dc6-8447-4d99-a307-5c4ef334c956 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:16.688772 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd1dc6-8447-4d99-a307-5c4ef334c956 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:16.707297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-dafd1dc6-8447-4d99-a307-5c4ef334c956 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:16.707297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:16.707297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:16.707297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:16.707297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:16.707297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:16.707297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:16.707297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:16.707297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:16.707297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:16.707297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:16.707297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:16.707297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:53:16.707297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:53:16.707297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:53:16.708379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:53:16.708379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:16.708379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:16.708379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:16.708379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:16.708379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:16.708379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:16.708379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:16.708379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:16.708379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:16.708379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:16.708379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:16.708379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:16.708379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:16.708379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:16.708379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:16.708379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:16.709459 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:53:16.709459 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:53:16.709459 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:53:16.709459 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:53:16.709459 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:53:16.709459 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:53:16.709459 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:16.709459 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:16.711760 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 435/867] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:53:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:53:16.720599 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e1cdd-6174-4e06-9171-729f9c2cca63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:16.720599 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e1cdd-6174-4e06-9171-729f9c2cca63 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:16.720599 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e1cdd-6174-4e06-9171-729f9c2cca63 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:16.720599 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e1cdd-6174-4e06-9171-729f9c2cca63 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:16.721023 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd1dc6-8447-4d99-a307-5c4ef334c956 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:16.727168 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e1cdd-6174-4e06-9171-729f9c2cca63 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:16.728080 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e1cdd-6174-4e06-9171-729f9c2cca63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:16.732465 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e1cdd-6174-4e06-9171-729f9c2cca63 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:16.738355 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 433/868] 10.222.0.35 () {56 vars in 1126 bytes} [Thu May 19 21:53:16 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:16.784297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:16.854407 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd1dc6-8447-4d99-a307-5c4ef334c956 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:16.894859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790439c-d17d-4bb1-9ea0-1a5d6f6806be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:16.895548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790439c-d17d-4bb1-9ea0-1a5d6f6806be None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:16.895833 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790439c-d17d-4bb1-9ea0-1a5d6f6806be None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:16.896108 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790439c-d17d-4bb1-9ea0-1a5d6f6806be None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:16.896945 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790439c-d17d-4bb1-9ea0-1a5d6f6806be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:16.897285 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790439c-d17d-4bb1-9ea0-1a5d6f6806be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:16.898758 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790439c-d17d-4bb1-9ea0-1a5d6f6806be None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:16.912790 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 436/869] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:53:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:16.919317 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e1cdd-6174-4e06-9171-729f9c2cca63 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:16.965758 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:17.041520 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e1cdd-6174-4e06-9171-729f9c2cca63 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:17.079132 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d71cbc-6edb-42b9-b11f-9a4c7e50bdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:17.079791 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d71cbc-6edb-42b9-b11f-9a4c7e50bdfa None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:17.080127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d71cbc-6edb-42b9-b11f-9a4c7e50bdfa None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:17.080425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d71cbc-6edb-42b9-b11f-9a4c7e50bdfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:17.081266 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d71cbc-6edb-42b9-b11f-9a4c7e50bdfa None admin] RBAC: Adding query filter params (role.id=372e9dc71b5a4a4daddc43ab384fa67b, scope.project.id=89b20e18525c473e94a2b263148f1f5f, user.id=6d4c4b75552b4c739079f328a6efba40) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:17.081580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d71cbc-6edb-42b9-b11f-9a4c7e50bdfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:17.083007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d71cbc-6edb-42b9-b11f-9a4c7e50bdfa None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:17.090923 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 434/870] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:53:16 2022] GET /identity/v3/role_assignments?user.id=6d4c4b75552b4c739079f328a6efba40&scope.project.id=89b20e18525c473e94a2b263148f1f5f&role.id=372e9dc71b5a4a4daddc43ab384fa67b => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:17.940835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02b5c1-2755-4323-911d-57157998dd66 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:17.941393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02b5c1-2755-4323-911d-57157998dd66 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:17.941393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02b5c1-2755-4323-911d-57157998dd66 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:17.943025 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 437/871] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:17.949392 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e81c1-9fad-4cd2-b2fb-295e5d2c2932 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:17.949850 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e81c1-9fad-4cd2-b2fb-295e5d2c2932 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:17.949925 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e81c1-9fad-4cd2-b2fb-295e5d2c2932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:17.967748 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b60e81c1-9fad-4cd2-b2fb-295e5d2c2932 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:17.969095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b60e81c1-9fad-4cd2-b2fb-295e5d2c2932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:18.052567 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 435/872] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:53:18.069697 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02b5c1-2755-4323-911d-57157998dd66 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:18.175948 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:18.181743 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02b5c1-2755-4323-911d-57157998dd66 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:18.219854 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be108d1d-f75c-4f7e-941f-319e8fb039f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:18.220461 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be108d1d-f75c-4f7e-941f-319e8fb039f5 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:18.220748 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be108d1d-f75c-4f7e-941f-319e8fb039f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:18.221022 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be108d1d-f75c-4f7e-941f-319e8fb039f5 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:18.221760 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be108d1d-f75c-4f7e-941f-319e8fb039f5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:18.223131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be108d1d-f75c-4f7e-941f-319e8fb039f5 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:18.240261 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 438/873] 10.222.0.35 () {60 vars in 1141 bytes} [Thu May 19 21:53:18 2022] POST /identity/v3/services => generated 251 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:53:18.765704 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166839c-8bd8-41a5-b695-8f433149b010 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:18.766495 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166839c-8bd8-41a5-b695-8f433149b010 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:18.766977 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166839c-8bd8-41a5-b695-8f433149b010 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:18.768829 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 436/874] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:18.774487 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c41d03-0b7c-4731-96fc-e7fa0ae4b4a9 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:18.775583 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c41d03-0b7c-4731-96fc-e7fa0ae4b4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:18.776067 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c41d03-0b7c-4731-96fc-e7fa0ae4b4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:18.793165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-42c41d03-0b7c-4731-96fc-e7fa0ae4b4a9 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:18.795764 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-42c41d03-0b7c-4731-96fc-e7fa0ae4b4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:18.879718 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 439/875] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:18 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:53:18.902344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166839c-8bd8-41a5-b695-8f433149b010 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:18.936739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:19.027182 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166839c-8bd8-41a5-b695-8f433149b010 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:19.063774 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b7b3b-64a3-46bb-a56a-409e91238f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:19.064646 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b7b3b-64a3-46bb-a56a-409e91238f9b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:19.064937 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b7b3b-64a3-46bb-a56a-409e91238f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:19.065218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b7b3b-64a3-46bb-a56a-409e91238f9b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:19.065919 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b7b3b-64a3-46bb-a56a-409e91238f9b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:19.067348 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b7b3b-64a3-46bb-a56a-409e91238f9b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:19.080644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-094b7b3b-64a3-46bb-a56a-409e91238f9b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:53:19.080644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:19.080644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:53:19.080644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:53:19.080644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:53:19.080644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:53:19.080644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:53:19.080644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:19.080644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:53:19.080644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:19.080644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:53:19.080644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:19.080644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:19.080644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:19.080644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:19.080644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:19.080644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:19.081678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:19.081678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:19.081678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:19.081678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:19.081678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:19.081678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:19.081678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:53:19.081678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:53:19.081678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:53:19.081678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:53:19.081678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:19.081678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:19.081678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:19.081678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:19.081678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:19.081678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:19.082473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:19.082473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:19.082473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:19.082473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:19.082473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:19.082473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:19.082473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:19.082473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:19.082473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:19.082473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:19.082473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:53:19.082473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:19.082473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:53:19.082473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:19.082473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 437/876] 10.222.0.35 () {56 vars in 1126 bytes} [Thu May 19 21:53:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:19.090617 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c41d03-0b7c-4731-96fc-e7fa0ae4b4a9 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:19.185811 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:19.201927 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c41d03-0b7c-4731-96fc-e7fa0ae4b4a9 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:19.238337 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409ccac-5f6e-4639-b322-23cc215e1c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:19.239013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409ccac-5f6e-4639-b322-23cc215e1c47 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:19.239299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409ccac-5f6e-4639-b322-23cc215e1c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:19.239578 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409ccac-5f6e-4639-b322-23cc215e1c47 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:19.240288 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409ccac-5f6e-4639-b322-23cc215e1c47 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:19.240873 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409ccac-5f6e-4639-b322-23cc215e1c47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:19.242243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409ccac-5f6e-4639-b322-23cc215e1c47 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:19.248035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 440/877] 10.222.0.35 () {56 vars in 1122 bytes} [Thu May 19 21:53:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:19.253554 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b7b3b-64a3-46bb-a56a-409e91238f9b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:19.307803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0c428-8728-436b-a02f-9dc4ed1cd86d None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:19.308494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0c428-8728-436b-a02f-9dc4ed1cd86d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:19.309008 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0c428-8728-436b-a02f-9dc4ed1cd86d None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:19.315302 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 441/878] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:53:19.317040 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55140a7d-b1b0-4ca8-b0f7-bb0aeef4327c None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:19.317527 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55140a7d-b1b0-4ca8-b0f7-bb0aeef4327c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:19.317995 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55140a7d-b1b0-4ca8-b0f7-bb0aeef4327c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:19.342102 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-55140a7d-b1b0-4ca8-b0f7-bb0aeef4327c None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:19.343712 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-55140a7d-b1b0-4ca8-b0f7-bb0aeef4327c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:19.377334 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:19.386197 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b7b3b-64a3-46bb-a56a-409e91238f9b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:19.423868 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab6fb7-e3ea-408f-bd25-586353b6e0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:19.424972 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab6fb7-e3ea-408f-bd25-586353b6e0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:19.425456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab6fb7-e3ea-408f-bd25-586353b6e0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:19.425726 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab6fb7-e3ea-408f-bd25-586353b6e0e3 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:19.426606 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab6fb7-e3ea-408f-bd25-586353b6e0e3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:19.427077 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab6fb7-e3ea-408f-bd25-586353b6e0e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:19.428706 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab6fb7-e3ea-408f-bd25-586353b6e0e3 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:19.436335 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 438/879] 10.222.0.35 () {56 vars in 1122 bytes} [Thu May 19 21:53:19 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:19.448680 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 442/880] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:19 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:53:19.465442 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab6fb7-e3ea-408f-bd25-586353b6e0e3 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:19.484134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732104f-6d2e-4711-a049-921e313a1e0f None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:19.484738 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732104f-6d2e-4711-a049-921e313a1e0f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:19.485166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732104f-6d2e-4711-a049-921e313a1e0f None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:19.487132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 443/881] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:53:19.494720 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a7497-f01a-4fef-847c-39693c5990c0 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:19.495270 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a7497-f01a-4fef-847c-39693c5990c0 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:19.495704 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a7497-f01a-4fef-847c-39693c5990c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:19.517149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-5f7a7497-f01a-4fef-847c-39693c5990c0 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:19.518382 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5f7a7497-f01a-4fef-847c-39693c5990c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:19.602282 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab6fb7-e3ea-408f-bd25-586353b6e0e3 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:19.616548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 444/882] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:19 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:53:19.640792 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a7497-f01a-4fef-847c-39693c5990c0 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:19.648263 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4c9f3-44e4-4e56-ad7f-fc1f83dbbbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:19.649002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4c9f3-44e4-4e56-ad7f-fc1f83dbbbc3 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:19.649287 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4c9f3-44e4-4e56-ad7f-fc1f83dbbbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:19.649563 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4c9f3-44e4-4e56-ad7f-fc1f83dbbbc3 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:19.651476 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4c9f3-44e4-4e56-ad7f-fc1f83dbbbc3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:19.652964 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4c9f3-44e4-4e56-ad7f-fc1f83dbbbc3 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:19.656573 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:19.688596 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 439/883] 10.222.0.35 () {60 vars in 1141 bytes} [Thu May 19 21:53:19 2022] POST /identity/v3/services => generated 269 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:53:19.782505 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a7497-f01a-4fef-847c-39693c5990c0 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:19.837874 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16b583-0ef8-4d31-908c-80ca59f86f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:19.839296 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16b583-0ef8-4d31-908c-80ca59f86f07 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:19.839801 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16b583-0ef8-4d31-908c-80ca59f86f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:19.840304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16b583-0ef8-4d31-908c-80ca59f86f07 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:19.854167 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16b583-0ef8-4d31-908c-80ca59f86f07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:53:19.863021 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-3d16b583-0ef8-4d31-908c-80ca59f86f07 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 21:53:19.863021 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:19.863021 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:19.863021 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:19.863021 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:19.863021 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:19.863021 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:19.863021 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:19.863021 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:19.863021 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:19.863021 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:19.863021 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:19.863021 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:53:19.863021 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:53:19.863021 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:53:19.863021 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:53:19.863998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:53:19.863998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:53:19.863998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:53:19.863998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:53:19.863998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:19.863998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:19.863998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:19.863998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:19.863998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:19.863998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:19.863998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:19.863998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:19.863998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:19.863998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:19.863998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:19.863998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:19.865242 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:19.865242 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:19.865242 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:19.865242 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:19.865242 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:53:19.865242 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:53:19.865242 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:53:19.865242 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:53:19.865242 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:53:19.865242 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:53:19.865242 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 21:53:19.865242 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:19.868038 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 445/884] 10.222.0.35 () {56 vars in 1120 bytes} [Thu May 19 21:53:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:53:19.874279 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4c9f3-44e4-4e56-ad7f-fc1f83dbbbc3 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:19.900900 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:20.007690 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4c9f3-44e4-4e56-ad7f-fc1f83dbbbc3 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:20.043956 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deea102-edf5-4528-a84f-9918d42fee13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:20.044724 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deea102-edf5-4528-a84f-9918d42fee13 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:20.045073 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deea102-edf5-4528-a84f-9918d42fee13 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:20.045352 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deea102-edf5-4528-a84f-9918d42fee13 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:20.046109 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deea102-edf5-4528-a84f-9918d42fee13 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:20.046411 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deea102-edf5-4528-a84f-9918d42fee13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:20.047832 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deea102-edf5-4528-a84f-9918d42fee13 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:20.058114 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 440/885] 10.222.0.35 () {56 vars in 1115 bytes} [Thu May 19 21:53:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:20.063641 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16b583-0ef8-4d31-908c-80ca59f86f07 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:20.136901 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:20.177019 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16b583-0ef8-4d31-908c-80ca59f86f07 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:20.226513 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831495ac-56c3-4672-a222-7a71894562e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:20.227323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831495ac-56c3-4672-a222-7a71894562e7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:20.227613 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831495ac-56c3-4672-a222-7a71894562e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:20.227896 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831495ac-56c3-4672-a222-7a71894562e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:20.239731 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831495ac-56c3-4672-a222-7a71894562e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:20.241488 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831495ac-56c3-4672-a222-7a71894562e7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:20.260926 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-831495ac-56c3-4672-a222-7a71894562e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:20.260926 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:20.260926 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:20.260926 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:20.260926 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:20.260926 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:20.260926 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:20.260926 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:20.260926 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:20.260926 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:20.260926 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:20.260926 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:20.260926 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:53:20.260926 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:53:20.260926 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:53:20.261887 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:53:20.261887 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:20.261887 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:20.261887 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:20.261887 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:20.261887 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:20.261887 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:20.261887 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:20.261887 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:20.261887 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:20.261887 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:20.261887 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:20.261887 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:20.261887 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:20.261887 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:20.261887 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:20.261887 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:20.262764 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:53:20.262764 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:53:20.262764 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:20.262764 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:20.262764 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 446/886] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:20.269271 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deea102-edf5-4528-a84f-9918d42fee13 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:20.360231 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:20.383883 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deea102-edf5-4528-a84f-9918d42fee13 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:20.425863 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb36bd-8c8f-4038-8459-4d722a2470ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:20.426458 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb36bd-8c8f-4038-8459-4d722a2470ae None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:20.426740 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb36bd-8c8f-4038-8459-4d722a2470ae None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:20.427016 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb36bd-8c8f-4038-8459-4d722a2470ae None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:20.427751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb36bd-8c8f-4038-8459-4d722a2470ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:20.428055 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb36bd-8c8f-4038-8459-4d722a2470ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:20.429476 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb36bd-8c8f-4038-8459-4d722a2470ae None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:20.442627 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 441/887] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:20.447940 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831495ac-56c3-4672-a222-7a71894562e7 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:20.562496 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831495ac-56c3-4672-a222-7a71894562e7 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:20.582056 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:20.601852 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b69ca-b239-45b1-bf49-9511e9173f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:20.602678 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b69ca-b239-45b1-bf49-9511e9173f8f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:20.603044 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b69ca-b239-45b1-bf49-9511e9173f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:20.603937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b69ca-b239-45b1-bf49-9511e9173f8f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:20.612047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b69ca-b239-45b1-bf49-9511e9173f8f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:20.613558 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b69ca-b239-45b1-bf49-9511e9173f8f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:20.634473 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-507b69ca-b239-45b1-bf49-9511e9173f8f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 21:53:20.634473 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:20.634473 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:20.634473 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:20.634473 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:20.634473 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:20.634473 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:20.634473 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:20.634473 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:20.634473 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:20.634473 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:20.634473 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:20.634473 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:53:20.634473 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:53:20.634473 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:53:20.634473 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:53:20.635454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:20.635454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:20.635454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:53:20.635454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:20.635454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:53:20.635454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:20.635454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:20.635454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:20.635454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:20.635454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:20.635454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:20.635454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:20.635454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:20.635454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:20.635454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:20.635454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:20.635454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:20.635454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:20.637172 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:20.637172 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:20.637172 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:53:20.637172 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:53:20.637172 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:53:20.637172 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:53:20.637172 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:53:20.637172 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:53:20.637172 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 21:53:20.637172 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:20.637172 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 447/888] 10.222.0.35 () {56 vars in 1117 bytes} [Thu May 19 21:53:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:20.645503 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb36bd-8c8f-4038-8459-4d722a2470ae None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:20.720359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908de95e-42c4-42c4-8c8f-25ae0ab7a3e2 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:20.721030 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908de95e-42c4-42c4-8c8f-25ae0ab7a3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:20.721516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908de95e-42c4-42c4-8c8f-25ae0ab7a3e2 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:20.723555 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 448/889] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:53:20.729713 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555f1f3-16b5-4449-9724-5c7c4c376670 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:20.730769 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555f1f3-16b5-4449-9724-5c7c4c376670 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:20.731284 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555f1f3-16b5-4449-9724-5c7c4c376670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:20.755961 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8555f1f3-16b5-4449-9724-5c7c4c376670 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:20.758288 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8555f1f3-16b5-4449-9724-5c7c4c376670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:20.771058 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb36bd-8c8f-4038-8459-4d722a2470ae None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:20.818537 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d3b1f-411f-46d9-9c80-934d7ae95208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:20.819385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d3b1f-411f-46d9-9c80-934d7ae95208 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:20.819764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d3b1f-411f-46d9-9c80-934d7ae95208 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:20.820134 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d3b1f-411f-46d9-9c80-934d7ae95208 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:20.821209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d3b1f-411f-46d9-9c80-934d7ae95208 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:20.821613 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d3b1f-411f-46d9-9c80-934d7ae95208 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:20.823698 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d3b1f-411f-46d9-9c80-934d7ae95208 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:20.843174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:20.853997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 442/890] 10.222.0.35 () {56 vars in 1149 bytes} [Thu May 19 21:53:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:20.855480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d3b1f-411f-46d9-9c80-934d7ae95208 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:20.864335 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 449/891] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:53:20.889983 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555f1f3-16b5-4449-9724-5c7c4c376670 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:21.008719 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d3b1f-411f-46d9-9c80-934d7ae95208 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:21.014074 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555f1f3-16b5-4449-9724-5c7c4c376670 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:21.027178 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:21.048855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987241e-1421-41bc-8d45-25c17d3fe88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:21.049535 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987241e-1421-41bc-8d45-25c17d3fe88b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:21.049816 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987241e-1421-41bc-8d45-25c17d3fe88b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:21.050103 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987241e-1421-41bc-8d45-25c17d3fe88b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:21.062579 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71971eba-e3e6-4dba-b0eb-2f7bab4057f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:21.064196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71971eba-e3e6-4dba-b0eb-2f7bab4057f3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:21.064688 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71971eba-e3e6-4dba-b0eb-2f7bab4057f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:21.065114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71971eba-e3e6-4dba-b0eb-2f7bab4057f3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:21.066113 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71971eba-e3e6-4dba-b0eb-2f7bab4057f3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:21.068344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71971eba-e3e6-4dba-b0eb-2f7bab4057f3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:21.085016 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-71971eba-e3e6-4dba-b0eb-2f7bab4057f3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 21:53:21.085016 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:21.085016 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:53:21.085016 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:53:21.085016 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:53:21.085016 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:53:21.085016 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:53:21.085016 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:21.085016 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 21:53:21.085016 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:21.085016 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:53:21.085016 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:21.085016 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:21.085016 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:21.085016 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:21.085016 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:21.085016 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:21.086267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:21.086267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:21.086267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:21.086267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:21.086267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:21.086267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:21.086267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:53:21.086267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:53:21.086267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:53:21.086267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:53:21.086267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:21.086267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:21.086267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:21.086267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:21.086267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:21.086267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:21.087284 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:21.087284 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:21.087284 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:21.087284 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:21.087284 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:21.087284 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:21.087284 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:21.087284 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:21.087284 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:21.087284 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:21.087284 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:53:21.087284 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:21.087284 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 21:53:21.087284 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:21.089954 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 450/892] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 21:53:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:53:21.098553 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71971eba-e3e6-4dba-b0eb-2f7bab4057f3 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:21.129002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:21.131439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987241e-1421-41bc-8d45-25c17d3fe88b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:21.133294 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987241e-1421-41bc-8d45-25c17d3fe88b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:21.222797 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71971eba-e3e6-4dba-b0eb-2f7bab4057f3 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:21.267055 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af028eb-4b89-4a61-9bcd-e348cb4b57c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:21.268451 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af028eb-4b89-4a61-9bcd-e348cb4b57c9 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:21.268608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 443/893] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:53:20 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:53:21.272674 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af028eb-4b89-4a61-9bcd-e348cb4b57c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:21.273098 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af028eb-4b89-4a61-9bcd-e348cb4b57c9 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:21.273831 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987241e-1421-41bc-8d45-25c17d3fe88b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:21.274131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af028eb-4b89-4a61-9bcd-e348cb4b57c9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:21.274668 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af028eb-4b89-4a61-9bcd-e348cb4b57c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:21.276987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af028eb-4b89-4a61-9bcd-e348cb4b57c9 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:21.282769 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 451/894] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 21:53:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:21.288209 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af028eb-4b89-4a61-9bcd-e348cb4b57c9 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:21.326920 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:21.405712 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:21.409792 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987241e-1421-41bc-8d45-25c17d3fe88b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:21.428656 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af028eb-4b89-4a61-9bcd-e348cb4b57c9 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:21.458341 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695dbbf4-c124-4eb7-b364-5038b40e8f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:21.459532 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dbbf4-c124-4eb7-b364-5038b40e8f31 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:21.459950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dbbf4-c124-4eb7-b364-5038b40e8f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:21.460710 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dbbf4-c124-4eb7-b364-5038b40e8f31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:21.470891 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101de7f-56ca-48ed-89c0-73b536aa008b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:21.472113 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101de7f-56ca-48ed-89c0-73b536aa008b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:21.472424 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101de7f-56ca-48ed-89c0-73b536aa008b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:21.472708 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101de7f-56ca-48ed-89c0-73b536aa008b None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:21.473633 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7101de7f-56ca-48ed-89c0-73b536aa008b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:21.474088 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7101de7f-56ca-48ed-89c0-73b536aa008b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:21.475085 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695dbbf4-c124-4eb7-b364-5038b40e8f31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:21.475491 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7101de7f-56ca-48ed-89c0-73b536aa008b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:21.477163 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695dbbf4-c124-4eb7-b364-5038b40e8f31 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:21.487170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 452/895] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 21:53:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:21.488090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101de7f-56ca-48ed-89c0-73b536aa008b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:21.499114 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-695dbbf4-c124-4eb7-b364-5038b40e8f31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:21.499114 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:21.499114 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:21.499114 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:21.499114 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:21.499114 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:21.499114 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:21.499114 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:21.499114 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:21.499114 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:21.499114 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:21.499114 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:21.499114 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:53:21.499114 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:53:21.499114 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:53:21.500031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:53:21.500031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:21.500031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:21.500031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:21.500031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:21.500031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:21.500031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:21.500031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:21.500031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:21.500031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:21.500031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:21.500031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:21.500031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:21.500031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:21.500031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:21.500031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:21.500031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:21.501289 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:53:21.501289 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:53:21.501289 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:21.501289 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:21.503547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 444/896] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:21.512536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695dbbf4-c124-4eb7-b364-5038b40e8f31 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:21.601912 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:21.606988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101de7f-56ca-48ed-89c0-73b536aa008b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:21.631729 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695dbbf4-c124-4eb7-b364-5038b40e8f31 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:21.646006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf7c27-0ffa-452e-a811-00ae409ea45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:21.647030 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf7c27-0ffa-452e-a811-00ae409ea45b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:21.647511 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf7c27-0ffa-452e-a811-00ae409ea45b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:21.648021 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf7c27-0ffa-452e-a811-00ae409ea45b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:21.649066 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf7c27-0ffa-452e-a811-00ae409ea45b None admin] RBAC: Adding query filter params (interface=public, service_id=79c43b1a569743e7b4ffc0eca372e9dd, region_id=RegionOne) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:21.649601 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf7c27-0ffa-452e-a811-00ae409ea45b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:21.651577 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf7c27-0ffa-452e-a811-00ae409ea45b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:21.657929 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 453/897] 10.222.0.35 () {56 vars in 1251 bytes} [Thu May 19 21:53:21 2022] GET /identity/v3/endpoints?service_id=79c43b1a569743e7b4ffc0eca372e9dd&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:21.666467 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf7c27-0ffa-452e-a811-00ae409ea45b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:21.679630 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09d32f-f2a3-43f4-a4ac-3c5ef6e61b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:21.680754 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09d32f-f2a3-43f4-a4ac-3c5ef6e61b57 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:21.682034 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09d32f-f2a3-43f4-a4ac-3c5ef6e61b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:21.682322 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09d32f-f2a3-43f4-a4ac-3c5ef6e61b57 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:21.683201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09d32f-f2a3-43f4-a4ac-3c5ef6e61b57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:21.683511 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09d32f-f2a3-43f4-a4ac-3c5ef6e61b57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:21.684981 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09d32f-f2a3-43f4-a4ac-3c5ef6e61b57 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:21.703200 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 445/898] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:21.704146 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09d32f-f2a3-43f4-a4ac-3c5ef6e61b57 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:21.721079 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:21.794598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf7c27-0ffa-452e-a811-00ae409ea45b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:21.823410 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09d32f-f2a3-43f4-a4ac-3c5ef6e61b57 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:21.835136 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d517e7-b837-4736-abe0-b243c2c41c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:21.836195 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d517e7-b837-4736-abe0-b243c2c41c3d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:21.836718 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d517e7-b837-4736-abe0-b243c2c41c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:21.837191 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d517e7-b837-4736-abe0-b243c2c41c3d None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:21.838749 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d517e7-b837-4736-abe0-b243c2c41c3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:21.840449 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d517e7-b837-4736-abe0-b243c2c41c3d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:21.847420 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 454/899] 10.222.0.35 () {56 vars in 1087 bytes} [Thu May 19 21:53:21 2022] GET /identity/v3/services => generated 1268 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:53:21.873359 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d3d33-493b-4592-82f4-090b7391e906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:21.874827 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d3d33-493b-4592-82f4-090b7391e906 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:21.875532 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d3d33-493b-4592-82f4-090b7391e906 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:21.876045 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d3d33-493b-4592-82f4-090b7391e906 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:21.885457 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d3d33-493b-4592-82f4-090b7391e906 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:21.887396 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d3d33-493b-4592-82f4-090b7391e906 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:21.904288 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-c83d3d33-493b-4592-82f4-090b7391e906 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:21.904288 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:21.904288 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:21.904288 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:21.904288 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:21.904288 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:21.904288 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:21.904288 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:21.904288 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:21.904288 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:21.904288 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:21.904288 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:21.904288 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:53:21.904288 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:53:21.904288 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:53:21.905425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:53:21.905425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:21.905425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:21.905425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:21.905425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:21.905425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:21.905425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:21.905425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:21.905425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:21.905425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:21.905425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:21.905425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:21.905425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:21.905425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:21.905425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:21.905425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:21.905425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:21.906304 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:53:21.906304 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:53:21.906304 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:53:21.906304 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:53:21.906304 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:53:21.906304 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:53:21.906304 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:21.906304 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:21.909006 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 446/900] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:53:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:21.917627 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d517e7-b837-4736-abe0-b243c2c41c3d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:21.953990 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:21.967430 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed132c9-9135-4967-ab18-fb047e508dd8 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:21.967767 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed132c9-9135-4967-ab18-fb047e508dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:21.967980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed132c9-9135-4967-ab18-fb047e508dd8 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:21.971020 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 447/901] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:53:21.981059 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db116c92-065a-4300-a1b3-928b7334eb21 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:21.981547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db116c92-065a-4300-a1b3-928b7334eb21 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:21.981956 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db116c92-065a-4300-a1b3-928b7334eb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:22.006771 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-db116c92-065a-4300-a1b3-928b7334eb21 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:22.008739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-db116c92-065a-4300-a1b3-928b7334eb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:22.055313 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d517e7-b837-4736-abe0-b243c2c41c3d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:22.096323 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 448/902] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:53:22.102032 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a3222-e7a0-401c-9f39-ba961cecbf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:22.102942 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a3222-e7a0-401c-9f39-ba961cecbf51 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:22.103744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a3222-e7a0-401c-9f39-ba961cecbf51 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:22.104018 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a3222-e7a0-401c-9f39-ba961cecbf51 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:22.104832 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a3222-e7a0-401c-9f39-ba961cecbf51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:22.105138 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a3222-e7a0-401c-9f39-ba961cecbf51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:22.106576 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a3222-e7a0-401c-9f39-ba961cecbf51 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:22.122758 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db116c92-065a-4300-a1b3-928b7334eb21 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:22.122966 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 455/903] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:53:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:22.126128 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:22.129731 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a3222-e7a0-401c-9f39-ba961cecbf51 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:22.232557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:22.250802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a3222-e7a0-401c-9f39-ba961cecbf51 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:22.251405 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db116c92-065a-4300-a1b3-928b7334eb21 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:22.296695 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6617ef-4431-4bbe-867f-9d86ff70f0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:22.296913 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46dcee2-aa8d-43b9-abb4-bad7b8250590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:22.297380 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6617ef-4431-4bbe-867f-9d86ff70f0f3 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:22.297581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dcee2-aa8d-43b9-abb4-bad7b8250590 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:22.297720 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6617ef-4431-4bbe-867f-9d86ff70f0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:22.297892 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dcee2-aa8d-43b9-abb4-bad7b8250590 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:22.297987 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6617ef-4431-4bbe-867f-9d86ff70f0f3 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:22.298151 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dcee2-aa8d-43b9-abb4-bad7b8250590 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:22.298631 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6617ef-4431-4bbe-867f-9d86ff70f0f3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:22.298981 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46dcee2-aa8d-43b9-abb4-bad7b8250590 None admin] RBAC: Adding query filter params (role.id=349b194bc80845e4a14c05f7cffcfe54, scope.project.id=89b20e18525c473e94a2b263148f1f5f, user.id=6d4c4b75552b4c739079f328a6efba40) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:22.299349 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46dcee2-aa8d-43b9-abb4-bad7b8250590 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:22.300006 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6617ef-4431-4bbe-867f-9d86ff70f0f3 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:22.300830 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46dcee2-aa8d-43b9-abb4-bad7b8250590 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:22.316650 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 456/904] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:53:22 2022] GET /identity/v3/role_assignments?user.id=6d4c4b75552b4c739079f328a6efba40&scope.project.id=89b20e18525c473e94a2b263148f1f5f&role.id=349b194bc80845e4a14c05f7cffcfe54 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:22.316650 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a3038-7c73-46c5-8355-2204c3e079f3 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:22.316650 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a3038-7c73-46c5-8355-2204c3e079f3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:22.316650 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a3038-7c73-46c5-8355-2204c3e079f3 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:22.316650 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 457/905] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:22.317294 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b56e4c-cc01-42bc-a29c-cb429d719f5c None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:22.317473 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b56e4c-cc01-42bc-a29c-cb429d719f5c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:22.317706 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b56e4c-cc01-42bc-a29c-cb429d719f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:22.328953 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 449/906] 10.222.0.35 () {60 vars in 1141 bytes} [Thu May 19 21:53:22 2022] POST /identity/v3/services => generated 241 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:53:22.338525 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c7b56e4c-cc01-42bc-a29c-cb429d719f5c None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:22.340291 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c7b56e4c-cc01-42bc-a29c-cb429d719f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:22.444891 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 458/907] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:53:22.470423 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6617ef-4431-4bbe-867f-9d86ff70f0f3 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:22.569119 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:22.618107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6617ef-4431-4bbe-867f-9d86ff70f0f3 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:22.660603 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca62b1-9f91-4692-959e-07d66621124f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:22.661476 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca62b1-9f91-4692-959e-07d66621124f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:22.661756 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca62b1-9f91-4692-959e-07d66621124f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:22.662034 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca62b1-9f91-4692-959e-07d66621124f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:22.662733 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca62b1-9f91-4692-959e-07d66621124f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:22.664137 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca62b1-9f91-4692-959e-07d66621124f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:22.698013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-00ca62b1-9f91-4692-959e-07d66621124f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 21:53:22.698013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:22.698013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:53:22.698013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:53:22.698013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:53:22.698013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:53:22.698013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:53:22.698013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:22.698013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 21:53:22.698013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:22.698013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:53:22.698013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:22.698013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:22.698013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:22.698013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:22.698013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:22.699118 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:22.699118 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:22.699118 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:22.699118 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:22.699118 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:22.699118 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:22.699118 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:22.699118 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:53:22.699118 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:53:22.699118 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:53:22.699118 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:53:22.699118 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:22.699118 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:22.699118 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:22.699118 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:22.699118 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:22.699998 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:22.699998 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:22.699998 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:22.699998 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:22.699998 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:22.699998 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:22.699998 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:22.699998 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:22.699998 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:22.699998 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:22.699998 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:22.699998 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:53:22.699998 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:22.699998 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 21:53:22.699998 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:22.699998 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 450/908] 10.222.0.35 () {56 vars in 1132 bytes} [Thu May 19 21:53:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:22.707996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b56e4c-cc01-42bc-a29c-cb429d719f5c None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:22.795934 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:22.820177 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b56e4c-cc01-42bc-a29c-cb429d719f5c None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:22.856630 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052150d-90a2-4bfe-ab1e-e132ef4e54bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:22.857323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052150d-90a2-4bfe-ab1e-e132ef4e54bc None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:22.857603 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052150d-90a2-4bfe-ab1e-e132ef4e54bc None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:22.857875 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052150d-90a2-4bfe-ab1e-e132ef4e54bc None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:22.858588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052150d-90a2-4bfe-ab1e-e132ef4e54bc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:22.858894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052150d-90a2-4bfe-ab1e-e132ef4e54bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:22.860301 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052150d-90a2-4bfe-ab1e-e132ef4e54bc None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:22.866512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 459/909] 10.222.0.35 () {56 vars in 1126 bytes} [Thu May 19 21:53:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:22.873257 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca62b1-9f91-4692-959e-07d66621124f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:22.988209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca62b1-9f91-4692-959e-07d66621124f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:23.021573 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:23.042915 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35df35-2049-47a6-836c-3856b8fd6af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:23.043601 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35df35-2049-47a6-836c-3856b8fd6af8 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:23.043886 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35df35-2049-47a6-836c-3856b8fd6af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:23.044162 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35df35-2049-47a6-836c-3856b8fd6af8 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:23.044925 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35df35-2049-47a6-836c-3856b8fd6af8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:23.045235 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35df35-2049-47a6-836c-3856b8fd6af8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:23.046805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35df35-2049-47a6-836c-3856b8fd6af8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:23.052838 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 451/910] 10.222.0.35 () {56 vars in 1126 bytes} [Thu May 19 21:53:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:23.060355 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052150d-90a2-4bfe-ab1e-e132ef4e54bc None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:23.183201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052150d-90a2-4bfe-ab1e-e132ef4e54bc None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:23.222070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663eaf78-cad4-4bb2-b68a-56a074943131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:23.222744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663eaf78-cad4-4bb2-b68a-56a074943131 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:23.223168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663eaf78-cad4-4bb2-b68a-56a074943131 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:23.223392 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663eaf78-cad4-4bb2-b68a-56a074943131 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:23.224115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663eaf78-cad4-4bb2-b68a-56a074943131 None admin] RBAC: Adding query filter params (interface=public, service_id=0e94b5b5726a445c898ad686b8454a29, region_id=RegionOne) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:23.224447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663eaf78-cad4-4bb2-b68a-56a074943131 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:23.225863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663eaf78-cad4-4bb2-b68a-56a074943131 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:23.233234 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 460/911] 10.222.0.35 () {56 vars in 1251 bytes} [Thu May 19 21:53:23 2022] GET /identity/v3/endpoints?service_id=0e94b5b5726a445c898ad686b8454a29&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:23.239358 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35df35-2049-47a6-836c-3856b8fd6af8 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:23.359781 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35df35-2049-47a6-836c-3856b8fd6af8 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:23.401695 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efdbfd-495a-44da-a36d-602316b407d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:23.402367 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efdbfd-495a-44da-a36d-602316b407d2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:23.402646 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efdbfd-495a-44da-a36d-602316b407d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:23.402920 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efdbfd-495a-44da-a36d-602316b407d2 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:23.403601 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efdbfd-495a-44da-a36d-602316b407d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:23.404995 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efdbfd-495a-44da-a36d-602316b407d2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:23.411422 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 452/912] 10.222.0.35 () {56 vars in 1087 bytes} [Thu May 19 21:53:23 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:53:24.273713 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081b5ef-9d8b-42a6-aad3-662e194c304f None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:24.274246 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081b5ef-9d8b-42a6-aad3-662e194c304f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:24.274246 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081b5ef-9d8b-42a6-aad3-662e194c304f None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:24.276592 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 461/913] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:24.282316 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613baab7-2856-4cc6-8824-2d2d7b8be97c None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:24.282784 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613baab7-2856-4cc6-8824-2d2d7b8be97c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:24.282861 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613baab7-2856-4cc6-8824-2d2d7b8be97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:24.300987 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-613baab7-2856-4cc6-8824-2d2d7b8be97c None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:24.302191 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-613baab7-2856-4cc6-8824-2d2d7b8be97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:24.363011 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:24.394422 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 453/914] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:53:24.417210 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081b5ef-9d8b-42a6-aad3-662e194c304f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:24.427519 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:24.541922 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081b5ef-9d8b-42a6-aad3-662e194c304f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:24.580181 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceedb3d-48d8-47d7-99df-05acdddf82e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:24.581071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceedb3d-48d8-47d7-99df-05acdddf82e7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:24.581355 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceedb3d-48d8-47d7-99df-05acdddf82e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:24.581630 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceedb3d-48d8-47d7-99df-05acdddf82e7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:24.582309 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceedb3d-48d8-47d7-99df-05acdddf82e7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:24.583736 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceedb3d-48d8-47d7-99df-05acdddf82e7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:24.597111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-4ceedb3d-48d8-47d7-99df-05acdddf82e7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 21:53:24.597111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:24.597111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:53:24.597111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:53:24.597111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:53:24.597111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:53:24.597111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:53:24.597111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:24.597111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 21:53:24.597111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:24.597111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:53:24.597111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:24.597111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:24.597111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:24.597111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:24.597111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:24.597111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:24.599238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:24.599238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:24.599238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:24.599238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:24.599238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:24.599238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:24.599238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:53:24.599238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:53:24.599238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:53:24.599238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:53:24.599238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:24.599238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:24.599238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:24.599238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:24.599238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:24.599238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:24.600359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:24.600359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:24.600359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:24.600359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:24.600359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:24.600359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:24.600359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:24.600359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:24.600359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:24.600359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:24.600359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:53:24.600359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:24.600359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 21:53:24.600359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:24.600359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 462/915] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 21:53:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:24.605295 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613baab7-2856-4cc6-8824-2d2d7b8be97c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:24.717253 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613baab7-2856-4cc6-8824-2d2d7b8be97c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:24.758318 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec20bf-2ec7-4e9e-9188-19081bd2cab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:24.758994 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec20bf-2ec7-4e9e-9188-19081bd2cab3 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:24.759956 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec20bf-2ec7-4e9e-9188-19081bd2cab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:24.760357 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec20bf-2ec7-4e9e-9188-19081bd2cab3 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:24.761275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec20bf-2ec7-4e9e-9188-19081bd2cab3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:24.761587 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec20bf-2ec7-4e9e-9188-19081bd2cab3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:24.762980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec20bf-2ec7-4e9e-9188-19081bd2cab3 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:24.768708 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 454/916] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 21:53:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:24.771634 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34c1e1-3e41-4ecd-aa49-e376cba8d739 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:24.771920 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34c1e1-3e41-4ecd-aa49-e376cba8d739 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:24.772197 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34c1e1-3e41-4ecd-aa49-e376cba8d739 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:24.775894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec20bf-2ec7-4e9e-9188-19081bd2cab3 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:24.776022 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 463/917] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:24.781021 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211b3f5-a2cf-4933-bb5a-b545be9b0011 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:24.781309 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211b3f5-a2cf-4933-bb5a-b545be9b0011 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:24.781563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211b3f5-a2cf-4933-bb5a-b545be9b0011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:24.799349 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a211b3f5-a2cf-4933-bb5a-b545be9b0011 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:24.800744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a211b3f5-a2cf-4933-bb5a-b545be9b0011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:24.849189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:24.875324 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:24.882494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 464/918] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:53:24.904683 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211b3f5-a2cf-4933-bb5a-b545be9b0011 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:24.912820 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec20bf-2ec7-4e9e-9188-19081bd2cab3 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:24.961269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8044cb-c314-40fa-8dd3-9fcf81e3857d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:24.961948 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8044cb-c314-40fa-8dd3-9fcf81e3857d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:24.962261 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8044cb-c314-40fa-8dd3-9fcf81e3857d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:24.962612 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8044cb-c314-40fa-8dd3-9fcf81e3857d None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:24.963335 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8044cb-c314-40fa-8dd3-9fcf81e3857d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:24.963641 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8044cb-c314-40fa-8dd3-9fcf81e3857d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:24.965050 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8044cb-c314-40fa-8dd3-9fcf81e3857d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:24.970083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 455/919] 10.222.0.35 () {56 vars in 1114 bytes} [Thu May 19 21:53:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:24.971533 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f1f81-b728-4616-8d4d-f4fa97c28a70 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:24.971817 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f1f81-b728-4616-8d4d-f4fa97c28a70 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:24.972093 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f1f81-b728-4616-8d4d-f4fa97c28a70 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:24.973501 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 456/920] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:24.978304 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f1f81-b728-4616-8d4d-f4fa97c28a70 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:25.033974 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211b3f5-a2cf-4933-bb5a-b545be9b0011 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:25.074816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0ed91-8e19-4d4f-beb0-972788791f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:25.075861 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0ed91-8e19-4d4f-beb0-972788791f95 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:25.076301 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0ed91-8e19-4d4f-beb0-972788791f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:25.076762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0ed91-8e19-4d4f-beb0-972788791f95 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:25.077565 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0ed91-8e19-4d4f-beb0-972788791f95 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:25.079101 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0ed91-8e19-4d4f-beb0-972788791f95 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:25.089530 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f1f81-b728-4616-8d4d-f4fa97c28a70 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:25.101816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-2cc0ed91-8e19-4d4f-beb0-972788791f95 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:53:25.101816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:25.101816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:53:25.101816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:53:25.101816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:53:25.101816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:53:25.101816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:53:25.101816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:25.101816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:53:25.101816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:25.101816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:53:25.101816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:25.101816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:25.101816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:25.101816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:25.101816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:25.101816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:25.103115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:25.103115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:25.103115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:25.103115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:25.103115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:25.103115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:25.103115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:53:25.103115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:53:25.103115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:53:25.103115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:53:25.103115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:25.103115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:25.103115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:25.103115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:25.103115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:25.103115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:25.104168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:25.104168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:25.104168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:25.104168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:25.104168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:25.104168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:25.104168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:25.104168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:25.104168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:25.104168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:25.104168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:53:25.104168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:25.104168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:53:25.104168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:25.105389 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:25.107206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 465/921] 10.222.0.35 () {56 vars in 1126 bytes} [Thu May 19 21:53:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:53:25.108887 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae05441-4f4a-4160-84e1-21ab4d7e84df None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:25.109187 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae05441-4f4a-4160-84e1-21ab4d7e84df None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:25.109477 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae05441-4f4a-4160-84e1-21ab4d7e84df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:25.127657 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-7ae05441-4f4a-4160-84e1-21ab4d7e84df None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:25.128886 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7ae05441-4f4a-4160-84e1-21ab4d7e84df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:25.133280 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a37c25-2310-4ede-95c6-866c440ee70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:25.133927 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a37c25-2310-4ede-95c6-866c440ee70b None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:25.134259 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a37c25-2310-4ede-95c6-866c440ee70b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:25.134534 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a37c25-2310-4ede-95c6-866c440ee70b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:25.135276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a37c25-2310-4ede-95c6-866c440ee70b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:25.136673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a37c25-2310-4ede-95c6-866c440ee70b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:25.168615 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 457/922] 10.222.0.35 () {60 vars in 1144 bytes} [Thu May 19 21:53:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:53:25.169950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a37c25-2310-4ede-95c6-866c440ee70b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:25.217470 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:25.236707 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 466/923] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:53:25.268598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae05441-4f4a-4160-84e1-21ab4d7e84df None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:25.330700 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a37c25-2310-4ede-95c6-866c440ee70b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:25.386285 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b6799-3db8-4667-a1f8-2c8a457760f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:25.386966 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b6799-3db8-4667-a1f8-2c8a457760f2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:25.387612 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b6799-3db8-4667-a1f8-2c8a457760f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:25.387612 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b6799-3db8-4667-a1f8-2c8a457760f2 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:25.388231 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b6799-3db8-4667-a1f8-2c8a457760f2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:25.388591 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b6799-3db8-4667-a1f8-2c8a457760f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:25.390033 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b6799-3db8-4667-a1f8-2c8a457760f2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:25.395080 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 458/924] 10.222.0.35 () {56 vars in 1122 bytes} [Thu May 19 21:53:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:25.402227 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b6799-3db8-4667-a1f8-2c8a457760f2 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:25.427974 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae05441-4f4a-4160-84e1-21ab4d7e84df None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:25.449639 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:25.486248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad06025-c03c-4ac5-9387-927d6615a7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:25.486248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad06025-c03c-4ac5-9387-927d6615a7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:25.486248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad06025-c03c-4ac5-9387-927d6615a7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:25.486248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad06025-c03c-4ac5-9387-927d6615a7e5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:25.501269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad06025-c03c-4ac5-9387-927d6615a7e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:53:25.522304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-4ad06025-c03c-4ac5-9387-927d6615a7e5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 21:53:25.522304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:25.522304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:25.522304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:25.522304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:25.522304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:25.522304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:25.522304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:25.522304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:25.522304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:25.522304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:25.522304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:25.522304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:53:25.522304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:53:25.522304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:53:25.522304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:53:25.523511 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:53:25.523511 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:53:25.523511 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:53:25.523511 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:53:25.523511 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:25.523511 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:25.523511 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:25.523511 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:25.523511 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:25.523511 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:25.523511 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:25.523511 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:25.523511 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:25.523511 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:25.523511 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:25.523511 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:25.524325 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:25.524325 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:25.524325 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:25.524325 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:25.524325 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:53:25.524325 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:53:25.524325 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:53:25.524325 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:53:25.524325 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:53:25.524325 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:53:25.524325 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 21:53:25.524325 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:25.524325 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 467/925] 10.222.0.35 () {56 vars in 1120 bytes} [Thu May 19 21:53:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:53:25.533562 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad06025-c03c-4ac5-9387-927d6615a7e5 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:25.538482 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b6799-3db8-4667-a1f8-2c8a457760f2 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:25.577013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e0525-c02d-4cbc-bcba-a3a4aa05b223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:25.577719 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e0525-c02d-4cbc-bcba-a3a4aa05b223 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:25.578000 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e0525-c02d-4cbc-bcba-a3a4aa05b223 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:25.578274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e0525-c02d-4cbc-bcba-a3a4aa05b223 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:25.579092 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e0525-c02d-4cbc-bcba-a3a4aa05b223 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:25.579400 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e0525-c02d-4cbc-bcba-a3a4aa05b223 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:25.581060 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e0525-c02d-4cbc-bcba-a3a4aa05b223 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:25.587162 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 459/926] 10.222.0.35 () {56 vars in 1122 bytes} [Thu May 19 21:53:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:25.593508 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e0525-c02d-4cbc-bcba-a3a4aa05b223 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:25.600388 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:25.666573 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad06025-c03c-4ac5-9387-927d6615a7e5 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:25.706185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d7d1b-1680-45b4-a683-e188053fcf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:25.707150 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d7d1b-1680-45b4-a683-e188053fcf8a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:25.707703 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d7d1b-1680-45b4-a683-e188053fcf8a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:25.708126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d7d1b-1680-45b4-a683-e188053fcf8a None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:25.709167 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d7d1b-1680-45b4-a683-e188053fcf8a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:25.709737 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d7d1b-1680-45b4-a683-e188053fcf8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:25.711633 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d7d1b-1680-45b4-a683-e188053fcf8a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:25.727448 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 468/927] 10.222.0.35 () {56 vars in 1115 bytes} [Thu May 19 21:53:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:25.729463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d7d1b-1680-45b4-a683-e188053fcf8a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:25.731016 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:25.738366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e0525-c02d-4cbc-bcba-a3a4aa05b223 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:25.780607 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6599a9d-4401-449b-b212-0d6e4bf795cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:25.780973 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6599a9d-4401-449b-b212-0d6e4bf795cd None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:25.781146 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6599a9d-4401-449b-b212-0d6e4bf795cd None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:25.781427 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6599a9d-4401-449b-b212-0d6e4bf795cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:25.782237 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6599a9d-4401-449b-b212-0d6e4bf795cd None admin] RBAC: Adding query filter params (interface=public, service_id=2732e0000e404e618729896a73d1805c, region_id=RegionOne) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:25.782547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6599a9d-4401-449b-b212-0d6e4bf795cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:25.783916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6599a9d-4401-449b-b212-0d6e4bf795cd None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:25.789653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 460/928] 10.222.0.35 () {56 vars in 1251 bytes} [Thu May 19 21:53:25 2022] GET /identity/v3/endpoints?service_id=2732e0000e404e618729896a73d1805c&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:25.798362 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6599a9d-4401-449b-b212-0d6e4bf795cd None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:25.858484 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d7d1b-1680-45b4-a683-e188053fcf8a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:25.871749 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:25.895679 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa15fb-3532-4d2f-b4a5-9a70ba5b712e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:25.896218 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa15fb-3532-4d2f-b4a5-9a70ba5b712e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:25.896538 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa15fb-3532-4d2f-b4a5-9a70ba5b712e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:25.896810 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa15fb-3532-4d2f-b4a5-9a70ba5b712e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:25.908748 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa15fb-3532-4d2f-b4a5-9a70ba5b712e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:25.910109 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa15fb-3532-4d2f-b4a5-9a70ba5b712e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:25.914482 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6599a9d-4401-449b-b212-0d6e4bf795cd None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:25.927858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-f4aa15fb-3532-4d2f-b4a5-9a70ba5b712e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:25.927858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:25.927858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:25.927858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:25.927858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:25.927858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:25.927858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:25.927858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:25.927858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:25.927858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:25.927858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:25.927858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:25.927858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:53:25.927858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:53:25.927858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:53:25.929283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:53:25.929283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:25.929283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:25.929283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:25.929283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:25.929283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:25.929283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:25.929283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:25.929283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:25.929283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:25.929283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:25.929283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:25.929283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:25.929283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:25.929283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:25.929283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:25.929283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:25.930291 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:53:25.930291 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:53:25.930291 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:25.930291 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:25.930291 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 469/929] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:25.930600 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7e5af-049a-435a-b340-152004b73228 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:25.930898 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7e5af-049a-435a-b340-152004b73228 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:25.931587 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7e5af-049a-435a-b340-152004b73228 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:25.932626 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 470/930] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:25.937978 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212cce5-e6d0-45f4-ae69-a4ce6cd9fa7f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:25.938273 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212cce5-e6d0-45f4-ae69-a4ce6cd9fa7f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:25.938553 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212cce5-e6d0-45f4-ae69-a4ce6cd9fa7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:25.956352 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-2212cce5-e6d0-45f4-ae69-a4ce6cd9fa7f None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:25.957583 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2212cce5-e6d0-45f4-ae69-a4ce6cd9fa7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:25.961752 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cdafd5-5b90-41b8-9a20-395f3a5481b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:25.962808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdafd5-5b90-41b8-9a20-395f3a5481b0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:25.963288 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdafd5-5b90-41b8-9a20-395f3a5481b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:25.963744 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdafd5-5b90-41b8-9a20-395f3a5481b0 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:25.964647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cdafd5-5b90-41b8-9a20-395f3a5481b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:25.966795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cdafd5-5b90-41b8-9a20-395f3a5481b0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:25.975363 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 461/931] 10.222.0.35 () {56 vars in 1087 bytes} [Thu May 19 21:53:25 2022] GET /identity/v3/services => generated 1497 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:53:25.976517 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cdafd5-5b90-41b8-9a20-395f3a5481b0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:26.008602 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:26.068433 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 471/932] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:53:26.089629 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212cce5-e6d0-45f4-ae69-a4ce6cd9fa7f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:26.131559 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cdafd5-5b90-41b8-9a20-395f3a5481b0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:26.172325 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c479a-56c0-4d87-b317-cddd868e0a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:26.173298 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c479a-56c0-4d87-b317-cddd868e0a92 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:26.173725 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c479a-56c0-4d87-b317-cddd868e0a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:26.174167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c479a-56c0-4d87-b317-cddd868e0a92 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:26.175195 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c479a-56c0-4d87-b317-cddd868e0a92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:26.175647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c479a-56c0-4d87-b317-cddd868e0a92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:26.177340 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c479a-56c0-4d87-b317-cddd868e0a92 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:26.193622 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 462/933] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:26.199550 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c479a-56c0-4d87-b317-cddd868e0a92 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:26.224084 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:26.232245 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212cce5-e6d0-45f4-ae69-a4ce6cd9fa7f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:26.281913 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d510197-8610-46b9-9dcd-14a4d17f3699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:26.283235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d510197-8610-46b9-9dcd-14a4d17f3699 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:26.284017 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d510197-8610-46b9-9dcd-14a4d17f3699 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:26.284759 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d510197-8610-46b9-9dcd-14a4d17f3699 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:26.285838 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d510197-8610-46b9-9dcd-14a4d17f3699 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:26.288112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d510197-8610-46b9-9dcd-14a4d17f3699 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:26.305127 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-1d510197-8610-46b9-9dcd-14a4d17f3699 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 21:53:26.305127 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:26.305127 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:53:26.305127 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:53:26.305127 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:53:26.305127 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:53:26.305127 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:53:26.305127 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:26.305127 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 21:53:26.305127 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:26.305127 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:53:26.305127 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:26.305127 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:26.305127 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:26.305127 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:26.305127 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:26.307149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:26.307149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:26.307149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:26.307149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:26.307149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:26.307149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:26.307149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:26.307149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:53:26.307149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:53:26.307149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:53:26.307149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:53:26.307149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:26.307149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:26.307149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:26.307149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:26.307149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:26.307982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:26.307982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:26.307982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:26.307982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:26.307982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:26.307982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:26.307982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:26.307982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:26.307982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:26.307982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:26.307982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:26.307982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:53:26.307982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:26.307982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 21:53:26.307982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:26.307982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 472/934] 10.222.0.35 () {56 vars in 1132 bytes} [Thu May 19 21:53:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:53:26.313175 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d510197-8610-46b9-9dcd-14a4d17f3699 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:26.325797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:26.352982 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c479a-56c0-4d87-b317-cddd868e0a92 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:26.406345 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a2350-476b-456f-a18b-c3046645d6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:26.408006 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a2350-476b-456f-a18b-c3046645d6d5 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:26.408835 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a2350-476b-456f-a18b-c3046645d6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:26.409522 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a2350-476b-456f-a18b-c3046645d6d5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:26.424716 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a2350-476b-456f-a18b-c3046645d6d5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:26.426911 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a2350-476b-456f-a18b-c3046645d6d5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:26.446480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-256a2350-476b-456f-a18b-c3046645d6d5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 21:53:26.446480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:26.446480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:26.446480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:26.446480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:26.446480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:26.446480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:26.446480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:26.446480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:26.446480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:26.446480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:26.446480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:26.446480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:53:26.446480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:53:26.446480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:53:26.446480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:53:26.447635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:26.447635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:26.447635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:53:26.447635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:26.447635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:53:26.447635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:26.447635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:26.447635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:26.447635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:26.447635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:26.447635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:26.447635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:26.447635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:26.447635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:26.447635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:26.447635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:26.447635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:26.447635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:26.448674 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:26.448674 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:26.448674 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:53:26.448674 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:53:26.448674 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:53:26.448674 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:53:26.448674 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:53:26.448674 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:53:26.448674 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 21:53:26.448674 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:26.451609 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 463/935] 10.222.0.35 () {56 vars in 1117 bytes} [Thu May 19 21:53:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:26.451751 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d510197-8610-46b9-9dcd-14a4d17f3699 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:26.460058 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a2350-476b-456f-a18b-c3046645d6d5 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:26.510751 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b959d8d-baef-4392-822d-ddd21dfcc3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:26.511428 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b959d8d-baef-4392-822d-ddd21dfcc3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:26.511710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b959d8d-baef-4392-822d-ddd21dfcc3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:26.511986 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b959d8d-baef-4392-822d-ddd21dfcc3e9 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:26.512910 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b959d8d-baef-4392-822d-ddd21dfcc3e9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:26.513243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b959d8d-baef-4392-822d-ddd21dfcc3e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:26.514703 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b959d8d-baef-4392-822d-ddd21dfcc3e9 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:26.520642 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 473/936] 10.222.0.35 () {56 vars in 1126 bytes} [Thu May 19 21:53:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:26.526708 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b959d8d-baef-4392-822d-ddd21dfcc3e9 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:26.561568 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:26.589664 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a2350-476b-456f-a18b-c3046645d6d5 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:26.630767 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7977c-e947-420b-9b38-7adb2dfffc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:26.631816 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7977c-e947-420b-9b38-7adb2dfffc89 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:26.632358 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7977c-e947-420b-9b38-7adb2dfffc89 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:26.632856 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7977c-e947-420b-9b38-7adb2dfffc89 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:26.634030 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7977c-e947-420b-9b38-7adb2dfffc89 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:26.634613 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7977c-e947-420b-9b38-7adb2dfffc89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:26.636299 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7977c-e947-420b-9b38-7adb2dfffc89 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:26.648654 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b959d8d-baef-4392-822d-ddd21dfcc3e9 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:26.657077 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 464/937] 10.222.0.35 () {56 vars in 1149 bytes} [Thu May 19 21:53:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:26.668460 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7977c-e947-420b-9b38-7adb2dfffc89 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:26.669233 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:26.700441 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae785a7-e69d-4bf2-be5a-45289455d840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:26.701646 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae785a7-e69d-4bf2-be5a-45289455d840 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:26.702106 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae785a7-e69d-4bf2-be5a-45289455d840 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:26.702926 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae785a7-e69d-4bf2-be5a-45289455d840 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:26.705071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae785a7-e69d-4bf2-be5a-45289455d840 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:26.706394 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae785a7-e69d-4bf2-be5a-45289455d840 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:26.710179 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae785a7-e69d-4bf2-be5a-45289455d840 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:26.719684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 474/938] 10.222.0.35 () {56 vars in 1126 bytes} [Thu May 19 21:53:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:26.725925 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae785a7-e69d-4bf2-be5a-45289455d840 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:26.801723 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7977c-e947-420b-9b38-7adb2dfffc89 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:26.846385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554d243-f694-4105-ac60-ec141900b9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:26.847296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554d243-f694-4105-ac60-ec141900b9be None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:26.847645 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554d243-f694-4105-ac60-ec141900b9be None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:26.847988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554d243-f694-4105-ac60-ec141900b9be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:26.855015 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:26.860226 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554d243-f694-4105-ac60-ec141900b9be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:26.863441 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554d243-f694-4105-ac60-ec141900b9be None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:26.877998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae785a7-e69d-4bf2-be5a-45289455d840 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:26.891778 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-9554d243-f694-4105-ac60-ec141900b9be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:26.891778 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:26.891778 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:26.891778 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:26.891778 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:26.891778 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:26.891778 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:26.891778 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:26.891778 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:26.891778 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:26.891778 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:26.891778 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:26.891778 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:53:26.891778 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:53:26.891778 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:53:26.892768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:53:26.892768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:26.892768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:26.892768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:26.892768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:26.892768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:26.892768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:26.892768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:26.892768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:26.892768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:26.892768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:26.892768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:26.892768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:26.892768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:26.892768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:26.892768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:26.892768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:26.893634 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:53:26.893634 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:53:26.893634 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:26.893634 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:26.900533 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 465/939] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:26.901594 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554d243-f694-4105-ac60-ec141900b9be None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:26.927649 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81bfca-ba7b-45eb-a443-7ff8d5fef941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:26.928719 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81bfca-ba7b-45eb-a443-7ff8d5fef941 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:26.929240 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81bfca-ba7b-45eb-a443-7ff8d5fef941 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:26.929721 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81bfca-ba7b-45eb-a443-7ff8d5fef941 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:26.930673 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81bfca-ba7b-45eb-a443-7ff8d5fef941 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:26.932923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81bfca-ba7b-45eb-a443-7ff8d5fef941 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:26.955175 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 475/940] 10.222.0.35 () {60 vars in 1144 bytes} [Thu May 19 21:53:26 2022] POST /identity/v3/endpoints => generated 347 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:53:26.980097 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:27.038621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554d243-f694-4105-ac60-ec141900b9be None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:27.089304 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b210b15-de0e-4594-bdd5-ff62197f82f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:27.089984 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b210b15-de0e-4594-bdd5-ff62197f82f9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:27.090304 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b210b15-de0e-4594-bdd5-ff62197f82f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:27.090634 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b210b15-de0e-4594-bdd5-ff62197f82f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:27.091528 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b210b15-de0e-4594-bdd5-ff62197f82f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:27.091847 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b210b15-de0e-4594-bdd5-ff62197f82f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:27.093434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b210b15-de0e-4594-bdd5-ff62197f82f9 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:27.106983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 466/941] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:27.112773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81bfca-ba7b-45eb-a443-7ff8d5fef941 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:27.235369 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81bfca-ba7b-45eb-a443-7ff8d5fef941 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:27.273253 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756d17d-cdb7-408e-941c-959a5b01985b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:27.274335 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756d17d-cdb7-408e-941c-959a5b01985b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:27.275430 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756d17d-cdb7-408e-941c-959a5b01985b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:27.276185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756d17d-cdb7-408e-941c-959a5b01985b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:27.285939 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756d17d-cdb7-408e-941c-959a5b01985b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:27.287677 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756d17d-cdb7-408e-941c-959a5b01985b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:27.303685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-c756d17d-cdb7-408e-941c-959a5b01985b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:27.303685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:27.303685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:27.303685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:27.303685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:27.303685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:27.303685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:27.303685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:27.303685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:27.303685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:27.303685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:27.303685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:27.303685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:53:27.303685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:53:27.303685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:53:27.304872 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:53:27.304872 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:27.304872 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:27.304872 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:27.304872 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:27.304872 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:27.304872 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:27.304872 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:27.304872 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:27.304872 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:27.304872 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:27.304872 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:27.304872 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:27.304872 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:27.304872 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:27.304872 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:27.304872 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:27.306230 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:53:27.306230 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:53:27.306230 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:53:27.306230 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:53:27.306230 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:53:27.306230 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:53:27.306230 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:27.306230 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:27.308479 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 476/942] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:53:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:27.314365 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b210b15-de0e-4594-bdd5-ff62197f82f9 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:27.429378 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b210b15-de0e-4594-bdd5-ff62197f82f9 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:27.447991 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:27.469377 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca774c-900e-478d-b2f3-5e3988b965a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:27.470049 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca774c-900e-478d-b2f3-5e3988b965a2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:27.470329 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca774c-900e-478d-b2f3-5e3988b965a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:27.470600 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca774c-900e-478d-b2f3-5e3988b965a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:27.471394 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca774c-900e-478d-b2f3-5e3988b965a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:27.471699 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca774c-900e-478d-b2f3-5e3988b965a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:27.473151 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca774c-900e-478d-b2f3-5e3988b965a2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:27.487933 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 467/943] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:53:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:27.494931 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756d17d-cdb7-408e-941c-959a5b01985b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:27.498718 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:27.613559 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756d17d-cdb7-408e-941c-959a5b01985b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:27.620355 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ee1d7-4f22-4f9c-b9de-1a40a427b133 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:27.620710 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ee1d7-4f22-4f9c-b9de-1a40a427b133 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:27.620998 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ee1d7-4f22-4f9c-b9de-1a40a427b133 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:27.622793 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 468/944] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:53:27.628126 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0eda6-6182-4d6b-bf19-cf9056739f04 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:27.628431 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0eda6-6182-4d6b-bf19-cf9056739f04 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:27.628736 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0eda6-6182-4d6b-bf19-cf9056739f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:27.650668 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a7c0eda6-6182-4d6b-bf19-cf9056739f04 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:27.651392 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eab4e7-2aa6-40cb-a140-74f7a2f7f953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:27.652189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a7c0eda6-6182-4d6b-bf19-cf9056739f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:27.652301 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eab4e7-2aa6-40cb-a140-74f7a2f7f953 None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:27.652611 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eab4e7-2aa6-40cb-a140-74f7a2f7f953 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:27.652880 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eab4e7-2aa6-40cb-a140-74f7a2f7f953 None admin] PATH_INFO: `/v3/projects/89b20e18525c473e94a2b263148f1f5f/users/6d4c4b75552b4c739079f328a6efba40/roles/349b194bc80845e4a14c05f7cffcfe54` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:27.655546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eab4e7-2aa6-40cb-a140-74f7a2f7f953 None admin] RBAC: Authorizing `identity:create_grant(project_id=89b20e18525c473e94a2b263148f1f5f, user_id=6d4c4b75552b4c739079f328a6efba40, role_id=349b194bc80845e4a14c05f7cffcfe54)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:27.657256 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eab4e7-2aa6-40cb-a140-74f7a2f7f953 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:27.677392 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 477/945] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 21:53:27 2022] PUT /identity/v3/projects/89b20e18525c473e94a2b263148f1f5f/users/6d4c4b75552b4c739079f328a6efba40/roles/349b194bc80845e4a14c05f7cffcfe54 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:53:27.755451 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 469/946] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:53:27.781389 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eab4e7-2aa6-40cb-a140-74f7a2f7f953 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:27.872655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:27.921665 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eab4e7-2aa6-40cb-a140-74f7a2f7f953 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:27.959664 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abd432-7e37-4d4b-b2b3-4f1332f6fd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:27.960348 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abd432-7e37-4d4b-b2b3-4f1332f6fd5a None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:27.960668 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abd432-7e37-4d4b-b2b3-4f1332f6fd5a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:27.960941 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abd432-7e37-4d4b-b2b3-4f1332f6fd5a None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:27.961651 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6abd432-7e37-4d4b-b2b3-4f1332f6fd5a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:27.963148 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6abd432-7e37-4d4b-b2b3-4f1332f6fd5a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:27.964552 dv-cinder-842237-1-smb devstack@keystone.service[80209]: WARNING keystone.server.flask.common [None req-c6abd432-7e37-4d4b-b2b3-4f1332f6fd5a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 19 21:53:27.983973 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.sql.core [None req-c6abd432-7e37-4d4b-b2b3-4f1332f6fd5a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 21:53:27.983973 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 21:53:27.983973 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [parameters: {'id': '9188c78076e2436fa7ba4ae71dad2cf9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 21:53:27.983973 dv-cinder-842237-1-smb devstack@keystone.service[80209]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80209) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 21:53:28.002062 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-c6abd432-7e37-4d4b-b2b3-4f1332f6fd5a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9188c78076e2436fa7ba4ae71dad2cf9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9188c78076e2436fa7ba4ae71dad2cf9. May 19 21:53:28.002062 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:28.002062 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 21:53:28.002062 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 21:53:28.002062 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 21:53:28.002062 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 21:53:28.002062 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 21:53:28.002062 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application result = self._query(query) May 19 21:53:28.002062 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 21:53:28.002062 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application conn.query(q) May 19 21:53:28.002062 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 21:53:28.002062 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 21:53:28.002062 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 21:53:28.002943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application result.read() May 19 21:53:28.002943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 21:53:28.002943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 21:53:28.002943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 21:53:28.002943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 21:53:28.002943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 21:53:28.002943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 21:53:28.002943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 21:53:28.002943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 21:53:28.002943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 21:53:28.002943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:28.002943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 21:53:28.002943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:28.002943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:28.002943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 21:53:28.002943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 21:53:28.002943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 19 21:53:28.002943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return project_ref.to_dict() May 19 21:53:28.003864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 21:53:28.003864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application next(self.gen) May 19 21:53:28.003864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 21:53:28.003864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application yield resource May 19 21:53:28.003864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 21:53:28.003864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application next(self.gen) May 19 21:53:28.003864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 21:53:28.003864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.session.rollback() May 19 21:53:28.003864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 21:53:28.003864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.force_reraise() May 19 21:53:28.003864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 21:53:28.003864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise self.value May 19 21:53:28.003864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 21:53:28.003864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 21:53:28.003864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 21:53:28.003864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application session.commit() May 19 21:53:28.003864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 21:53:28.004775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 21:53:28.004775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 21:53:28.004775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._prepare_impl() May 19 21:53:28.004775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 21:53:28.004775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.session.flush() May 19 21:53:28.004775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 21:53:28.004775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._flush(objects) May 19 21:53:28.004775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 21:53:28.004775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 21:53:28.004775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 21:53:28.004775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application compat.raise_( May 19 21:53:28.004775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 21:53:28.004775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception May 19 21:53:28.004775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 21:53:28.004775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application flush_context.execute() May 19 21:53:28.004775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 21:53:28.004775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rec.execute(self) May 19 21:53:28.005785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 21:53:28.005785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 21:53:28.005785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 21:53:28.005785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 21:53:28.005785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 21:53:28.005785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 21:53:28.005785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 21:53:28.005785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 21:53:28.005785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 21:53:28.005785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 21:53:28.005785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 21:53:28.005785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 21:53:28.005785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 21:53:28.005785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 21:53:28.005785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 21:53:28.006581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 21:53:28.006581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 21:53:28.006581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception May 19 21:53:28.006581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 21:53:28.006581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 21:53:28.006581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 21:53:28.006581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 21:53:28.006581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 21:53:28.006581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application result = self._query(query) May 19 21:53:28.006581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 21:53:28.006581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application conn.query(q) May 19 21:53:28.006581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 21:53:28.006581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 21:53:28.006581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 21:53:28.006581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application result.read() May 19 21:53:28.006581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 21:53:28.006581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 21:53:28.007424 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 21:53:28.007424 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 21:53:28.007424 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 21:53:28.007424 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 21:53:28.007424 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 21:53:28.007424 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 21:53:28.007424 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 21:53:28.007424 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 21:53:28.007424 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [parameters: {'id': '9188c78076e2436fa7ba4ae71dad2cf9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 21:53:28.007424 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 21:53:28.007424 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:28.007424 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:53:28.007424 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:28.007424 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:28.007424 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 19 21:53:28.008201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 19 21:53:28.008201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 21:53:28.008201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 21:53:28.008201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 19 21:53:28.008201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:28.008201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:53:28.008201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:28.008201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:28.008201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:28.008201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:28.008201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:28.008201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:28.008201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:28.008201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:28.008201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:28.008201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:28.008201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:28.013412 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:28.013412 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 19 21:53:28.013412 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 19 21:53:28.013412 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:28.013412 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:28.013412 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 19 21:53:28.013412 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.Conflict( May 19 21:53:28.013412 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9188c78076e2436fa7ba4ae71dad2cf9. May 19 21:53:28.013412 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:28.013412 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 478/947] 10.222.0.35 () {60 vars in 1140 bytes} [Thu May 19 21:53:27 2022] POST /identity/v3/projects => generated 262 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:28.020496 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0eda6-6182-4d6b-bf19-cf9056739f04 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:28.128458 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:28.132012 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0eda6-6182-4d6b-bf19-cf9056739f04 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:28.170564 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc1f92-5df6-478d-b13e-aad871959072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:28.171721 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc1f92-5df6-478d-b13e-aad871959072 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:28.172221 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc1f92-5df6-478d-b13e-aad871959072 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:28.172735 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc1f92-5df6-478d-b13e-aad871959072 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:28.180186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc1f92-5df6-478d-b13e-aad871959072 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:28.182560 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc1f92-5df6-478d-b13e-aad871959072 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:28.197366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-56dc1f92-5df6-478d-b13e-aad871959072 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:28.197366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:28.197366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:28.197366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:28.197366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:28.197366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:28.197366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:28.197366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:28.197366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:28.197366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:28.197366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:28.197366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:28.197366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:53:28.197366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:53:28.197366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:53:28.198313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:53:28.198313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:28.198313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:28.198313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:28.198313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:28.198313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:28.198313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:28.198313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:28.198313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:28.198313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:28.198313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:28.198313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:28.198313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:28.198313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:28.198313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:28.198313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:28.198313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:28.199190 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:53:28.199190 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:53:28.199190 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:53:28.199190 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:53:28.199190 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:53:28.199190 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:53:28.199190 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:28.199190 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:28.201723 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 470/948] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:53:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:28.207826 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abd432-7e37-4d4b-b2b3-4f1332f6fd5a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:28.328346 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abd432-7e37-4d4b-b2b3-4f1332f6fd5a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:28.353436 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:28.375129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02966094-6aaa-4347-9b18-3ae50e58e346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:28.376012 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02966094-6aaa-4347-9b18-3ae50e58e346 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:28.376619 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02966094-6aaa-4347-9b18-3ae50e58e346 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:28.376898 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02966094-6aaa-4347-9b18-3ae50e58e346 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:28.377672 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02966094-6aaa-4347-9b18-3ae50e58e346 None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:28.377976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02966094-6aaa-4347-9b18-3ae50e58e346 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:28.379643 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02966094-6aaa-4347-9b18-3ae50e58e346 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:28.402404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 479/949] 10.222.0.35 () {56 vars in 1112 bytes} [Thu May 19 21:53:28 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:28.529711 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2625382-6789-47a8-aa75-cada7e1e613b None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:28.530252 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2625382-6789-47a8-aa75-cada7e1e613b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:28.530476 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2625382-6789-47a8-aa75-cada7e1e613b None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:28.532538 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 471/950] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:28.538764 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b7428-dde0-4462-ad52-f9b0b6b04edb None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:28.539299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b7428-dde0-4462-ad52-f9b0b6b04edb None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:28.539299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b7428-dde0-4462-ad52-f9b0b6b04edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:28.559792 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-117b7428-dde0-4462-ad52-f9b0b6b04edb None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:28.561432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-117b7428-dde0-4462-ad52-f9b0b6b04edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:28.644593 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 480/951] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:53:28.661577 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2625382-6789-47a8-aa75-cada7e1e613b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:28.782505 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2625382-6789-47a8-aa75-cada7e1e613b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:28.819402 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc3286-1a5d-40b3-bdec-6a35892ac1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:28.820599 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc3286-1a5d-40b3-bdec-6a35892ac1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:28.821081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc3286-1a5d-40b3-bdec-6a35892ac1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:28.821733 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc3286-1a5d-40b3-bdec-6a35892ac1a0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:28.823094 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc3286-1a5d-40b3-bdec-6a35892ac1a0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:28.824691 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc3286-1a5d-40b3-bdec-6a35892ac1a0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:28.837905 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-74bc3286-1a5d-40b3-bdec-6a35892ac1a0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:53:28.837905 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:28.837905 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:53:28.837905 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:53:28.837905 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:53:28.837905 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:53:28.837905 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:53:28.837905 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:28.837905 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:53:28.837905 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:28.837905 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:53:28.837905 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:28.837905 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:28.837905 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:28.837905 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:28.837905 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:28.837905 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:28.838985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:28.838985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:28.838985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:28.838985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:28.838985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:28.838985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:28.838985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:53:28.838985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:53:28.838985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:53:28.838985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:53:28.838985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:28.838985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:28.838985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:28.838985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:28.838985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:28.838985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:28.839815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:28.839815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:28.839815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:28.839815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:28.839815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:28.839815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:28.839815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:28.839815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:28.839815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:28.839815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:28.839815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:53:28.839815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:28.839815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:53:28.839815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:28.842873 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 472/952] 10.222.0.35 () {56 vars in 1126 bytes} [Thu May 19 21:53:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:28.849195 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b7428-dde0-4462-ad52-f9b0b6b04edb None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:28.969215 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b7428-dde0-4462-ad52-f9b0b6b04edb None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:28.980500 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:29.009555 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb9f12-e42b-4799-a27e-2561b83cc2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:29.010603 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb9f12-e42b-4799-a27e-2561b83cc2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:29.011129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb9f12-e42b-4799-a27e-2561b83cc2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:29.011612 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb9f12-e42b-4799-a27e-2561b83cc2b7 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:29.012572 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb9f12-e42b-4799-a27e-2561b83cc2b7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:29.013072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb9f12-e42b-4799-a27e-2561b83cc2b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:29.014694 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb9f12-e42b-4799-a27e-2561b83cc2b7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:29.020577 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 481/953] 10.222.0.35 () {56 vars in 1122 bytes} [Thu May 19 21:53:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:29.029553 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc3286-1a5d-40b3-bdec-6a35892ac1a0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:29.059725 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:29.144110 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc3286-1a5d-40b3-bdec-6a35892ac1a0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:29.183217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7bc5b-60e2-4698-8544-4a2b9b6c1b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:29.184589 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7bc5b-60e2-4698-8544-4a2b9b6c1b55 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:29.185078 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7bc5b-60e2-4698-8544-4a2b9b6c1b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:29.185550 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7bc5b-60e2-4698-8544-4a2b9b6c1b55 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:29.186523 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7bc5b-60e2-4698-8544-4a2b9b6c1b55 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:29.187046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7bc5b-60e2-4698-8544-4a2b9b6c1b55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:29.188704 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7bc5b-60e2-4698-8544-4a2b9b6c1b55 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:29.195193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 473/954] 10.222.0.35 () {56 vars in 1122 bytes} [Thu May 19 21:53:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:29.201691 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb9f12-e42b-4799-a27e-2561b83cc2b7 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:29.305707 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb9f12-e42b-4799-a27e-2561b83cc2b7 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:29.343066 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa02ca9-5aa4-4ec6-b18d-a05a03314c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:29.344065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa02ca9-5aa4-4ec6-b18d-a05a03314c96 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:29.344580 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa02ca9-5aa4-4ec6-b18d-a05a03314c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:29.345197 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa02ca9-5aa4-4ec6-b18d-a05a03314c96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:29.346132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa02ca9-5aa4-4ec6-b18d-a05a03314c96 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:29.347692 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa02ca9-5aa4-4ec6-b18d-a05a03314c96 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:29.379612 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 482/955] 10.222.0.35 () {60 vars in 1144 bytes} [Thu May 19 21:53:29 2022] POST /identity/v3/endpoints => generated 349 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:53:29.388196 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a1c26-4c56-4099-a63f-af56d476a779 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:29.388923 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a1c26-4c56-4099-a63f-af56d476a779 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:29.389412 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a1c26-4c56-4099-a63f-af56d476a779 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:29.391400 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 474/956] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:29.397529 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b23228-fccf-44d1-aade-ef549c16b8b9 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:29.397931 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b23228-fccf-44d1-aade-ef549c16b8b9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:29.398215 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b23228-fccf-44d1-aade-ef549c16b8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:29.420677 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-29b23228-fccf-44d1-aade-ef549c16b8b9 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:29.422002 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-29b23228-fccf-44d1-aade-ef549c16b8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:29.456808 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:29.513776 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 483/957] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:53:29.536569 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a1c26-4c56-4099-a63f-af56d476a779 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:29.638085 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:29.652077 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a1c26-4c56-4099-a63f-af56d476a779 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:29.691448 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff4e9d-e728-4430-89fb-3d1622cfacef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:29.692533 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff4e9d-e728-4430-89fb-3d1622cfacef None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:29.693020 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff4e9d-e728-4430-89fb-3d1622cfacef None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:29.693473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff4e9d-e728-4430-89fb-3d1622cfacef None admin] PATH_INFO: `/v3/services/compute` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:29.694354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff4e9d-e728-4430-89fb-3d1622cfacef None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:29.695879 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff4e9d-e728-4430-89fb-3d1622cfacef None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:29.709369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-bbff4e9d-e728-4430-89fb-3d1622cfacef None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 21:53:29.709369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:29.709369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:53:29.709369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:53:29.709369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:53:29.709369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:53:29.709369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:53:29.709369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:29.709369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 21:53:29.709369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:29.709369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:53:29.709369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:29.709369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:29.709369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:29.709369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:29.709369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:29.709369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:29.710611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:29.710611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:29.710611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:29.710611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:29.710611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:29.710611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:29.710611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:53:29.710611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:53:29.710611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:53:29.710611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:53:29.710611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:29.710611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:29.710611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:29.710611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:29.710611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:29.710611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:29.711621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:29.711621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:29.711621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:29.711621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:29.711621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:29.711621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:29.711621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:29.711621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:29.711621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:29.711621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:29.711621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:53:29.711621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:29.711621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 21:53:29.711621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:29.714226 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 475/958] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:53:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:29.724213 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b23228-fccf-44d1-aade-ef549c16b8b9 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:29.837969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b23228-fccf-44d1-aade-ef549c16b8b9 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:29.874880 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50352e08-3e6e-445f-b681-e47fb74c1307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:29.875589 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50352e08-3e6e-445f-b681-e47fb74c1307 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:29.875869 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50352e08-3e6e-445f-b681-e47fb74c1307 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:29.876147 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50352e08-3e6e-445f-b681-e47fb74c1307 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:29.876950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50352e08-3e6e-445f-b681-e47fb74c1307 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:29.877260 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50352e08-3e6e-445f-b681-e47fb74c1307 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:29.878675 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50352e08-3e6e-445f-b681-e47fb74c1307 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:29.885056 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 484/959] 10.222.0.35 () {56 vars in 1112 bytes} [Thu May 19 21:53:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:29.890786 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff4e9d-e728-4430-89fb-3d1622cfacef None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:30.006740 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff4e9d-e728-4430-89fb-3d1622cfacef None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:30.045196 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8aef7-ff15-4c68-bbef-634889bd949d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:30.046229 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8aef7-ff15-4c68-bbef-634889bd949d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:30.046714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8aef7-ff15-4c68-bbef-634889bd949d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:30.047215 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8aef7-ff15-4c68-bbef-634889bd949d None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:30.048150 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8aef7-ff15-4c68-bbef-634889bd949d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:30.048696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8aef7-ff15-4c68-bbef-634889bd949d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:30.050275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8aef7-ff15-4c68-bbef-634889bd949d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:30.055769 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 476/960] 10.222.0.35 () {56 vars in 1112 bytes} [Thu May 19 21:53:29 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:30.152572 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dec1f6-dc91-439c-91d2-a0a11ff68d2b None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:30.152766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dec1f6-dc91-439c-91d2-a0a11ff68d2b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:30.153049 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dec1f6-dc91-439c-91d2-a0a11ff68d2b None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:30.154767 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 485/961] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:30.160630 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd147d-0957-4c48-8015-3ec2b9d2b53f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:30.160921 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd147d-0957-4c48-8015-3ec2b9d2b53f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:30.161200 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd147d-0957-4c48-8015-3ec2b9d2b53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:30.184115 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3dbd147d-0957-4c48-8015-3ec2b9d2b53f None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:30.185728 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3dbd147d-0957-4c48-8015-3ec2b9d2b53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:30.200522 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:30.272291 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 477/962] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:53:30.296428 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dec1f6-dc91-439c-91d2-a0a11ff68d2b None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:30.317990 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:30.412171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dec1f6-dc91-439c-91d2-a0a11ff68d2b None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:30.448943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69edbb-f3f4-42c9-b26f-22524d5afe40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:30.449787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69edbb-f3f4-42c9-b26f-22524d5afe40 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:30.450071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69edbb-f3f4-42c9-b26f-22524d5afe40 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:30.450349 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69edbb-f3f4-42c9-b26f-22524d5afe40 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:30.464307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69edbb-f3f4-42c9-b26f-22524d5afe40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:53:30.472673 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-3f69edbb-f3f4-42c9-b26f-22524d5afe40 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 21:53:30.472673 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:30.472673 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:30.472673 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:30.472673 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:30.472673 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:30.472673 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:30.472673 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:30.472673 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:30.472673 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:30.472673 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:30.472673 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:30.472673 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:53:30.472673 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:53:30.472673 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:53:30.472673 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:53:30.473592 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:53:30.473592 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:53:30.473592 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:53:30.473592 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:53:30.473592 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:30.473592 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:30.473592 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:30.473592 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:30.473592 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:30.473592 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:30.473592 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:30.473592 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:30.473592 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:30.473592 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:30.473592 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:30.473592 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:30.474930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:30.474930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:30.474930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:30.474930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:30.474930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:53:30.474930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:53:30.474930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:53:30.474930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:53:30.474930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:53:30.474930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:53:30.474930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 21:53:30.474930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:30.474930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 486/963] 10.222.0.35 () {56 vars in 1120 bytes} [Thu May 19 21:53:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:30.480940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd147d-0957-4c48-8015-3ec2b9d2b53f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:30.592334 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd147d-0957-4c48-8015-3ec2b9d2b53f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:30.634749 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce2d74-7f0b-45b0-ae5f-886f38a796b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:30.635586 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce2d74-7f0b-45b0-ae5f-886f38a796b0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:30.635874 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce2d74-7f0b-45b0-ae5f-886f38a796b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:30.636151 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce2d74-7f0b-45b0-ae5f-886f38a796b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:30.636951 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce2d74-7f0b-45b0-ae5f-886f38a796b0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:30.637262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce2d74-7f0b-45b0-ae5f-886f38a796b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:30.638682 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce2d74-7f0b-45b0-ae5f-886f38a796b0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:30.649003 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 478/964] 10.222.0.35 () {56 vars in 1115 bytes} [Thu May 19 21:53:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:30.655346 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69edbb-f3f4-42c9-b26f-22524d5afe40 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:30.742420 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:30.769989 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69edbb-f3f4-42c9-b26f-22524d5afe40 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:30.810977 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9cbe0b-f234-4e0a-81a8-4b650dd17fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:30.811795 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9cbe0b-f234-4e0a-81a8-4b650dd17fcc None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:30.812086 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9cbe0b-f234-4e0a-81a8-4b650dd17fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:30.812372 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9cbe0b-f234-4e0a-81a8-4b650dd17fcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:30.825797 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9cbe0b-f234-4e0a-81a8-4b650dd17fcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:30.827335 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9cbe0b-f234-4e0a-81a8-4b650dd17fcc None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:30.845689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-cd9cbe0b-f234-4e0a-81a8-4b650dd17fcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:30.845689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:30.845689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:30.845689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:30.845689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:30.845689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:30.845689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:30.845689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:30.845689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:30.845689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:30.845689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:30.845689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:30.845689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:53:30.845689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:53:30.845689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:53:30.846598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:53:30.846598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:30.846598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:30.846598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:30.846598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:30.846598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:30.846598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:30.846598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:30.846598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:30.846598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:30.846598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:30.846598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:30.846598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:30.846598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:30.846598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:30.846598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:30.846598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:30.847883 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:53:30.847883 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:53:30.847883 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:30.847883 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:30.847883 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 487/965] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:30.852749 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce2d74-7f0b-45b0-ae5f-886f38a796b0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:30.865907 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:30.965328 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa712673-596c-45a2-bbde-129246ab18f9 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:30.965667 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa712673-596c-45a2-bbde-129246ab18f9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:30.965881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa712673-596c-45a2-bbde-129246ab18f9 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:30.966627 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce2d74-7f0b-45b0-ae5f-886f38a796b0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:30.967522 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 488/966] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:53:30.973281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae62b2-cd43-4de7-9c16-58d14863719d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:30.973634 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae62b2-cd43-4de7-9c16-58d14863719d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:30.973860 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae62b2-cd43-4de7-9c16-58d14863719d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:30.992541 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-f3ae62b2-cd43-4de7-9c16-58d14863719d None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:30.994381 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f3ae62b2-cd43-4de7-9c16-58d14863719d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:31.014416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2f356-80bd-4310-9085-7d81fce806cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:31.015099 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2f356-80bd-4310-9085-7d81fce806cc None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:31.015384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2f356-80bd-4310-9085-7d81fce806cc None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:31.015664 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2f356-80bd-4310-9085-7d81fce806cc None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:31.016889 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2f356-80bd-4310-9085-7d81fce806cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:31.017204 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2f356-80bd-4310-9085-7d81fce806cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:31.018874 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2f356-80bd-4310-9085-7d81fce806cc None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:31.037549 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 479/967] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:31.043636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2f356-80bd-4310-9085-7d81fce806cc None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:31.069140 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 489/968] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:53:31.094846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae62b2-cd43-4de7-9c16-58d14863719d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:31.116755 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:31.155048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2f356-80bd-4310-9085-7d81fce806cc None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:31.160793 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:31.193447 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c87638-6f21-47c0-9b02-8c9e85b3e71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:31.194273 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c87638-6f21-47c0-9b02-8c9e85b3e71f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:31.194558 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c87638-6f21-47c0-9b02-8c9e85b3e71f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:31.194839 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c87638-6f21-47c0-9b02-8c9e85b3e71f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:31.202763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae62b2-cd43-4de7-9c16-58d14863719d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:31.203376 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c87638-6f21-47c0-9b02-8c9e85b3e71f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:31.205018 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c87638-6f21-47c0-9b02-8c9e85b3e71f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:31.221132 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-d5c87638-6f21-47c0-9b02-8c9e85b3e71f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 21:53:31.221132 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:31.221132 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:31.221132 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:31.221132 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:31.221132 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:31.221132 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:31.221132 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:31.221132 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:31.221132 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:31.221132 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:31.221132 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:31.221132 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:53:31.221132 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:53:31.221132 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:53:31.221132 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:53:31.222296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:31.222296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:31.222296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:53:31.222296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:31.222296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:53:31.222296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:31.222296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:31.222296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:31.222296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:31.222296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:31.222296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:31.222296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:31.222296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:31.222296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:31.222296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:31.222296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:31.222296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:31.222296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:31.223365 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:31.223365 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:31.223365 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:53:31.223365 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:53:31.223365 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:53:31.223365 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:53:31.223365 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:53:31.223365 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:53:31.223365 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 21:53:31.223365 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:31.228684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 480/969] 10.222.0.35 () {56 vars in 1117 bytes} [Thu May 19 21:53:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:31.230645 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c87638-6f21-47c0-9b02-8c9e85b3e71f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:31.247860 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64595d9-b0c6-4494-95eb-666e1106f72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:31.249052 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64595d9-b0c6-4494-95eb-666e1106f72f None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:31.249487 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64595d9-b0c6-4494-95eb-666e1106f72f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:31.250032 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64595d9-b0c6-4494-95eb-666e1106f72f None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:31.250745 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64595d9-b0c6-4494-95eb-666e1106f72f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:31.252670 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64595d9-b0c6-4494-95eb-666e1106f72f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:31.271728 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.sql.core [None req-f64595d9-b0c6-4494-95eb-666e1106f72f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 21:53:31.271728 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 21:53:31.271728 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [parameters: {'user_id': '378d10e4bf3049b9be8c3d1d04a408f7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 21:53:31.271728 dv-cinder-842237-1-smb devstack@keystone.service[80209]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80209) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 21:53:31.281684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-f64595d9-b0c6-4494-95eb-666e1106f72f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 21:53:31.281684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:31.281684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 21:53:31.281684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 21:53:31.281684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 21:53:31.281684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 21:53:31.281684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 21:53:31.281684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application result = self._query(query) May 19 21:53:31.281684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 21:53:31.281684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application conn.query(q) May 19 21:53:31.281684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 21:53:31.281684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 21:53:31.281684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 21:53:31.281684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application result.read() May 19 21:53:31.281684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 21:53:31.282614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 21:53:31.282614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 21:53:31.282614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 21:53:31.282614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 21:53:31.282614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 21:53:31.282614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 21:53:31.282614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 21:53:31.282614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 21:53:31.282614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:31.282614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 21:53:31.282614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:31.282614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:31.282614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 21:53:31.282614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 21:53:31.282614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 19 21:53:31.282614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 19 21:53:31.282614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 21:53:31.282614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application next(self.gen) May 19 21:53:31.283524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 21:53:31.283524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application yield resource May 19 21:53:31.283524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 21:53:31.283524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application next(self.gen) May 19 21:53:31.283524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 21:53:31.283524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.session.rollback() May 19 21:53:31.283524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 21:53:31.283524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.force_reraise() May 19 21:53:31.283524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 21:53:31.283524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise self.value May 19 21:53:31.283524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 21:53:31.283524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 21:53:31.283524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 21:53:31.283524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application session.commit() May 19 21:53:31.283524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 21:53:31.283524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 21:53:31.283524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 21:53:31.284497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._prepare_impl() May 19 21:53:31.284497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 21:53:31.284497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.session.flush() May 19 21:53:31.284497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 21:53:31.284497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._flush(objects) May 19 21:53:31.284497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 21:53:31.284497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 21:53:31.284497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 21:53:31.284497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application compat.raise_( May 19 21:53:31.284497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 21:53:31.284497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception May 19 21:53:31.284497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 21:53:31.284497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application flush_context.execute() May 19 21:53:31.284497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 21:53:31.284497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rec.execute(self) May 19 21:53:31.284497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 21:53:31.284497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 21:53:31.285375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 21:53:31.285375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 21:53:31.285375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 19 21:53:31.285375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application result = connection._execute_20( May 19 21:53:31.285375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 21:53:31.285375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 21:53:31.285375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 21:53:31.285375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 21:53:31.285375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 21:53:31.285375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 21:53:31.285375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 21:53:31.285375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 21:53:31.285375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 21:53:31.285375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 21:53:31.285375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 21:53:31.285375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception May 19 21:53:31.286185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 21:53:31.286185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 21:53:31.286185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 21:53:31.286185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 21:53:31.286185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 21:53:31.286185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application result = self._query(query) May 19 21:53:31.286185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 21:53:31.286185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application conn.query(q) May 19 21:53:31.286185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 21:53:31.286185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 21:53:31.286185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 21:53:31.286185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application result.read() May 19 21:53:31.286185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 21:53:31.286185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 21:53:31.286185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 21:53:31.286185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 21:53:31.286987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 21:53:31.286987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 21:53:31.286987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 21:53:31.286987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 21:53:31.286987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 21:53:31.286987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 21:53:31.286987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [parameters: {'user_id': '378d10e4bf3049b9be8c3d1d04a408f7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 21:53:31.286987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 21:53:31.286987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:31.286987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:53:31.286987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:31.286987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:31.286987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:31.286987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:31.286987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:31.287755 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:31.287755 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:31.287755 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:31.287755 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:31.287755 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:31.287755 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:31.287755 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:31.287755 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 19 21:53:31.287755 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 19 21:53:31.287755 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:31.287755 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:31.287755 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:53:31.287755 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:31.287755 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:53:31.287755 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:31.287755 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 19 21:53:31.287755 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 19 21:53:31.295186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 19 21:53:31.295186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 19 21:53:31.295186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 21:53:31.295186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 21:53:31.295186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 21:53:31.295186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:31.295186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 490/970] 10.222.0.35 () {60 vars in 1131 bytes} [Thu May 19 21:53:31 2022] POST /identity/v3/users => generated 160 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 19 21:53:31.295186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64595d9-b0c6-4494-95eb-666e1106f72f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:31.378774 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c87638-6f21-47c0-9b02-8c9e85b3e71f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:31.430239 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:31.449236 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b31ea-f0ba-4d66-8bd2-1617e928edbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:31.450623 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b31ea-f0ba-4d66-8bd2-1617e928edbb None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:31.451545 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b31ea-f0ba-4d66-8bd2-1617e928edbb None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:31.452267 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b31ea-f0ba-4d66-8bd2-1617e928edbb None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:31.453417 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b31ea-f0ba-4d66-8bd2-1617e928edbb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:31.453959 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b31ea-f0ba-4d66-8bd2-1617e928edbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:31.454066 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64595d9-b0c6-4494-95eb-666e1106f72f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:31.456067 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b31ea-f0ba-4d66-8bd2-1617e928edbb None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:31.481186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 481/971] 10.222.0.35 () {56 vars in 1149 bytes} [Thu May 19 21:53:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:31.483211 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:31.486239 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b31ea-f0ba-4d66-8bd2-1617e928edbb None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:31.503508 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028b5d4-ec55-4c7c-9324-bf981458a1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:31.504439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028b5d4-ec55-4c7c-9324-bf981458a1ea None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:31.504796 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028b5d4-ec55-4c7c-9324-bf981458a1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:31.505177 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028b5d4-ec55-4c7c-9324-bf981458a1ea None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:31.513817 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028b5d4-ec55-4c7c-9324-bf981458a1ea None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:31.515643 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028b5d4-ec55-4c7c-9324-bf981458a1ea None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:31.531070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-f028b5d4-ec55-4c7c-9324-bf981458a1ea None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 21:53:31.531070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:31.531070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:31.531070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:31.531070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:31.531070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:31.531070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:31.531070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:31.531070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:31.531070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:31.531070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:31.531070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:31.531070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:53:31.531070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:53:31.531070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:53:31.531070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:53:31.532095 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:31.532095 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:31.532095 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:53:31.532095 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:31.532095 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:53:31.532095 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:31.532095 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:31.532095 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:31.532095 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:31.532095 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:31.532095 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:31.532095 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:31.532095 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:31.532095 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:31.532095 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:31.532095 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:31.532095 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:31.532095 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:31.533189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:31.533189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:31.533189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:53:31.533189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:53:31.533189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:53:31.533189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:53:31.533189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:53:31.533189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:53:31.533189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 21:53:31.533189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:31.533189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 491/972] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:53:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:31.538142 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028b5d4-ec55-4c7c-9324-bf981458a1ea None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:31.624579 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b31ea-f0ba-4d66-8bd2-1617e928edbb None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:31.665888 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028b5d4-ec55-4c7c-9324-bf981458a1ea None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:31.676036 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e9829-7f8b-4860-acc1-4cb4dfcc99d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:31.677016 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e9829-7f8b-4860-acc1-4cb4dfcc99d7 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:31.677477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e9829-7f8b-4860-acc1-4cb4dfcc99d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:31.677903 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e9829-7f8b-4860-acc1-4cb4dfcc99d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:31.711060 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d196d0-b927-4165-9482-8d08e02f64ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:31.711941 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d196d0-b927-4165-9482-8d08e02f64ce None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:31.712442 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d196d0-b927-4165-9482-8d08e02f64ce None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:31.712844 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d196d0-b927-4165-9482-8d08e02f64ce None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:31.713772 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d196d0-b927-4165-9482-8d08e02f64ce None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:31.714184 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d196d0-b927-4165-9482-8d08e02f64ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:31.715754 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d196d0-b927-4165-9482-8d08e02f64ce None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:31.761660 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 492/973] 10.222.0.35 () {56 vars in 1101 bytes} [Thu May 19 21:53:31 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:31.772541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:31.785473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e9829-7f8b-4860-acc1-4cb4dfcc99d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:31.787218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e9829-7f8b-4860-acc1-4cb4dfcc99d7 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:31.844203 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9435df6-6f4c-4874-84e7-d51f0247f7cd None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:31.844539 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9435df6-6f4c-4874-84e7-d51f0247f7cd None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:31.844822 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9435df6-6f4c-4874-84e7-d51f0247f7cd None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:31.850544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 493/974] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:31.852643 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ec717-9b43-4051-a087-9d9a46ceed53 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:31.852979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ec717-9b43-4051-a087-9d9a46ceed53 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:31.853259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ec717-9b43-4051-a087-9d9a46ceed53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:31.875077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-619ec717-9b43-4051-a087-9d9a46ceed53 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:31.877126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-619ec717-9b43-4051-a087-9d9a46ceed53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:31.921401 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:31.926137 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 482/975] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:53:31 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:53:31.931830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e9829-7f8b-4860-acc1-4cb4dfcc99d7 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:31.972480 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 494/976] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:53:31.997147 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ec717-9b43-4051-a087-9d9a46ceed53 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:32.053556 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:32.080032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e9829-7f8b-4860-acc1-4cb4dfcc99d7 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:32.129640 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc83a5-58ec-4253-a8c7-5920c228d995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:32.130817 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc83a5-58ec-4253-a8c7-5920c228d995 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:32.131308 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc83a5-58ec-4253-a8c7-5920c228d995 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:32.131819 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc83a5-58ec-4253-a8c7-5920c228d995 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:32.132109 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ec717-9b43-4051-a087-9d9a46ceed53 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:32.144268 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc83a5-58ec-4253-a8c7-5920c228d995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:32.145819 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc83a5-58ec-4253-a8c7-5920c228d995 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:32.169208 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba3455-4f9c-49f8-b205-b05dd8846fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:32.169947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-bddc83a5-58ec-4253-a8c7-5920c228d995 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:32.169947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:32.169947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:32.169947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:32.169947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:32.169947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:32.169947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:32.169947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:32.169947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:32.169947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:32.169947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:32.169947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:32.169947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:53:32.169947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:53:32.169947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:53:32.170765 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:53:32.170765 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:32.170765 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:32.170765 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:32.170765 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:32.170765 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:32.170765 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:32.170765 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:32.170765 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:32.170765 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:32.170765 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:32.170765 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:32.170765 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:32.170765 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:32.170765 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:32.170765 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:32.170765 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:32.171952 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:53:32.171952 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:53:32.171952 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:32.171952 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:32.172167 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba3455-4f9c-49f8-b205-b05dd8846fae None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:32.172167 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba3455-4f9c-49f8-b205-b05dd8846fae None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:32.172167 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba3455-4f9c-49f8-b205-b05dd8846fae None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:32.172167 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba3455-4f9c-49f8-b205-b05dd8846fae None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:32.172583 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 483/977] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:53:32.176861 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc83a5-58ec-4253-a8c7-5920c228d995 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:32.177495 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba3455-4f9c-49f8-b205-b05dd8846fae None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:32.190523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-84ba3455-4f9c-49f8-b205-b05dd8846fae None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:53:32.190523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:32.190523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:53:32.190523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:53:32.190523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:53:32.190523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:53:32.190523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:53:32.190523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:32.190523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:53:32.190523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:32.190523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:53:32.190523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:32.190523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:32.190523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:32.190523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:32.190523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:32.190523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:32.191726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:32.191726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:32.191726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:32.191726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:32.191726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:32.191726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:32.191726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:53:32.191726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:53:32.191726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:53:32.191726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:53:32.191726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:32.191726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:32.191726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:32.191726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:32.191726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:32.191726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:32.193399 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:32.193399 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:32.193399 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:32.193399 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:32.193399 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:32.193399 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:32.193399 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:32.193399 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:32.193399 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:32.193399 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:32.193399 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:53:32.193399 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:32.193399 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:53:32.193399 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:32.193399 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 495/978] 10.222.0.35 () {56 vars in 1126 bytes} [Thu May 19 21:53:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:32.198409 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba3455-4f9c-49f8-b205-b05dd8846fae None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:32.240085 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:32.305695 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc83a5-58ec-4253-a8c7-5920c228d995 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:32.327877 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba3455-4f9c-49f8-b205-b05dd8846fae None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:32.351528 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fbe85-f5c9-448d-a51b-9c7fe3979760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:32.352203 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fbe85-f5c9-448d-a51b-9c7fe3979760 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:32.352516 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fbe85-f5c9-448d-a51b-9c7fe3979760 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:32.352830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fbe85-f5c9-448d-a51b-9c7fe3979760 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:32.353547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fbe85-f5c9-448d-a51b-9c7fe3979760 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:32.353848 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fbe85-f5c9-448d-a51b-9c7fe3979760 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:32.355234 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fbe85-f5c9-448d-a51b-9c7fe3979760 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:32.362838 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:32.370809 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 484/979] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:32.373719 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14303e1f-e7f4-42ea-a14e-3129ff3c3033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:32.374407 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14303e1f-e7f4-42ea-a14e-3129ff3c3033 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:32.374691 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14303e1f-e7f4-42ea-a14e-3129ff3c3033 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:32.374967 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14303e1f-e7f4-42ea-a14e-3129ff3c3033 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:32.375799 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14303e1f-e7f4-42ea-a14e-3129ff3c3033 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:32.376110 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14303e1f-e7f4-42ea-a14e-3129ff3c3033 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:32.376603 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fbe85-f5c9-448d-a51b-9c7fe3979760 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:32.377578 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14303e1f-e7f4-42ea-a14e-3129ff3c3033 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:32.383676 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 496/980] 10.222.0.35 () {56 vars in 1122 bytes} [Thu May 19 21:53:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:32.389839 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14303e1f-e7f4-42ea-a14e-3129ff3c3033 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:32.496645 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:32.499666 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fbe85-f5c9-448d-a51b-9c7fe3979760 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:32.500624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14303e1f-e7f4-42ea-a14e-3129ff3c3033 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:32.535562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47db370-eab9-4000-81b0-08dece6769c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:32.535885 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a5ae0-5b39-41f3-9d83-64b3b7b24a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:32.536452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47db370-eab9-4000-81b0-08dece6769c5 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:32.536653 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a5ae0-5b39-41f3-9d83-64b3b7b24a22 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:32.536755 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47db370-eab9-4000-81b0-08dece6769c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:32.536932 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a5ae0-5b39-41f3-9d83-64b3b7b24a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:32.537026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47db370-eab9-4000-81b0-08dece6769c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:32.537186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a5ae0-5b39-41f3-9d83-64b3b7b24a22 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:32.537881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a5ae0-5b39-41f3-9d83-64b3b7b24a22 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:32.538192 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a5ae0-5b39-41f3-9d83-64b3b7b24a22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:32.539579 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a5ae0-5b39-41f3-9d83-64b3b7b24a22 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:32.545181 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47db370-eab9-4000-81b0-08dece6769c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:32.545354 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 497/981] 10.222.0.35 () {56 vars in 1122 bytes} [Thu May 19 21:53:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:32.546248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a15a9-44d5-4c22-81a5-9f3ab475eb2f None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:32.546348 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47db370-eab9-4000-81b0-08dece6769c5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:32.546545 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a15a9-44d5-4c22-81a5-9f3ab475eb2f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:32.546822 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a15a9-44d5-4c22-81a5-9f3ab475eb2f None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:32.548217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 498/982] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:32.553384 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b614e5-ec24-43cf-b26a-2c3b8449ae4d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:32.553672 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b614e5-ec24-43cf-b26a-2c3b8449ae4d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:32.553950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b614e5-ec24-43cf-b26a-2c3b8449ae4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:32.562107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-e47db370-eab9-4000-81b0-08dece6769c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:32.562107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:32.562107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:32.562107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:32.562107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:32.562107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:32.562107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:32.562107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:32.562107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:32.562107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:32.562107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:32.562107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:32.562107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:53:32.562107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:53:32.562107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:53:32.563125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:53:32.563125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:32.563125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:32.563125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:32.563125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:32.563125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:32.563125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:32.563125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:32.563125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:32.563125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:32.563125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:32.563125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:32.563125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:32.563125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:32.563125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:32.563125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:32.563125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:32.568884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:53:32.568884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:53:32.568884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:53:32.568884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:53:32.568884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:53:32.568884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:53:32.568884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:32.568884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:32.568884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 485/983] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:53:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:53:32.568884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47db370-eab9-4000-81b0-08dece6769c5 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:32.575997 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-08b614e5-ec24-43cf-b26a-2c3b8449ae4d None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:32.577244 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-08b614e5-ec24-43cf-b26a-2c3b8449ae4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:32.633714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:32.649322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 499/984] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:53:32.650716 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b614e5-ec24-43cf-b26a-2c3b8449ae4d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:32.685773 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47db370-eab9-4000-81b0-08dece6769c5 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:32.722774 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af816df-6eb8-4c9d-8244-8f20bea57cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:32.723451 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af816df-6eb8-4c9d-8244-8f20bea57cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:32.723735 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af816df-6eb8-4c9d-8244-8f20bea57cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:32.724013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af816df-6eb8-4c9d-8244-8f20bea57cd9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:32.724855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af816df-6eb8-4c9d-8244-8f20bea57cd9 None admin] RBAC: Adding query filter params (interface=admin, service_id=2732e0000e404e618729896a73d1805c, region_id=RegionOne) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:32.725170 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af816df-6eb8-4c9d-8244-8f20bea57cd9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:32.726547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af816df-6eb8-4c9d-8244-8f20bea57cd9 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:32.731765 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 486/985] 10.222.0.35 () {56 vars in 1249 bytes} [Thu May 19 21:53:32 2022] GET /identity/v3/endpoints?service_id=2732e0000e404e618729896a73d1805c&interface=admin®ion_id=RegionOne => generated 193 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:32.732569 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af816df-6eb8-4c9d-8244-8f20bea57cd9 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:32.750711 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:32.760606 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b614e5-ec24-43cf-b26a-2c3b8449ae4d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:32.798863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e27a8-00cc-49e3-a5ef-7daa8bb8e403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:32.799564 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e27a8-00cc-49e3-a5ef-7daa8bb8e403 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:32.799809 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e27a8-00cc-49e3-a5ef-7daa8bb8e403 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:32.800081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e27a8-00cc-49e3-a5ef-7daa8bb8e403 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:32.800918 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e27a8-00cc-49e3-a5ef-7daa8bb8e403 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:32.801231 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e27a8-00cc-49e3-a5ef-7daa8bb8e403 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:32.802691 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e27a8-00cc-49e3-a5ef-7daa8bb8e403 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:32.815019 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 500/986] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:53:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:32.815759 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e27a8-00cc-49e3-a5ef-7daa8bb8e403 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:32.838276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af816df-6eb8-4c9d-8244-8f20bea57cd9 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:32.865147 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:32.879482 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72eb15f-a2ff-43e4-8a4c-8e52fcd41889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:32.880157 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72eb15f-a2ff-43e4-8a4c-8e52fcd41889 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:32.880477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72eb15f-a2ff-43e4-8a4c-8e52fcd41889 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:32.880852 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72eb15f-a2ff-43e4-8a4c-8e52fcd41889 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:32.881472 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72eb15f-a2ff-43e4-8a4c-8e52fcd41889 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:32.882845 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72eb15f-a2ff-43e4-8a4c-8e52fcd41889 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:32.896793 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 487/987] 10.222.0.35 () {60 vars in 1141 bytes} [Thu May 19 21:53:32 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:53:32.897486 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72eb15f-a2ff-43e4-8a4c-8e52fcd41889 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:32.952599 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e27a8-00cc-49e3-a5ef-7daa8bb8e403 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:33.000741 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e0e3f-6a8d-4676-8ff8-89bbd17733c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:33.001488 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e0e3f-6a8d-4676-8ff8-89bbd17733c4 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:33.001779 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e0e3f-6a8d-4676-8ff8-89bbd17733c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:33.002054 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e0e3f-6a8d-4676-8ff8-89bbd17733c4 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:33.002779 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e0e3f-6a8d-4676-8ff8-89bbd17733c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:33.004254 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e0e3f-6a8d-4676-8ff8-89bbd17733c4 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:33.011678 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 501/988] 10.222.0.35 () {56 vars in 1087 bytes} [Thu May 19 21:53:32 2022] GET /identity/v3/services => generated 1727 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:53:33.043438 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72eb15f-a2ff-43e4-8a4c-8e52fcd41889 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:33.085191 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfda38b-618d-4802-aea1-43f76507a213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:33.085766 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfda38b-618d-4802-aea1-43f76507a213 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:33.086053 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfda38b-618d-4802-aea1-43f76507a213 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:33.086333 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfda38b-618d-4802-aea1-43f76507a213 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:33.087791 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfda38b-618d-4802-aea1-43f76507a213 None admin] RBAC: Adding query filter params (role.id=349b194bc80845e4a14c05f7cffcfe54, scope.project.id=89b20e18525c473e94a2b263148f1f5f, user.id=6d4c4b75552b4c739079f328a6efba40) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:33.088124 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfda38b-618d-4802-aea1-43f76507a213 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:33.089645 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfda38b-618d-4802-aea1-43f76507a213 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:33.096950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 488/989] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:53:32 2022] GET /identity/v3/role_assignments?user.id=6d4c4b75552b4c739079f328a6efba40&scope.project.id=89b20e18525c473e94a2b263148f1f5f&role.id=349b194bc80845e4a14c05f7cffcfe54 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:35.206730 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125d75d-8a5f-4d26-9b98-ef6824bf65cb None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:35.207270 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125d75d-8a5f-4d26-9b98-ef6824bf65cb None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:35.207270 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125d75d-8a5f-4d26-9b98-ef6824bf65cb None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:35.208818 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 502/990] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:35.214622 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a54884-82c0-40c1-9339-585d770c969a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:35.215057 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a54884-82c0-40c1-9339-585d770c969a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:35.215198 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a54884-82c0-40c1-9339-585d770c969a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:35.234733 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-00a54884-82c0-40c1-9339-585d770c969a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:35.236150 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-00a54884-82c0-40c1-9339-585d770c969a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:35.296634 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260df0b7-375a-4f62-9e09-ce80ad6163f6 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:35.296961 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260df0b7-375a-4f62-9e09-ce80ad6163f6 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:35.297185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260df0b7-375a-4f62-9e09-ce80ad6163f6 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:35.297701 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:35.298866 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 503/991] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:35.304759 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a47ab-c09e-4d8b-afde-53f7b6efc3bb None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:35.305045 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a47ab-c09e-4d8b-afde-53f7b6efc3bb None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:35.305323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a47ab-c09e-4d8b-afde-53f7b6efc3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:35.323038 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-2b9a47ab-c09e-4d8b-afde-53f7b6efc3bb None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:35.325025 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2b9a47ab-c09e-4d8b-afde-53f7b6efc3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:35.328175 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 489/992] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:53:35.344003 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:35.359371 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a54884-82c0-40c1-9339-585d770c969a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:35.409958 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 504/993] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:53:35.430018 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977822e-91ee-42ae-8f13-4615f8d5ab7d None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:35.430313 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977822e-91ee-42ae-8f13-4615f8d5ab7d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:35.430581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977822e-91ee-42ae-8f13-4615f8d5ab7d None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:35.433147 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 505/994] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:53:35.433935 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977822e-91ee-42ae-8f13-4615f8d5ab7d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:35.480093 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a54884-82c0-40c1-9339-585d770c969a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:35.516097 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0cf45-e71d-49f5-b496-9378eba2d417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:35.516931 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0cf45-e71d-49f5-b496-9378eba2d417 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:35.517206 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0cf45-e71d-49f5-b496-9378eba2d417 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:35.517479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0cf45-e71d-49f5-b496-9378eba2d417 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:35.518130 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0cf45-e71d-49f5-b496-9378eba2d417 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:35.519495 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0cf45-e71d-49f5-b496-9378eba2d417 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:35.531607 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-bfd0cf45-e71d-49f5-b496-9378eba2d417 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 21:53:35.531607 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:35.531607 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:53:35.531607 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:53:35.531607 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:53:35.531607 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:53:35.531607 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:53:35.531607 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:35.531607 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 21:53:35.531607 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:35.531607 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:53:35.531607 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:35.531607 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:35.531607 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:35.531607 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:35.531607 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:35.531607 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:35.532665 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:35.532665 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:35.532665 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:35.532665 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:35.532665 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:35.532665 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:35.532665 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:53:35.532665 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:53:35.532665 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:53:35.532665 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:53:35.532665 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:35.532665 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:35.532665 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:35.532665 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:35.532665 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:35.532665 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:35.539017 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:35.539017 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:35.539017 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:35.539017 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:35.539017 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:35.539017 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:35.539017 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:35.539017 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:35.539017 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:35.539017 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:35.539017 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:53:35.539017 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:35.539017 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 21:53:35.539017 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:35.539017 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 490/995] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:53:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:53:35.539846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2365a87-be03-4fbd-b30b-aa2fe75a90cc None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:35.539846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2365a87-be03-4fbd-b30b-aa2fe75a90cc None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:35.539846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2365a87-be03-4fbd-b30b-aa2fe75a90cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:35.541988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977822e-91ee-42ae-8f13-4615f8d5ab7d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:35.551599 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-f2365a87-be03-4fbd-b30b-aa2fe75a90cc None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:35.552772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f2365a87-be03-4fbd-b30b-aa2fe75a90cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:35.579595 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045416e0-cd6f-4ea6-9c03-2b95e574a4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:35.580440 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045416e0-cd6f-4ea6-9c03-2b95e574a4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:35.580721 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045416e0-cd6f-4ea6-9c03-2b95e574a4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:35.581006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045416e0-cd6f-4ea6-9c03-2b95e574a4f6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:35.581662 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045416e0-cd6f-4ea6-9c03-2b95e574a4f6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:35.583041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045416e0-cd6f-4ea6-9c03-2b95e574a4f6 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:35.589513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:35.596300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-045416e0-cd6f-4ea6-9c03-2b95e574a4f6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:53:35.596300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:35.596300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:53:35.596300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:53:35.596300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:53:35.596300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:53:35.596300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:53:35.596300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:35.596300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:53:35.596300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:35.596300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:53:35.596300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:35.596300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:35.596300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:35.596300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:35.596300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:35.596300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:35.597601 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:35.597601 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:35.597601 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:35.597601 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:35.597601 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:35.597601 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:35.597601 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:53:35.597601 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:53:35.597601 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:53:35.597601 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:53:35.597601 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:35.597601 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:35.597601 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:35.597601 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:35.597601 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:35.597601 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:35.598414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:35.598414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:35.598414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:35.598414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:35.598414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:35.598414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:35.598414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:35.598414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:35.598414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:35.598414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:35.598414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:53:35.598414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:35.598414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 21:53:35.598414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:35.598414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 506/996] 10.222.0.35 () {56 vars in 1126 bytes} [Thu May 19 21:53:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:53:35.599217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045416e0-cd6f-4ea6-9c03-2b95e574a4f6 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:35.612802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:35.627428 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 491/997] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:53:35.628490 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2365a87-be03-4fbd-b30b-aa2fe75a90cc None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:35.712996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045416e0-cd6f-4ea6-9c03-2b95e574a4f6 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:35.735591 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2365a87-be03-4fbd-b30b-aa2fe75a90cc None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:35.749015 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2f079-157d-4a00-adb5-62464bb22193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:35.749688 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2f079-157d-4a00-adb5-62464bb22193 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:35.749973 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2f079-157d-4a00-adb5-62464bb22193 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:35.750270 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2f079-157d-4a00-adb5-62464bb22193 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:35.750973 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f2f079-157d-4a00-adb5-62464bb22193 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:35.751281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f2f079-157d-4a00-adb5-62464bb22193 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:35.752694 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f2f079-157d-4a00-adb5-62464bb22193 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:35.757637 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 507/998] 10.222.0.35 () {56 vars in 1112 bytes} [Thu May 19 21:53:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:35.758488 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2f079-157d-4a00-adb5-62464bb22193 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:35.772005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3c554-2b7f-4eb1-8705-8d9c25126f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:35.772717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3c554-2b7f-4eb1-8705-8d9c25126f28 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:35.772995 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3c554-2b7f-4eb1-8705-8d9c25126f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:35.773266 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3c554-2b7f-4eb1-8705-8d9c25126f28 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:35.773984 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3c554-2b7f-4eb1-8705-8d9c25126f28 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:35.774293 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3c554-2b7f-4eb1-8705-8d9c25126f28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:35.775698 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3c554-2b7f-4eb1-8705-8d9c25126f28 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:35.780532 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 492/999] 10.222.0.35 () {56 vars in 1122 bytes} [Thu May 19 21:53:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:35.781299 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3c554-2b7f-4eb1-8705-8d9c25126f28 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:35.820422 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:35.831918 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:35.864694 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2f079-157d-4a00-adb5-62464bb22193 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:35.888899 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3c554-2b7f-4eb1-8705-8d9c25126f28 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:35.899802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a8f06-b02d-41ee-af8a-a7a6c43194b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:35.900739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a8f06-b02d-41ee-af8a-a7a6c43194b2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:35.901023 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a8f06-b02d-41ee-af8a-a7a6c43194b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:35.901297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a8f06-b02d-41ee-af8a-a7a6c43194b2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:35.901943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a8f06-b02d-41ee-af8a-a7a6c43194b2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:35.903314 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a8f06-b02d-41ee-af8a-a7a6c43194b2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:35.915893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-b33a8f06-b02d-41ee-af8a-a7a6c43194b2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 21:53:35.915893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:35.915893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:53:35.915893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:53:35.915893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:53:35.915893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:53:35.915893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:53:35.915893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:35.915893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 21:53:35.915893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:35.915893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:53:35.915893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:35.915893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:35.915893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:35.915893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:35.915893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:35.915893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:35.917170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:35.917170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:35.917170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:35.917170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:35.917170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:35.917170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:35.917170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:53:35.917170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:53:35.917170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:53:35.917170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:53:35.917170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:35.917170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:35.917170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:35.917170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:35.917170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:35.917170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:35.918213 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:35.918213 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:35.918213 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:35.918213 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:35.918213 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:35.918213 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:35.918213 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:35.918213 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:35.918213 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:35.918213 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:35.918213 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:53:35.918213 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:35.918213 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 21:53:35.918213 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:35.918213 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 508/1000] 10.222.0.35 () {56 vars in 1105 bytes} [Thu May 19 21:53:35 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:35.919183 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a8f06-b02d-41ee-af8a-a7a6c43194b2 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:35.930400 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c39d0-4fcb-4f40-8a15-57f1966a3502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:35.931668 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c39d0-4fcb-4f40-8a15-57f1966a3502 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:35.932137 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c39d0-4fcb-4f40-8a15-57f1966a3502 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:35.932624 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c39d0-4fcb-4f40-8a15-57f1966a3502 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:35.933352 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c39d0-4fcb-4f40-8a15-57f1966a3502 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:35.933662 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c39d0-4fcb-4f40-8a15-57f1966a3502 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:35.935041 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c39d0-4fcb-4f40-8a15-57f1966a3502 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:35.940055 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 493/1001] 10.222.0.35 () {56 vars in 1112 bytes} [Thu May 19 21:53:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:35.940860 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c39d0-4fcb-4f40-8a15-57f1966a3502 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:36.027762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a8f06-b02d-41ee-af8a-a7a6c43194b2 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:36.052655 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:36.057842 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c39d0-4fcb-4f40-8a15-57f1966a3502 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:36.064397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f6f52-1884-4b76-a457-a71b8f29a7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:36.065090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f6f52-1884-4b76-a457-a71b8f29a7ad None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:36.065788 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f6f52-1884-4b76-a457-a71b8f29a7ad None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:36.066075 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f6f52-1884-4b76-a457-a71b8f29a7ad None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:36.066793 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f6f52-1884-4b76-a457-a71b8f29a7ad None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:36.067098 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f6f52-1884-4b76-a457-a71b8f29a7ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:36.069003 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f6f52-1884-4b76-a457-a71b8f29a7ad None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:36.070508 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:36.076397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 509/1002] 10.222.0.35 () {56 vars in 1122 bytes} [Thu May 19 21:53:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:36.077584 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f6f52-1884-4b76-a457-a71b8f29a7ad None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:36.095306 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460357b-9a9b-4785-8d17-c867a9839c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:36.096662 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460357b-9a9b-4785-8d17-c867a9839c3b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:36.096662 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460357b-9a9b-4785-8d17-c867a9839c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:36.096662 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460357b-9a9b-4785-8d17-c867a9839c3b None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:36.097229 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460357b-9a9b-4785-8d17-c867a9839c3b None admin] RBAC: Adding query filter params (name=image) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:36.097531 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460357b-9a9b-4785-8d17-c867a9839c3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:36.098901 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460357b-9a9b-4785-8d17-c867a9839c3b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:36.104033 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 494/1003] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:36.104663 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460357b-9a9b-4785-8d17-c867a9839c3b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:36.191529 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f6f52-1884-4b76-a457-a71b8f29a7ad None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:36.209074 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460357b-9a9b-4785-8d17-c867a9839c3b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:36.228502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc864f1c-caa4-4c86-a3c6-088e1d570091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:36.229201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc864f1c-caa4-4c86-a3c6-088e1d570091 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:36.229490 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc864f1c-caa4-4c86-a3c6-088e1d570091 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:36.229773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc864f1c-caa4-4c86-a3c6-088e1d570091 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:36.230593 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc864f1c-caa4-4c86-a3c6-088e1d570091 None admin] RBAC: Adding query filter params (interface=public, service_id=d3e48ea78fc6474ba446812434f8757a, region_id=RegionOne) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:36.230912 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc864f1c-caa4-4c86-a3c6-088e1d570091 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:36.232349 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc864f1c-caa4-4c86-a3c6-088e1d570091 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:36.238114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 510/1004] 10.222.0.35 () {56 vars in 1251 bytes} [Thu May 19 21:53:36 2022] GET /identity/v3/endpoints?service_id=d3e48ea78fc6474ba446812434f8757a&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:36.238904 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc864f1c-caa4-4c86-a3c6-088e1d570091 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:36.260221 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602abdcf-75bd-474a-a19a-cda962b2b572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:36.261292 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602abdcf-75bd-474a-a19a-cda962b2b572 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:36.261504 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602abdcf-75bd-474a-a19a-cda962b2b572 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:36.261786 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602abdcf-75bd-474a-a19a-cda962b2b572 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:36.262540 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602abdcf-75bd-474a-a19a-cda962b2b572 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:36.264389 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602abdcf-75bd-474a-a19a-cda962b2b572 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:36.282453 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 495/1005] 10.222.0.35 () {60 vars in 1144 bytes} [Thu May 19 21:53:36 2022] POST /identity/v3/endpoints => generated 325 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:53:36.283029 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602abdcf-75bd-474a-a19a-cda962b2b572 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:36.319258 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:36.324655 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:36.386166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc864f1c-caa4-4c86-a3c6-088e1d570091 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:36.449034 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b0977-b60c-4260-a6cb-2fd0387bbc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:36.449721 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b0977-b60c-4260-a6cb-2fd0387bbc48 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:36.450064 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b0977-b60c-4260-a6cb-2fd0387bbc48 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:36.450291 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b0977-b60c-4260-a6cb-2fd0387bbc48 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:36.451013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b0977-b60c-4260-a6cb-2fd0387bbc48 None admin] RBAC: Adding query filter params (type=image) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:36.451322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b0977-b60c-4260-a6cb-2fd0387bbc48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:36.452756 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b0977-b60c-4260-a6cb-2fd0387bbc48 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:36.456232 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602abdcf-75bd-474a-a19a-cda962b2b572 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:36.457922 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 511/1006] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:36 2022] GET /identity/v3/services?type=image => generated 122 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:36.513537 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898a4c9-0ad7-4ea9-851d-cd1a0af09375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:36.514223 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898a4c9-0ad7-4ea9-851d-cd1a0af09375 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:36.514500 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898a4c9-0ad7-4ea9-851d-cd1a0af09375 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:36.514781 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898a4c9-0ad7-4ea9-851d-cd1a0af09375 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:36.515492 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898a4c9-0ad7-4ea9-851d-cd1a0af09375 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:36.516939 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898a4c9-0ad7-4ea9-851d-cd1a0af09375 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:36.524098 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 496/1007] 10.222.0.35 () {56 vars in 1087 bytes} [Thu May 19 21:53:36 2022] GET /identity/v3/services => generated 1727 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:53:38.593747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c918187-c486-490b-a8e8-10c827fe8521 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:38.594316 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c918187-c486-490b-a8e8-10c827fe8521 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:38.594316 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c918187-c486-490b-a8e8-10c827fe8521 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:38.595841 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 512/1008] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:38.600932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d41842-47bf-4769-9873-2a3162ac2901 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:38.601414 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d41842-47bf-4769-9873-2a3162ac2901 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:38.601501 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d41842-47bf-4769-9873-2a3162ac2901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:38.619639 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b2d41842-47bf-4769-9873-2a3162ac2901 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:38.620857 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b2d41842-47bf-4769-9873-2a3162ac2901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:38.700437 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 497/1009] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:38 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:53:38.723643 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c918187-c486-490b-a8e8-10c827fe8521 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:38.758530 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facdce2-60ad-4c57-a8e5-041381be0122 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:38.758886 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facdce2-60ad-4c57-a8e5-041381be0122 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:38.759664 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facdce2-60ad-4c57-a8e5-041381be0122 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:38.761252 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 498/1010] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:53:38.766045 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082d9cf-5e73-4b48-82ee-84b00eb28ead None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:38.766334 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082d9cf-5e73-4b48-82ee-84b00eb28ead None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:38.766617 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082d9cf-5e73-4b48-82ee-84b00eb28ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:38.784391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-e082d9cf-5e73-4b48-82ee-84b00eb28ead None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:38.785650 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e082d9cf-5e73-4b48-82ee-84b00eb28ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:38.793961 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:38.843977 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c918187-c486-490b-a8e8-10c827fe8521 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:38.860235 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 499/1011] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:38 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:53:38.861434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991eef5c-0478-4936-a7f5-a004441028a7 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:38.861723 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991eef5c-0478-4936-a7f5-a004441028a7 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:38.861999 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991eef5c-0478-4936-a7f5-a004441028a7 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:38.863389 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 500/1012] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:38.868290 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:38.869275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a833a14-578e-4033-a995-6e78eadd6906 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:38.869609 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a833a14-578e-4033-a995-6e78eadd6906 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:38.870118 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a833a14-578e-4033-a995-6e78eadd6906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:38.882426 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168171f6-38a6-48e2-a892-8224ec9cb6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:38.883247 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168171f6-38a6-48e2-a892-8224ec9cb6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:38.883531 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168171f6-38a6-48e2-a892-8224ec9cb6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:38.883809 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168171f6-38a6-48e2-a892-8224ec9cb6e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:38.886050 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168171f6-38a6-48e2-a892-8224ec9cb6e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:38.887531 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168171f6-38a6-48e2-a892-8224ec9cb6e9 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:38.889391 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 513/1013] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:38.890786 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168171f6-38a6-48e2-a892-8224ec9cb6e9 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:38.896611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8a833a14-578e-4033-a995-6e78eadd6906 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:38.897843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8a833a14-578e-4033-a995-6e78eadd6906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:38.976544 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 501/1014] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:38 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:53:38.985505 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a833a14-578e-4033-a995-6e78eadd6906 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:38.995490 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168171f6-38a6-48e2-a892-8224ec9cb6e9 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:39.030473 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c7553-5391-40f1-8adf-fddb3ca08980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:39.031149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c7553-5391-40f1-8adf-fddb3ca08980 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:39.031435 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c7553-5391-40f1-8adf-fddb3ca08980 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:39.031714 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c7553-5391-40f1-8adf-fddb3ca08980 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:39.032473 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c7553-5391-40f1-8adf-fddb3ca08980 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:39.033917 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c7553-5391-40f1-8adf-fddb3ca08980 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:39.051382 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 514/1015] 10.222.0.35 () {60 vars in 1141 bytes} [Thu May 19 21:53:38 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:53:39.052251 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c7553-5391-40f1-8adf-fddb3ca08980 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:39.061074 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:39.100220 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a833a14-578e-4033-a995-6e78eadd6906 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:39.128313 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:39.151949 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb55469-468a-4627-a0a4-adf57ba00f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:39.152796 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb55469-468a-4627-a0a4-adf57ba00f0c None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:39.153121 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb55469-468a-4627-a0a4-adf57ba00f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:39.153503 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb55469-468a-4627-a0a4-adf57ba00f0c None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:39.154321 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb55469-468a-4627-a0a4-adf57ba00f0c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:39.155982 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb55469-468a-4627-a0a4-adf57ba00f0c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:39.185855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 502/1016] 10.222.0.35 () {60 vars in 1141 bytes} [Thu May 19 21:53:38 2022] POST /identity/v3/projects => generated 311 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:53:39.196109 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c7553-5391-40f1-8adf-fddb3ca08980 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:39.239605 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733df041-5f4c-4ccb-b7d4-dd69ddd99fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:39.240457 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733df041-5f4c-4ccb-b7d4-dd69ddd99fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:39.240757 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733df041-5f4c-4ccb-b7d4-dd69ddd99fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:39.241261 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733df041-5f4c-4ccb-b7d4-dd69ddd99fe8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:39.241929 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733df041-5f4c-4ccb-b7d4-dd69ddd99fe8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:39.243453 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733df041-5f4c-4ccb-b7d4-dd69ddd99fe8 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:39.257105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-733df041-5f4c-4ccb-b7d4-dd69ddd99fe8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 21:53:39.257105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:39.257105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:53:39.257105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:53:39.257105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:53:39.257105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:53:39.257105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:53:39.257105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:39.257105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 21:53:39.257105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:39.257105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:53:39.257105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:39.257105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:39.257105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:39.257105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:39.257105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:39.257105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:39.258283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:39.258283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:39.258283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:39.258283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:39.258283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:39.258283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:39.258283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:53:39.258283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:53:39.258283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:53:39.258283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:53:39.258283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:39.258283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:39.258283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:39.258283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:39.258283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:39.258283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:39.259463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:39.259463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:39.259463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:39.259463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:39.259463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:39.259463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:39.259463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:39.259463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:39.259463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:39.259463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:39.259463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:53:39.259463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:39.259463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 21:53:39.259463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:39.259463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 515/1017] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:53:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:39.265636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb55469-468a-4627-a0a4-adf57ba00f0c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:39.400540 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb55469-468a-4627-a0a4-adf57ba00f0c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:39.426668 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:39.443620 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d42b64-4482-42df-8677-9f51f0ac18a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:39.444297 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d42b64-4482-42df-8677-9f51f0ac18a9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:39.444635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d42b64-4482-42df-8677-9f51f0ac18a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:39.444920 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d42b64-4482-42df-8677-9f51f0ac18a9 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:39.445638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d42b64-4482-42df-8677-9f51f0ac18a9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:39.445947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d42b64-4482-42df-8677-9f51f0ac18a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:39.448096 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d42b64-4482-42df-8677-9f51f0ac18a9 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:39.463829 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 503/1018] 10.222.0.35 () {56 vars in 1112 bytes} [Thu May 19 21:53:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:39.469830 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733df041-5f4c-4ccb-b7d4-dd69ddd99fe8 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:39.580649 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733df041-5f4c-4ccb-b7d4-dd69ddd99fe8 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:39.595136 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:39.619559 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110fbac-a3a7-46b7-8b0d-a0908ab8e647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:39.620236 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110fbac-a3a7-46b7-8b0d-a0908ab8e647 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:39.620569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110fbac-a3a7-46b7-8b0d-a0908ab8e647 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:39.620856 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110fbac-a3a7-46b7-8b0d-a0908ab8e647 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:39.621576 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110fbac-a3a7-46b7-8b0d-a0908ab8e647 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:39.621885 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110fbac-a3a7-46b7-8b0d-a0908ab8e647 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:39.623283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110fbac-a3a7-46b7-8b0d-a0908ab8e647 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:39.630195 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 516/1019] 10.222.0.35 () {56 vars in 1112 bytes} [Thu May 19 21:53:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:39.635224 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d42b64-4482-42df-8677-9f51f0ac18a9 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:39.753952 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d42b64-4482-42df-8677-9f51f0ac18a9 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:39.798190 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2636c-ff79-4cec-b050-9c94ba3ea577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:39.798862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2636c-ff79-4cec-b050-9c94ba3ea577 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:39.799146 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2636c-ff79-4cec-b050-9c94ba3ea577 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:39.799418 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2636c-ff79-4cec-b050-9c94ba3ea577 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:39.800172 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2636c-ff79-4cec-b050-9c94ba3ea577 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:39.801583 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2636c-ff79-4cec-b050-9c94ba3ea577 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:39.827533 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 504/1020] 10.222.0.35 () {60 vars in 1144 bytes} [Thu May 19 21:53:39 2022] POST /identity/v3/endpoints => generated 334 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:53:41.397718 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cf72e-bb26-4040-93d1-596c61e670f4 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:41.398268 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cf72e-bb26-4040-93d1-596c61e670f4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:41.398268 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cf72e-bb26-4040-93d1-596c61e670f4 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:41.400459 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 517/1021] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:41.406177 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4451724-c295-45f5-8b8b-3e1dc8d29fef None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:41.406673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4451724-c295-45f5-8b8b-3e1dc8d29fef None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:41.406766 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4451724-c295-45f5-8b8b-3e1dc8d29fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:41.424126 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b4451724-c295-45f5-8b8b-3e1dc8d29fef None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:41.425349 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b4451724-c295-45f5-8b8b-3e1dc8d29fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:41.472119 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:41.517280 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 505/1022] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:53:41.540092 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cf72e-bb26-4040-93d1-596c61e670f4 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:41.542230 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11b27c-390b-4187-bd04-110ebed745f8 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:41.542514 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11b27c-390b-4187-bd04-110ebed745f8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:41.542790 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11b27c-390b-4187-bd04-110ebed745f8 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:41.544295 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 506/1023] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:41.549314 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74736f0f-29e5-44a4-b1f9-648f6d1391f8 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:41.549597 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74736f0f-29e5-44a4-b1f9-648f6d1391f8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:41.549874 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74736f0f-29e5-44a4-b1f9-648f6d1391f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:41.567442 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-74736f0f-29e5-44a4-b1f9-648f6d1391f8 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:41.568653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-74736f0f-29e5-44a4-b1f9-648f6d1391f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:41.655963 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 507/1024] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:53:41.666272 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cf72e-bb26-4040-93d1-596c61e670f4 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:41.681414 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74736f0f-29e5-44a4-b1f9-648f6d1391f8 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:41.705122 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e09e48-e3a7-4e2d-87f9-4804cb0d41a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:41.705925 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e09e48-e3a7-4e2d-87f9-4804cb0d41a1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:41.706210 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e09e48-e3a7-4e2d-87f9-4804cb0d41a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:41.706478 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e09e48-e3a7-4e2d-87f9-4804cb0d41a1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:41.707133 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e09e48-e3a7-4e2d-87f9-4804cb0d41a1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:41.708546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e09e48-e3a7-4e2d-87f9-4804cb0d41a1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:41.721007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-f6e09e48-e3a7-4e2d-87f9-4804cb0d41a1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 21:53:41.721007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:41.721007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:53:41.721007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:53:41.721007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:53:41.721007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:53:41.721007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:53:41.721007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:41.721007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 21:53:41.721007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:41.721007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:53:41.721007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:41.721007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:41.721007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:41.721007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:41.721007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:41.721007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:41.722041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:41.722041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:41.722041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:41.722041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:41.722041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:41.722041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:41.722041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:53:41.722041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:53:41.722041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:53:41.722041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:53:41.722041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:41.722041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:41.722041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:41.722041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:41.722041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:41.722041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:41.722855 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:41.722855 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:41.722855 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:41.722855 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:41.722855 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:41.722855 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:41.722855 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:41.722855 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:41.722855 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:41.722855 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:41.722855 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:53:41.722855 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:41.722855 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 21:53:41.722855 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:41.722855 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 518/1025] 10.222.0.35 () {56 vars in 1105 bytes} [Thu May 19 21:53:41 2022] GET /identity/v3/services/image => generated 86 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:41.729302 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e09e48-e3a7-4e2d-87f9-4804cb0d41a1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:41.780900 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:41.807229 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:41.815647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74736f0f-29e5-44a4-b1f9-648f6d1391f8 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:41.845091 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e09e48-e3a7-4e2d-87f9-4804cb0d41a1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:41.858179 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc6381-915f-4deb-a985-c2cd2651c2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:41.859360 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc6381-915f-4deb-a985-c2cd2651c2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:41.859869 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc6381-915f-4deb-a985-c2cd2651c2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:41.860369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc6381-915f-4deb-a985-c2cd2651c2c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:41.861807 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc6381-915f-4deb-a985-c2cd2651c2c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:41.863453 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc6381-915f-4deb-a985-c2cd2651c2c9 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:41.865333 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 508/1026] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:41.871825 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc6381-915f-4deb-a985-c2cd2651c2c9 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:41.885538 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deab1c2-5563-4615-ad90-a28065723679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:41.886222 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deab1c2-5563-4615-ad90-a28065723679 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:41.886508 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deab1c2-5563-4615-ad90-a28065723679 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:41.886786 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deab1c2-5563-4615-ad90-a28065723679 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:41.887493 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deab1c2-5563-4615-ad90-a28065723679 None admin] RBAC: Adding query filter params (name=image) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:41.887800 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deab1c2-5563-4615-ad90-a28065723679 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:41.889309 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deab1c2-5563-4615-ad90-a28065723679 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:41.894700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 519/1027] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:41.903262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deab1c2-5563-4615-ad90-a28065723679 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:42.012193 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deab1c2-5563-4615-ad90-a28065723679 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:42.014561 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc6381-915f-4deb-a985-c2cd2651c2c9 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:42.020206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:42.053196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db67c10-8990-41f3-b0de-a1c5c4325360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:42.053884 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db67c10-8990-41f3-b0de-a1c5c4325360 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:42.054174 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db67c10-8990-41f3-b0de-a1c5c4325360 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:42.054490 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db67c10-8990-41f3-b0de-a1c5c4325360 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:42.055253 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db67c10-8990-41f3-b0de-a1c5c4325360 None admin] RBAC: Adding query filter params (type=image) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:42.055565 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db67c10-8990-41f3-b0de-a1c5c4325360 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:42.057686 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db67c10-8990-41f3-b0de-a1c5c4325360 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:42.060472 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6de47d-fddb-4e39-a459-563d7e3c0c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:42.060923 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6de47d-fddb-4e39-a459-563d7e3c0c07 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:42.061205 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6de47d-fddb-4e39-a459-563d7e3c0c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:42.061488 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6de47d-fddb-4e39-a459-563d7e3c0c07 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:42.062213 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6de47d-fddb-4e39-a459-563d7e3c0c07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:42.063651 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6de47d-fddb-4e39-a459-563d7e3c0c07 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:42.069218 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 520/1028] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:42.069978 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db67c10-8990-41f3-b0de-a1c5c4325360 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:42.092593 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 509/1029] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 21:53:41 2022] POST /identity/v3/users => generated 285 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:53:42.192773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db67c10-8990-41f3-b0de-a1c5c4325360 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:42.218314 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4ca38-a00a-46ba-a2f9-99559ea36c34 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:42.218605 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4ca38-a00a-46ba-a2f9-99559ea36c34 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:42.218888 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4ca38-a00a-46ba-a2f9-99559ea36c34 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:42.220351 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 510/1030] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:53:42.226458 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d52a3-52f5-4758-8468-008cb2da6eb6 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:42.226745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d52a3-52f5-4758-8468-008cb2da6eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:42.227024 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d52a3-52f5-4758-8468-008cb2da6eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:42.247434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-bf9d52a3-52f5-4758-8468-008cb2da6eb6 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:42.248606 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-bf9d52a3-52f5-4758-8468-008cb2da6eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:42.254158 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6d5f7-ab2f-403e-97de-a24ffbd14259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:42.254850 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6d5f7-ab2f-403e-97de-a24ffbd14259 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:42.255139 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6d5f7-ab2f-403e-97de-a24ffbd14259 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:42.255420 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6d5f7-ab2f-403e-97de-a24ffbd14259 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:42.256233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6d5f7-ab2f-403e-97de-a24ffbd14259 None admin] RBAC: Adding query filter params (interface=public, service_id=5af7f1ec375c48538c3b9aa124434eb5, region_id=RegionOne) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:42.256586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6d5f7-ab2f-403e-97de-a24ffbd14259 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:42.258014 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6d5f7-ab2f-403e-97de-a24ffbd14259 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:42.272237 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 521/1031] 10.222.0.35 () {56 vars in 1251 bytes} [Thu May 19 21:53:42 2022] GET /identity/v3/endpoints?service_id=5af7f1ec375c48538c3b9aa124434eb5&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:42.273384 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6d5f7-ab2f-403e-97de-a24ffbd14259 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:42.274606 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:42.333541 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:42.350949 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 511/1032] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:53:42.375753 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d52a3-52f5-4758-8468-008cb2da6eb6 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:42.414603 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6d5f7-ab2f-403e-97de-a24ffbd14259 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:42.450950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f8a1b-4eb0-46ce-9489-1a5d4f290ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:42.451625 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f8a1b-4eb0-46ce-9489-1a5d4f290ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:42.451911 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f8a1b-4eb0-46ce-9489-1a5d4f290ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:42.452190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f8a1b-4eb0-46ce-9489-1a5d4f290ff6 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:42.452902 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f8a1b-4eb0-46ce-9489-1a5d4f290ff6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:42.454286 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f8a1b-4eb0-46ce-9489-1a5d4f290ff6 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:42.461102 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 522/1033] 10.222.0.35 () {56 vars in 1087 bytes} [Thu May 19 21:53:42 2022] GET /identity/v3/services => generated 1957 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 21:53:42.497110 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d52a3-52f5-4758-8468-008cb2da6eb6 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:42.536576 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7e26f-9569-455d-9fb0-eba7f4bce540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:42.537339 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7e26f-9569-455d-9fb0-eba7f4bce540 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:42.537617 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7e26f-9569-455d-9fb0-eba7f4bce540 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:42.537989 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7e26f-9569-455d-9fb0-eba7f4bce540 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:42.550745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7e26f-9569-455d-9fb0-eba7f4bce540 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:53:42.559814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-47e7e26f-9569-455d-9fb0-eba7f4bce540 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 21:53:42.559814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:42.559814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:42.559814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:42.559814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:42.559814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:42.559814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:42.559814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:42.559814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:42.559814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:42.559814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:42.559814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:42.559814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:53:42.559814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:53:42.559814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:53:42.559814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:53:42.560992 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:53:42.560992 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:53:42.560992 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:53:42.560992 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:53:42.560992 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:42.560992 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:42.560992 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:42.560992 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:42.560992 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:42.560992 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:42.560992 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:42.560992 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:42.560992 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:42.560992 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:42.560992 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:42.560992 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:42.567018 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:42.567018 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:42.567018 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:42.567018 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:42.567018 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:53:42.567018 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:53:42.567018 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:53:42.567018 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:53:42.567018 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:53:42.567018 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:53:42.567018 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 21:53:42.567018 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:42.567018 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 512/1034] 10.222.0.35 () {56 vars in 1120 bytes} [Thu May 19 21:53:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:53:42.567723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f8a1b-4eb0-46ce-9489-1a5d4f290ff6 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:42.697293 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:42.706404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f8a1b-4eb0-46ce-9489-1a5d4f290ff6 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:42.758937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e5b89-f08a-4fbc-b5c6-d894499a544b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:42.759682 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e5b89-f08a-4fbc-b5c6-d894499a544b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:42.759965 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e5b89-f08a-4fbc-b5c6-d894499a544b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:42.760240 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e5b89-f08a-4fbc-b5c6-d894499a544b None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:42.761018 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e5b89-f08a-4fbc-b5c6-d894499a544b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:42.761323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e5b89-f08a-4fbc-b5c6-d894499a544b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:42.762689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e5b89-f08a-4fbc-b5c6-d894499a544b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:42.771863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 523/1035] 10.222.0.35 () {56 vars in 1115 bytes} [Thu May 19 21:53:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:42.777412 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7e26f-9569-455d-9fb0-eba7f4bce540 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:42.792950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:42.890497 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7e26f-9569-455d-9fb0-eba7f4bce540 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:42.940239 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27460f-05a1-4328-8115-9150c6659c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:42.941087 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27460f-05a1-4328-8115-9150c6659c75 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:42.941421 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27460f-05a1-4328-8115-9150c6659c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:42.941706 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27460f-05a1-4328-8115-9150c6659c75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:42.955844 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27460f-05a1-4328-8115-9150c6659c75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:42.957523 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27460f-05a1-4328-8115-9150c6659c75 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:42.975825 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-ff27460f-05a1-4328-8115-9150c6659c75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:42.975825 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:42.975825 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:42.975825 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:42.975825 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:42.975825 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:42.975825 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:42.975825 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:42.975825 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:42.975825 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:42.975825 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:42.975825 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:42.975825 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:53:42.975825 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:53:42.975825 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:53:42.977046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:53:42.977046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:42.977046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:42.977046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:42.977046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:42.977046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:42.977046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:42.977046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:42.977046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:42.977046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:42.977046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:42.977046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:42.977046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:42.977046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:42.977046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:42.977046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:42.977046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:42.977951 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:53:42.977951 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:53:42.977951 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:42.977951 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:42.977951 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 513/1036] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:42.984813 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e5b89-f08a-4fbc-b5c6-d894499a544b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:43.107936 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e5b89-f08a-4fbc-b5c6-d894499a544b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:43.145644 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77801da0-840c-417a-aa32-b80e1e0cb938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:43.146307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77801da0-840c-417a-aa32-b80e1e0cb938 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:43.146586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77801da0-840c-417a-aa32-b80e1e0cb938 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:43.146857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77801da0-840c-417a-aa32-b80e1e0cb938 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:43.147570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77801da0-840c-417a-aa32-b80e1e0cb938 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:43.147874 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77801da0-840c-417a-aa32-b80e1e0cb938 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:43.149267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77801da0-840c-417a-aa32-b80e1e0cb938 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:43.163987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 524/1037] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:43.169848 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27460f-05a1-4328-8115-9150c6659c75 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:43.235423 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:43.279584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27460f-05a1-4328-8115-9150c6659c75 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:43.314539 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004cdb7-e481-4457-bda1-639c77b8b2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:43.315356 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004cdb7-e481-4457-bda1-639c77b8b2d3 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:43.315635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004cdb7-e481-4457-bda1-639c77b8b2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:43.315906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004cdb7-e481-4457-bda1-639c77b8b2d3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:43.325444 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004cdb7-e481-4457-bda1-639c77b8b2d3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:43.326902 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004cdb7-e481-4457-bda1-639c77b8b2d3 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:43.342626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-e004cdb7-e481-4457-bda1-639c77b8b2d3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 21:53:43.342626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:43.342626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:43.342626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:43.342626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:43.342626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:43.342626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:43.342626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:43.342626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:43.342626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:43.342626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:43.342626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:43.342626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:53:43.342626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:53:43.342626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:53:43.342626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:53:43.343652 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:43.343652 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:43.343652 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:53:43.343652 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:43.343652 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:53:43.343652 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:43.343652 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:43.343652 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:43.343652 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:43.343652 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:43.343652 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:43.343652 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:43.343652 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:43.343652 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:43.343652 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:43.343652 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:43.343652 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:43.343652 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:43.345137 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:43.345137 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:43.345137 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:53:43.345137 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:53:43.345137 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:53:43.345137 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:53:43.345137 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:53:43.345137 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:53:43.345137 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 21:53:43.345137 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:43.348624 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 514/1038] 10.222.0.35 () {56 vars in 1093 bytes} [Thu May 19 21:53:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:43.349779 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77801da0-840c-417a-aa32-b80e1e0cb938 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:43.377897 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:43.471734 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77801da0-840c-417a-aa32-b80e1e0cb938 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:43.506552 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b3495-4315-4b77-b31f-49a53e6e4349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:43.507226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b3495-4315-4b77-b31f-49a53e6e4349 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:43.507507 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b3495-4315-4b77-b31f-49a53e6e4349 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:43.507780 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b3495-4315-4b77-b31f-49a53e6e4349 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:43.508645 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b3495-4315-4b77-b31f-49a53e6e4349 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:43.509498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b3495-4315-4b77-b31f-49a53e6e4349 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:43.510943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b3495-4315-4b77-b31f-49a53e6e4349 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:43.535320 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 525/1039] 10.222.0.35 () {56 vars in 1133 bytes} [Thu May 19 21:53:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:43.536929 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004cdb7-e481-4457-bda1-639c77b8b2d3 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:43.647563 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004cdb7-e481-4457-bda1-639c77b8b2d3 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:43.673863 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:43.689216 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2d8c2-7aaa-452d-aafe-5f0090fc5234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:43.689881 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2d8c2-7aaa-452d-aafe-5f0090fc5234 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:43.690161 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2d8c2-7aaa-452d-aafe-5f0090fc5234 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:43.690433 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2d8c2-7aaa-452d-aafe-5f0090fc5234 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:43.764705 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2d8c2-7aaa-452d-aafe-5f0090fc5234 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:43.766156 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2d8c2-7aaa-452d-aafe-5f0090fc5234 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:43.877087 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 515/1040] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:53:43 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:53:43.882480 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b3495-4315-4b77-b31f-49a53e6e4349 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:43.967407 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:43.993123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b3495-4315-4b77-b31f-49a53e6e4349 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:44.037923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268e7a4-c929-474f-befe-aa9a61a0cb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:44.038755 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268e7a4-c929-474f-befe-aa9a61a0cb6a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:44.039041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268e7a4-c929-474f-befe-aa9a61a0cb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:44.039320 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268e7a4-c929-474f-befe-aa9a61a0cb6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:44.057457 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268e7a4-c929-474f-befe-aa9a61a0cb6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:44.058950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268e7a4-c929-474f-befe-aa9a61a0cb6a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:44.077550 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-7268e7a4-c929-474f-befe-aa9a61a0cb6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:44.077550 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:44.077550 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:44.077550 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:44.077550 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:44.077550 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:44.077550 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:44.077550 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:44.077550 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:44.077550 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:44.077550 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:44.077550 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:44.077550 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:53:44.077550 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:53:44.077550 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:53:44.078502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:53:44.078502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:44.078502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:44.078502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:44.078502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:44.078502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:44.078502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:44.078502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:44.078502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:44.078502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:44.078502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:44.078502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:44.078502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:44.078502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:44.078502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:44.078502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:44.078502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:44.079384 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:53:44.079384 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:53:44.079384 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:44.079384 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:44.079384 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 526/1041] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:44.085420 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2d8c2-7aaa-452d-aafe-5f0090fc5234 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:44.119412 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:44.216252 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2d8c2-7aaa-452d-aafe-5f0090fc5234 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:44.269797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b1d55-3ba1-4068-a3a2-aedc2e4a5931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:44.270378 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b1d55-3ba1-4068-a3a2-aedc2e4a5931 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:44.270659 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b1d55-3ba1-4068-a3a2-aedc2e4a5931 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:44.270933 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b1d55-3ba1-4068-a3a2-aedc2e4a5931 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:44.271668 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b1d55-3ba1-4068-a3a2-aedc2e4a5931 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:44.271970 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b1d55-3ba1-4068-a3a2-aedc2e4a5931 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:44.273369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b1d55-3ba1-4068-a3a2-aedc2e4a5931 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:44.286034 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 516/1042] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:44.292668 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268e7a4-c929-474f-befe-aa9a61a0cb6a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:44.420146 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268e7a4-c929-474f-befe-aa9a61a0cb6a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:44.450787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:44.467218 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4e04e-e531-49dd-af70-96488419f66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:44.468032 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4e04e-e531-49dd-af70-96488419f66c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:44.468329 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4e04e-e531-49dd-af70-96488419f66c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:44.468621 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4e04e-e531-49dd-af70-96488419f66c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:44.476158 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4e04e-e531-49dd-af70-96488419f66c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:44.477663 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4e04e-e531-49dd-af70-96488419f66c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:44.492292 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-30d4e04e-e531-49dd-af70-96488419f66c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:44.492292 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:44.492292 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:44.492292 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:44.492292 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:44.492292 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:44.492292 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:44.492292 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:44.492292 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:44.492292 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:44.492292 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:44.492292 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:44.492292 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:53:44.492292 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:53:44.492292 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:53:44.493318 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:53:44.493318 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:44.493318 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:44.493318 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:44.493318 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:44.493318 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:44.493318 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:44.493318 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:44.493318 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:44.493318 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:44.493318 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:44.493318 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:44.493318 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:44.493318 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:44.493318 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:44.493318 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:44.493318 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:44.499533 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:53:44.499533 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:53:44.499533 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:53:44.499533 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:53:44.499533 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:53:44.499533 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:53:44.499533 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:44.499533 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:44.499533 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 527/1043] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:53:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:53:44.501644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b1d55-3ba1-4068-a3a2-aedc2e4a5931 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:44.553204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a93a5a-b8cb-482b-bfc4-cc8ec26ddcbc None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:44.553397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a93a5a-b8cb-482b-bfc4-cc8ec26ddcbc None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:44.553667 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a93a5a-b8cb-482b-bfc4-cc8ec26ddcbc None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:44.555064 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 528/1044] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:53:44.562071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0385e9-f0fe-4dfa-8049-00e195b3305f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:44.562397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0385e9-f0fe-4dfa-8049-00e195b3305f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:44.562717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0385e9-f0fe-4dfa-8049-00e195b3305f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:44.582091 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8b0385e9-f0fe-4dfa-8049-00e195b3305f None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:44.583284 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8b0385e9-f0fe-4dfa-8049-00e195b3305f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:44.610603 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:44.635965 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b1d55-3ba1-4068-a3a2-aedc2e4a5931 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:44.672602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 529/1045] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:53:44.677903 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb6955-5895-40c4-809f-0794940232ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:44.678573 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb6955-5895-40c4-809f-0794940232ba None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:44.678852 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb6955-5895-40c4-809f-0794940232ba None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:44.679122 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb6955-5895-40c4-809f-0794940232ba None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:44.679911 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb6955-5895-40c4-809f-0794940232ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:44.680216 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb6955-5895-40c4-809f-0794940232ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:44.682321 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb6955-5895-40c4-809f-0794940232ba None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:44.700629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 517/1046] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:53:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:44.700824 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0385e9-f0fe-4dfa-8049-00e195b3305f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:44.701987 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb6955-5895-40c4-809f-0794940232ba None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:44.813830 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0385e9-f0fe-4dfa-8049-00e195b3305f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:44.818939 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb6955-5895-40c4-809f-0794940232ba None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:44.835334 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:44.850752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d3089-3cdb-4de7-894f-bd8171e13249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:44.851546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d3089-3cdb-4de7-894f-bd8171e13249 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:44.851831 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d3089-3cdb-4de7-894f-bd8171e13249 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:44.852104 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d3089-3cdb-4de7-894f-bd8171e13249 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:44.855226 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfb8e8-73cd-47ce-86af-554e7445ba76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:44.855881 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfb8e8-73cd-47ce-86af-554e7445ba76 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:44.856156 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfb8e8-73cd-47ce-86af-554e7445ba76 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:44.856449 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfb8e8-73cd-47ce-86af-554e7445ba76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:44.857344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcfb8e8-73cd-47ce-86af-554e7445ba76 None admin] RBAC: Adding query filter params (role.id=349b194bc80845e4a14c05f7cffcfe54, scope.project.id=89b20e18525c473e94a2b263148f1f5f, user.id=902ca8f1d59547a0ab187b4748311f58) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:44.857594 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcfb8e8-73cd-47ce-86af-554e7445ba76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:44.859016 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcfb8e8-73cd-47ce-86af-554e7445ba76 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:44.863319 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d3089-3cdb-4de7-894f-bd8171e13249 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:53:44.864488 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 518/1047] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:53:44 2022] GET /identity/v3/role_assignments?user.id=902ca8f1d59547a0ab187b4748311f58&scope.project.id=89b20e18525c473e94a2b263148f1f5f&role.id=349b194bc80845e4a14c05f7cffcfe54 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:44.865787 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bc9fe-d2cf-4fef-93a6-acce6cbc24da None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:44.866320 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bc9fe-d2cf-4fef-93a6-acce6cbc24da None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:44.866592 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bc9fe-d2cf-4fef-93a6-acce6cbc24da None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:44.868001 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 519/1048] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:44.872460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-0a0d3089-3cdb-4de7-894f-bd8171e13249 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:53:44.872460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:44.872460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:44.872460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:44.872460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:44.872460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:44.872460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:44.872460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:44.872460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:44.872460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:44.872460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:44.872460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:44.872460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:53:44.872460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:53:44.872460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:53:44.872460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:53:44.873494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:53:44.873494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:53:44.873494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:53:44.873494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:53:44.873494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:44.873494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:44.873494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:44.873494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:44.873494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:44.873494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:44.873494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:44.873494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:44.873494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:44.873494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:44.873494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:44.873494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:44.874323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:44.874323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:44.874323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:44.874323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:44.874323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:53:44.874323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:53:44.874323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:53:44.874323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:53:44.874323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:53:44.874323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:53:44.874323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:53:44.874323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:44.874323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 530/1049] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:53:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:53:44.877286 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665bb33-e1a5-4b4a-ab5d-c56bc4756aef None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:44.877571 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665bb33-e1a5-4b4a-ab5d-c56bc4756aef None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:44.877848 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665bb33-e1a5-4b4a-ab5d-c56bc4756aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:44.880259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d3089-3cdb-4de7-894f-bd8171e13249 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:44.892614 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:44.900111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-5665bb33-e1a5-4b4a-ab5d-c56bc4756aef None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:44.901174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5665bb33-e1a5-4b4a-ab5d-c56bc4756aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:44.984171 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 520/1050] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:53:45.007280 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d3089-3cdb-4de7-894f-bd8171e13249 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:45.008287 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665bb33-e1a5-4b4a-ab5d-c56bc4756aef None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:45.047087 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b96622-b9e4-4dab-ae3d-e3751dbd4684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:45.047880 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b96622-b9e4-4dab-ae3d-e3751dbd4684 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:45.048159 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b96622-b9e4-4dab-ae3d-e3751dbd4684 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:45.048472 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b96622-b9e4-4dab-ae3d-e3751dbd4684 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:45.049331 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b96622-b9e4-4dab-ae3d-e3751dbd4684 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:45.049644 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b96622-b9e4-4dab-ae3d-e3751dbd4684 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:45.051075 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b96622-b9e4-4dab-ae3d-e3751dbd4684 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:45.065910 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 531/1051] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:53:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:45.066993 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b96622-b9e4-4dab-ae3d-e3751dbd4684 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:45.115486 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:45.133618 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665bb33-e1a5-4b4a-ab5d-c56bc4756aef None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:45.173936 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d6f79-24ff-443d-85d8-7d0e121a5df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:45.174735 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d6f79-24ff-443d-85d8-7d0e121a5df0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:45.175021 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d6f79-24ff-443d-85d8-7d0e121a5df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:45.175296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d6f79-24ff-443d-85d8-7d0e121a5df0 None admin] PATH_INFO: `/v3/services/image` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:45.175955 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d6f79-24ff-443d-85d8-7d0e121a5df0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:45.177365 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d6f79-24ff-443d-85d8-7d0e121a5df0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:45.179693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b96622-b9e4-4dab-ae3d-e3751dbd4684 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:45.180464 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:45.191650 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-bc5d6f79-24ff-443d-85d8-7d0e121a5df0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 21:53:45.191650 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:45.191650 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:53:45.191650 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:53:45.191650 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:53:45.191650 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:53:45.191650 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:53:45.191650 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:45.191650 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 21:53:45.191650 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:45.191650 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:53:45.191650 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:45.191650 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:45.191650 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:45.191650 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:45.191650 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:45.191650 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:45.193128 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:45.193128 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:45.193128 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:45.193128 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:45.193128 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:45.193128 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:45.193128 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:53:45.193128 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:53:45.193128 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:53:45.193128 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:53:45.193128 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:45.193128 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:45.193128 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:45.193128 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:45.193128 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:45.193128 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:45.194139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:45.194139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:45.194139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:45.194139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:45.194139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:45.194139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:45.194139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:45.194139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:45.194139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:45.194139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:45.194139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:53:45.194139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:53:45.194139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 21:53:45.194139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:45.197989 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 521/1052] 10.222.0.35 () {56 vars in 1105 bytes} [Thu May 19 21:53:45 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:53:45.203511 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d6f79-24ff-443d-85d8-7d0e121a5df0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:45.227036 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe1740-fdcb-47de-805c-7b8bc3f30f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:45.228078 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe1740-fdcb-47de-805c-7b8bc3f30f4f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:45.228273 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe1740-fdcb-47de-805c-7b8bc3f30f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:45.228681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe1740-fdcb-47de-805c-7b8bc3f30f4f None admin] PATH_INFO: `/v3/users/59ce4b3eab0d402f80fd0322c382db50` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:45.244452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe1740-fdcb-47de-805c-7b8bc3f30f4f None admin] RBAC: Authorizing `identity:get_user(user_id=59ce4b3eab0d402f80fd0322c382db50)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:45.246171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe1740-fdcb-47de-805c-7b8bc3f30f4f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:45.248262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 532/1053] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:53:45 2022] GET /identity/v3/users/59ce4b3eab0d402f80fd0322c382db50 => generated 285 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:45.253808 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe1740-fdcb-47de-805c-7b8bc3f30f4f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:45.325887 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d6f79-24ff-443d-85d8-7d0e121a5df0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:45.368160 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f62a0-3648-4c02-b7aa-10332915b7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:45.369466 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:45.369631 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f62a0-3648-4c02-b7aa-10332915b7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:45.370439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f62a0-3648-4c02-b7aa-10332915b7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:45.370439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f62a0-3648-4c02-b7aa-10332915b7e8 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:45.370991 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f62a0-3648-4c02-b7aa-10332915b7e8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:45.371313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f62a0-3648-4c02-b7aa-10332915b7e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:45.372718 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f62a0-3648-4c02-b7aa-10332915b7e8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:45.373896 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe1740-fdcb-47de-805c-7b8bc3f30f4f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:45.378278 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 522/1054] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:45.383752 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f62a0-3648-4c02-b7aa-10332915b7e8 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:45.415482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d5c86-057b-408d-97e9-487d8ac103c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:45.416062 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d5c86-057b-408d-97e9-487d8ac103c5 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:45.416350 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d5c86-057b-408d-97e9-487d8ac103c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:45.416635 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d5c86-057b-408d-97e9-487d8ac103c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:45.458955 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:45.501453 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f62a0-3648-4c02-b7aa-10332915b7e8 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:45.507271 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d5c86-057b-408d-97e9-487d8ac103c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:45.508781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d5c86-057b-408d-97e9-487d8ac103c5 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:45.538534 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca831e98-a58c-4489-a59f-ea72e5f83bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:45.539195 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca831e98-a58c-4489-a59f-ea72e5f83bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:45.539475 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca831e98-a58c-4489-a59f-ea72e5f83bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:45.539747 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca831e98-a58c-4489-a59f-ea72e5f83bf1 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:45.540987 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca831e98-a58c-4489-a59f-ea72e5f83bf1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:45.541293 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca831e98-a58c-4489-a59f-ea72e5f83bf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:45.542701 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca831e98-a58c-4489-a59f-ea72e5f83bf1 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:45.548564 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 523/1055] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:45.556952 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca831e98-a58c-4489-a59f-ea72e5f83bf1 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:45.638470 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:45.644574 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 533/1056] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:53:45 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 21:53:45.649112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d5c86-057b-408d-97e9-487d8ac103c5 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:45.689810 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca831e98-a58c-4489-a59f-ea72e5f83bf1 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:45.722869 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:45.732357 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0370d-c4d1-433e-a741-ea94d506b6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:45.733059 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0370d-c4d1-433e-a741-ea94d506b6fd None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:45.733347 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0370d-c4d1-433e-a741-ea94d506b6fd None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:45.733715 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0370d-c4d1-433e-a741-ea94d506b6fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:45.734587 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0370d-c4d1-433e-a741-ea94d506b6fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:45.735968 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0370d-c4d1-433e-a741-ea94d506b6fd None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:45.767872 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 524/1057] 10.222.0.35 () {60 vars in 1144 bytes} [Thu May 19 21:53:45 2022] POST /identity/v3/endpoints => generated 327 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 21:53:45.786535 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d5c86-057b-408d-97e9-487d8ac103c5 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:45.843594 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4b99f-9d07-48dd-bbdf-915219044b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:45.844482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4b99f-9d07-48dd-bbdf-915219044b7c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:45.844770 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4b99f-9d07-48dd-bbdf-915219044b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:45.845067 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4b99f-9d07-48dd-bbdf-915219044b7c None admin] PATH_INFO: `/v3/projects/db9e71855c464daa9754686f96594b72` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:45.846396 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4b99f-9d07-48dd-bbdf-915219044b7c None admin] RBAC: Authorizing `identity:get_project(project_id=db9e71855c464daa9754686f96594b72)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:45.847979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4b99f-9d07-48dd-bbdf-915219044b7c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:45.855839 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 534/1058] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:53:45 2022] GET /identity/v3/projects/db9e71855c464daa9754686f96594b72 => generated 311 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:45.857304 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0370d-c4d1-433e-a741-ea94d506b6fd None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:45.977613 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0370d-c4d1-433e-a741-ea94d506b6fd None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:46.016397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef471252-d0d3-4105-a2e5-c58b03769f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:46.017132 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef471252-d0d3-4105-a2e5-c58b03769f69 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:46.017415 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef471252-d0d3-4105-a2e5-c58b03769f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:46.017688 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef471252-d0d3-4105-a2e5-c58b03769f69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:46.018535 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef471252-d0d3-4105-a2e5-c58b03769f69 None admin] RBAC: Adding query filter params (role.id=04369f3c13174671a298fcd8175998d8, scope.project.id=db9e71855c464daa9754686f96594b72, user.id=59ce4b3eab0d402f80fd0322c382db50) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:46.018843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef471252-d0d3-4105-a2e5-c58b03769f69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:46.020299 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef471252-d0d3-4105-a2e5-c58b03769f69 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:46.027860 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 525/1059] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:53:45 2022] GET /identity/v3/role_assignments?user.id=59ce4b3eab0d402f80fd0322c382db50&scope.project.id=db9e71855c464daa9754686f96594b72&role.id=04369f3c13174671a298fcd8175998d8 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:47.205077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f30fe-d200-4bbf-9e9b-23469ac6d7db None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:47.205630 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f30fe-d200-4bbf-9e9b-23469ac6d7db None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:47.205630 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f30fe-d200-4bbf-9e9b-23469ac6d7db None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:47.207183 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 535/1060] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:47.212283 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aab1f-7812-4811-ae2d-d2641b16342f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:47.212760 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aab1f-7812-4811-ae2d-d2641b16342f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:47.212955 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aab1f-7812-4811-ae2d-d2641b16342f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:47.233095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6e8aab1f-7812-4811-ae2d-d2641b16342f None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:47.234295 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6e8aab1f-7812-4811-ae2d-d2641b16342f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:47.280565 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:47.306861 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 526/1061] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:53:47.329976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f30fe-d200-4bbf-9e9b-23469ac6d7db None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:47.399315 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:47.444134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f30fe-d200-4bbf-9e9b-23469ac6d7db None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:47.481634 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4aca69-1798-4967-ae36-5f92f5a6e697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:47.482815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4aca69-1798-4967-ae36-5f92f5a6e697 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:47.483311 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4aca69-1798-4967-ae36-5f92f5a6e697 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:47.483785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4aca69-1798-4967-ae36-5f92f5a6e697 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:47.497394 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4aca69-1798-4967-ae36-5f92f5a6e697 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:53:47.505953 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-6d4aca69-1798-4967-ae36-5f92f5a6e697 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 21:53:47.505953 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:47.505953 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:47.505953 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:47.505953 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:47.505953 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:47.505953 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:47.505953 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:47.505953 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:47.505953 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:47.505953 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:47.505953 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:47.505953 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:53:47.505953 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:53:47.505953 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:53:47.505953 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:53:47.506890 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:53:47.506890 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:53:47.506890 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:53:47.506890 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:53:47.506890 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:47.506890 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:47.506890 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:47.506890 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:47.506890 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:47.506890 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:47.506890 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:47.506890 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:47.506890 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:47.506890 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:47.506890 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:47.506890 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:47.507709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:47.507709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:47.507709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:47.507709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:47.507709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:53:47.507709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:53:47.507709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:53:47.507709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:53:47.507709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:53:47.507709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:53:47.507709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 21:53:47.507709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:47.512576 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 536/1062] 10.222.0.35 () {56 vars in 1120 bytes} [Thu May 19 21:53:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:47.515108 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8aab1f-7812-4811-ae2d-d2641b16342f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:47.625861 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8aab1f-7812-4811-ae2d-d2641b16342f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:47.665899 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6b544-9259-4ca8-9dec-9415c6ae53ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:47.666609 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6b544-9259-4ca8-9dec-9415c6ae53ec None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:47.667046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6b544-9259-4ca8-9dec-9415c6ae53ec None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:47.667326 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6b544-9259-4ca8-9dec-9415c6ae53ec None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:47.668092 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda6b544-9259-4ca8-9dec-9415c6ae53ec None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:47.668421 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda6b544-9259-4ca8-9dec-9415c6ae53ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:47.669804 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda6b544-9259-4ca8-9dec-9415c6ae53ec None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:47.686154 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 527/1063] 10.222.0.35 () {56 vars in 1115 bytes} [Thu May 19 21:53:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:47.689180 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4aca69-1798-4967-ae36-5f92f5a6e697 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:47.804553 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4aca69-1798-4967-ae36-5f92f5a6e697 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:47.829453 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:47.844263 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999ce5b-e2a9-4998-a22a-305ecfe94321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:47.845170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999ce5b-e2a9-4998-a22a-305ecfe94321 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:47.845463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999ce5b-e2a9-4998-a22a-305ecfe94321 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:47.845740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999ce5b-e2a9-4998-a22a-305ecfe94321 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:47.858482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999ce5b-e2a9-4998-a22a-305ecfe94321 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:47.860014 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999ce5b-e2a9-4998-a22a-305ecfe94321 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:47.878241 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-1999ce5b-e2a9-4998-a22a-305ecfe94321 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:47.878241 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:47.878241 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:47.878241 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:47.878241 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:47.878241 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:47.878241 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:47.878241 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:47.878241 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:47.878241 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:47.878241 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:47.878241 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:47.878241 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:53:47.878241 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:53:47.878241 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:53:47.879196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:53:47.879196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:47.879196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:47.879196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:47.879196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:47.879196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:47.879196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:47.879196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:47.879196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:47.879196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:47.879196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:47.879196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:47.879196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:47.879196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:47.879196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:47.879196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:47.879196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:47.885431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:53:47.885431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:53:47.885431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:47.885431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:47.885431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 537/1064] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:47.885921 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6b544-9259-4ca8-9dec-9415c6ae53ec None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:47.934961 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:48.011587 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6b544-9259-4ca8-9dec-9415c6ae53ec None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:48.046150 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aefdc8-c24d-46d6-80ee-3ada33712cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:48.046818 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aefdc8-c24d-46d6-80ee-3ada33712cee None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:48.047097 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aefdc8-c24d-46d6-80ee-3ada33712cee None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:48.047369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aefdc8-c24d-46d6-80ee-3ada33712cee None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:48.048251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aefdc8-c24d-46d6-80ee-3ada33712cee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:48.048458 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aefdc8-c24d-46d6-80ee-3ada33712cee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:48.049944 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aefdc8-c24d-46d6-80ee-3ada33712cee None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:48.068240 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 528/1065] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:48.070090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999ce5b-e2a9-4998-a22a-305ecfe94321 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:48.146027 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e53b74-b0fa-4472-9f19-f20c24a053ce None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:48.146691 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e53b74-b0fa-4472-9f19-f20c24a053ce None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:48.147044 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e53b74-b0fa-4472-9f19-f20c24a053ce None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:48.148870 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 529/1066] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:48.164218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c2f20-efdc-4e52-a3e3-f300fc4ba94e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:48.164608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c2f20-efdc-4e52-a3e3-f300fc4ba94e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:48.164808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c2f20-efdc-4e52-a3e3-f300fc4ba94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:48.184227 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-852c2f20-efdc-4e52-a3e3-f300fc4ba94e None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:48.185604 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-852c2f20-efdc-4e52-a3e3-f300fc4ba94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:48.199562 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999ce5b-e2a9-4998-a22a-305ecfe94321 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:48.243121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d971613-f4c9-4c01-be40-6b8b4152a3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:48.244101 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d971613-f4c9-4c01-be40-6b8b4152a3ff None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:48.244385 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d971613-f4c9-4c01-be40-6b8b4152a3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:48.244688 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d971613-f4c9-4c01-be40-6b8b4152a3ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:48.253172 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d971613-f4c9-4c01-be40-6b8b4152a3ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:48.254892 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d971613-f4c9-4c01-be40-6b8b4152a3ff None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:48.263355 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 530/1067] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:53:48.273000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-7d971613-f4c9-4c01-be40-6b8b4152a3ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 21:53:48.273000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:48.273000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:48.273000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:48.273000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:48.273000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:48.273000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:48.273000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:48.273000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:48.273000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:48.273000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:48.273000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:48.273000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:53:48.273000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:53:48.273000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:53:48.273000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:53:48.273996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:48.273996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:48.273996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:53:48.273996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:48.273996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:53:48.273996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:48.273996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:48.273996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:48.273996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:48.273996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:48.273996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:48.273996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:48.273996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:48.273996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:48.273996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:48.273996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:48.273996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:48.273996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:48.275447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:48.275447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:48.275447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:53:48.275447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:53:48.275447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:53:48.275447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:53:48.275447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:53:48.275447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:53:48.275447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 21:53:48.275447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:48.279545 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 538/1068] 10.222.0.35 () {56 vars in 1093 bytes} [Thu May 19 21:53:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:48.280788 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c2f20-efdc-4e52-a3e3-f300fc4ba94e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:48.287705 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d971613-f4c9-4c01-be40-6b8b4152a3ff None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:48.322919 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:48.334475 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:48.401068 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c2f20-efdc-4e52-a3e3-f300fc4ba94e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:48.409377 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d971613-f4c9-4c01-be40-6b8b4152a3ff None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:48.436947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f56b3c-1882-4fae-ba15-c1ae340e3506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:48.437629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f56b3c-1882-4fae-ba15-c1ae340e3506 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:48.437911 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f56b3c-1882-4fae-ba15-c1ae340e3506 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:48.438217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f56b3c-1882-4fae-ba15-c1ae340e3506 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:48.439056 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f56b3c-1882-4fae-ba15-c1ae340e3506 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:48.439363 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f56b3c-1882-4fae-ba15-c1ae340e3506 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:48.440818 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f56b3c-1882-4fae-ba15-c1ae340e3506 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:48.451277 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b9f62-668f-4dd2-8b0e-617a2eb54035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:48.451931 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b9f62-668f-4dd2-8b0e-617a2eb54035 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:48.452231 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b9f62-668f-4dd2-8b0e-617a2eb54035 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:48.452544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b9f62-668f-4dd2-8b0e-617a2eb54035 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:48.459166 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 531/1069] 10.222.0.35 () {56 vars in 1133 bytes} [Thu May 19 21:53:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:48.460579 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbc05f-f3fe-4212-8967-a238079cc117 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:48.460860 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbc05f-f3fe-4212-8967-a238079cc117 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:48.461140 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbc05f-f3fe-4212-8967-a238079cc117 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:48.462425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 532/1070] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:48.464963 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbc05f-f3fe-4212-8967-a238079cc117 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:48.527346 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b9f62-668f-4dd2-8b0e-617a2eb54035 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:48.528894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b9f62-668f-4dd2-8b0e-617a2eb54035 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:48.564619 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:48.567250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:48.581206 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbc05f-f3fe-4212-8967-a238079cc117 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:48.617186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df7818-eccf-4595-a933-7ff0388a4a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:48.617978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df7818-eccf-4595-a933-7ff0388a4a6c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:48.618256 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df7818-eccf-4595-a933-7ff0388a4a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:48.619260 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df7818-eccf-4595-a933-7ff0388a4a6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:48.631208 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df7818-eccf-4595-a933-7ff0388a4a6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:48.632705 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df7818-eccf-4595-a933-7ff0388a4a6c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:48.640278 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 539/1071] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:53:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 21:53:48.641629 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4cae9-6a82-4c6e-97b6-4ff49879218b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:48.641918 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4cae9-6a82-4c6e-97b6-4ff49879218b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:48.642195 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4cae9-6a82-4c6e-97b6-4ff49879218b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:48.652414 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-f5df7818-eccf-4595-a933-7ff0388a4a6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:48.652414 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:48.652414 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:48.652414 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:48.652414 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:48.652414 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:48.652414 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:48.652414 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:48.652414 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:48.652414 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:48.652414 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:48.652414 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:48.652414 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:53:48.652414 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:53:48.652414 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:53:48.653456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:53:48.653456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:48.653456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:48.653456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:48.653456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:48.653456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:48.653456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:48.653456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:48.653456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:48.653456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:48.653456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:48.653456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:48.653456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:48.653456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:48.653456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:48.653456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:48.653456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:48.654344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:53:48.654344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:53:48.654344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:48.654344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:48.654344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 533/1072] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:48.654634 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df7818-eccf-4595-a933-7ff0388a4a6c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:48.662927 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-7bd4cae9-6a82-4c6e-97b6-4ff49879218b None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:48.664125 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7bd4cae9-6a82-4c6e-97b6-4ff49879218b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:48.736641 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 540/1073] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:53:48.737745 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4cae9-6a82-4c6e-97b6-4ff49879218b None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:48.773704 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df7818-eccf-4595-a933-7ff0388a4a6c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:48.807766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:48.809689 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645ab96-760d-4b61-9b8e-627db939ea06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:48.810511 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645ab96-760d-4b61-9b8e-627db939ea06 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:48.810794 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645ab96-760d-4b61-9b8e-627db939ea06 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:48.811071 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645ab96-760d-4b61-9b8e-627db939ea06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:48.819660 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:48.827629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7645ab96-760d-4b61-9b8e-627db939ea06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:48.827629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7645ab96-760d-4b61-9b8e-627db939ea06 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:48.847570 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-7645ab96-760d-4b61-9b8e-627db939ea06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:48.847570 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:48.847570 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:48.847570 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:48.847570 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:48.847570 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:48.847570 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:48.847570 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:48.847570 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:48.847570 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:48.847570 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:48.847570 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:48.847570 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:53:48.847570 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:53:48.847570 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:53:48.848632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:53:48.848632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:48.848632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:48.848632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:48.848632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:48.848632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:48.848632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:48.848632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:48.848632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:48.848632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:48.848632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:48.848632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:48.848632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:48.848632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:48.848632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:48.848632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:48.848632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:48.849513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:53:48.849513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:53:48.849513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:48.849513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:48.849513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 534/1074] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:48.849788 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4cae9-6a82-4c6e-97b6-4ff49879218b None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:48.849870 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645ab96-760d-4b61-9b8e-627db939ea06 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:48.883674 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f3c66-43ab-4e30-a1da-297423f20308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:48.884903 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f3c66-43ab-4e30-a1da-297423f20308 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:48.885186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f3c66-43ab-4e30-a1da-297423f20308 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:48.885455 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f3c66-43ab-4e30-a1da-297423f20308 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:48.886170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f3c66-43ab-4e30-a1da-297423f20308 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:48.886472 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f3c66-43ab-4e30-a1da-297423f20308 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:48.887880 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f3c66-43ab-4e30-a1da-297423f20308 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:48.900880 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 541/1075] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:48.901730 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f3c66-43ab-4e30-a1da-297423f20308 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:48.961835 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645ab96-760d-4b61-9b8e-627db939ea06 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:48.998882 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b43ce3-377d-466d-bb7d-7105190393ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:48.999689 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b43ce3-377d-466d-bb7d-7105190393ef None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:48.999969 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b43ce3-377d-466d-bb7d-7105190393ef None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:49.000240 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b43ce3-377d-466d-bb7d-7105190393ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:49.006018 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f3c66-43ab-4e30-a1da-297423f20308 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:49.011689 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b43ce3-377d-466d-bb7d-7105190393ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:53:49.019165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-41b43ce3-377d-466d-bb7d-7105190393ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:53:49.019165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:49.019165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:49.019165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:49.019165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:49.019165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:49.019165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:49.019165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:49.019165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:49.019165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:49.019165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:49.019165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:49.019165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:53:49.019165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:53:49.019165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:53:49.019165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:53:49.020099 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:53:49.020099 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:53:49.020099 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:53:49.020099 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:53:49.020099 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:49.020099 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:49.020099 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:49.020099 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:49.020099 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:49.020099 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:49.020099 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:49.020099 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:49.020099 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:49.020099 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:49.020099 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:49.020099 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:49.020950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:49.020950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:49.020950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:49.020950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:49.020950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:53:49.020950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:53:49.020950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:53:49.020950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:53:49.020950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:53:49.020950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:53:49.020950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:53:49.020950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:49.020950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 535/1076] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:53:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:49.021733 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b43ce3-377d-466d-bb7d-7105190393ef None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:49.038811 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:49.047276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3e957-5d55-4ab8-b20b-e72714154bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:49.047979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3e957-5d55-4ab8-b20b-e72714154bfe None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:49.048259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3e957-5d55-4ab8-b20b-e72714154bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:49.048569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3e957-5d55-4ab8-b20b-e72714154bfe None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:49.049303 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3e957-5d55-4ab8-b20b-e72714154bfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:49.049606 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3e957-5d55-4ab8-b20b-e72714154bfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:49.051012 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3e957-5d55-4ab8-b20b-e72714154bfe None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:49.063693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 542/1077] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:49.064548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3e957-5d55-4ab8-b20b-e72714154bfe None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:49.089095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:49.154260 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b43ce3-377d-466d-bb7d-7105190393ef None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:49.193972 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641788fb-2e7f-4864-8bed-f3ea28171991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:49.194787 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641788fb-2e7f-4864-8bed-f3ea28171991 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:49.195067 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641788fb-2e7f-4864-8bed-f3ea28171991 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:49.195338 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641788fb-2e7f-4864-8bed-f3ea28171991 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:49.195541 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3e957-5d55-4ab8-b20b-e72714154bfe None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:49.204802 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641788fb-2e7f-4864-8bed-f3ea28171991 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:49.206018 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641788fb-2e7f-4864-8bed-f3ea28171991 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:49.221846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-641788fb-2e7f-4864-8bed-f3ea28171991 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:49.221846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:49.221846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:49.221846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:49.221846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:49.221846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:49.221846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:49.221846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:49.221846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:49.221846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:49.221846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:49.221846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:49.221846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:53:49.221846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:53:49.221846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:53:49.223001 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:53:49.223001 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:49.223001 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:49.223001 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:49.223001 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:49.223001 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:49.223001 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:49.223001 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:49.223001 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:49.223001 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:49.223001 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:49.223001 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:49.223001 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:49.223001 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:49.223001 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:49.223001 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:49.223001 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:49.223889 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:53:49.223889 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:53:49.223889 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:53:49.223889 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:53:49.223889 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:53:49.223889 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:53:49.223889 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:49.223889 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:49.223889 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 536/1078] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:53:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:49.229537 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641788fb-2e7f-4864-8bed-f3ea28171991 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:49.241535 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e8f3b-2b7f-49b7-97b5-c59b8f8e128b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:49.242223 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e8f3b-2b7f-49b7-97b5-c59b8f8e128b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:49.242502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e8f3b-2b7f-49b7-97b5-c59b8f8e128b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:49.242778 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e8f3b-2b7f-49b7-97b5-c59b8f8e128b None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:49.244387 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e8f3b-2b7f-49b7-97b5-c59b8f8e128b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:49.244979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e8f3b-2b7f-49b7-97b5-c59b8f8e128b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:49.246203 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e8f3b-2b7f-49b7-97b5-c59b8f8e128b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:49.259851 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 543/1079] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:53:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:49.266124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e8f3b-2b7f-49b7-97b5-c59b8f8e128b None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:49.339742 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:49.362508 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641788fb-2e7f-4864-8bed-f3ea28171991 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:49.383481 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:49.406192 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e8f3b-2b7f-49b7-97b5-c59b8f8e128b None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:49.412345 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae4ac6-0542-4e5b-9a99-734cb5d4ebc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:49.413086 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae4ac6-0542-4e5b-9a99-734cb5d4ebc0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:49.413373 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae4ac6-0542-4e5b-9a99-734cb5d4ebc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:49.413647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae4ac6-0542-4e5b-9a99-734cb5d4ebc0 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:49.415120 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae4ac6-0542-4e5b-9a99-734cb5d4ebc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:49.415972 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae4ac6-0542-4e5b-9a99-734cb5d4ebc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:49.418011 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae4ac6-0542-4e5b-9a99-734cb5d4ebc0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:49.430300 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 537/1080] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:53:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:49.436943 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae4ac6-0542-4e5b-9a99-734cb5d4ebc0 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:49.444824 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcfae1c-3355-4472-8833-e1f12bd7ea5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:49.445702 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfae1c-3355-4472-8833-e1f12bd7ea5c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:49.445982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfae1c-3355-4472-8833-e1f12bd7ea5c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:49.446254 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfae1c-3355-4472-8833-e1f12bd7ea5c None admin] PATH_INFO: `/v3/users/59ce4b3eab0d402f80fd0322c382db50` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:49.448249 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcfae1c-3355-4472-8833-e1f12bd7ea5c None admin] RBAC: Authorizing `identity:get_user(user_id=59ce4b3eab0d402f80fd0322c382db50)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:49.449755 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcfae1c-3355-4472-8833-e1f12bd7ea5c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:49.457067 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 544/1081] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:53:49 2022] GET /identity/v3/users/59ce4b3eab0d402f80fd0322c382db50 => generated 285 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:49.458306 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcfae1c-3355-4472-8833-e1f12bd7ea5c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:49.554594 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae4ac6-0542-4e5b-9a99-734cb5d4ebc0 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:49.582516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcfae1c-3355-4472-8833-e1f12bd7ea5c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:49.591382 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bdf65-cadb-432c-a125-be9503f8258e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:49.592269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bdf65-cadb-432c-a125-be9503f8258e None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:49.592584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bdf65-cadb-432c-a125-be9503f8258e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:49.592865 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bdf65-cadb-432c-a125-be9503f8258e None admin] PATH_INFO: `/v3/projects/89b20e18525c473e94a2b263148f1f5f/users/902ca8f1d59547a0ab187b4748311f58/roles/349b194bc80845e4a14c05f7cffcfe54` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:49.595133 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bdf65-cadb-432c-a125-be9503f8258e None admin] RBAC: Authorizing `identity:create_grant(project_id=89b20e18525c473e94a2b263148f1f5f, user_id=902ca8f1d59547a0ab187b4748311f58, role_id=349b194bc80845e4a14c05f7cffcfe54)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:49.596604 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bdf65-cadb-432c-a125-be9503f8258e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:49.605107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:49.611869 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 538/1082] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 21:53:49 2022] PUT /identity/v3/projects/89b20e18525c473e94a2b263148f1f5f/users/902ca8f1d59547a0ab187b4748311f58/roles/349b194bc80845e4a14c05f7cffcfe54 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 21:53:49.631190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e192763-f57a-4a2e-b492-32aece19c69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:49.632081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e192763-f57a-4a2e-b492-32aece19c69f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:49.632366 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e192763-f57a-4a2e-b492-32aece19c69f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:49.632684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e192763-f57a-4a2e-b492-32aece19c69f None admin] PATH_INFO: `/v3/projects/db9e71855c464daa9754686f96594b72` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:49.634035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e192763-f57a-4a2e-b492-32aece19c69f None admin] RBAC: Authorizing `identity:get_project(project_id=db9e71855c464daa9754686f96594b72)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:49.635693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e192763-f57a-4a2e-b492-32aece19c69f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:49.637550 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 545/1083] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:53:49 2022] GET /identity/v3/projects/db9e71855c464daa9754686f96594b72 => generated 311 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:49.644061 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bdf65-cadb-432c-a125-be9503f8258e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:49.695508 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:49.777933 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bdf65-cadb-432c-a125-be9503f8258e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:49.816764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290b6e3-9b70-4fe5-a123-092553417442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:49.817680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290b6e3-9b70-4fe5-a123-092553417442 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:49.817991 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290b6e3-9b70-4fe5-a123-092553417442 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:49.818259 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290b6e3-9b70-4fe5-a123-092553417442 None admin] PATH_INFO: `/v3/projects/db9e71855c464daa9754686f96594b72/users/59ce4b3eab0d402f80fd0322c382db50/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:49.820340 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290b6e3-9b70-4fe5-a123-092553417442 None admin] RBAC: Authorizing `identity:create_grant(project_id=db9e71855c464daa9754686f96594b72, user_id=59ce4b3eab0d402f80fd0322c382db50, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:49.822499 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290b6e3-9b70-4fe5-a123-092553417442 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:49.841900 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 539/1084] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 21:53:49 2022] PUT /identity/v3/projects/db9e71855c464daa9754686f96594b72/users/59ce4b3eab0d402f80fd0322c382db50/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:53:51.892152 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e3aa8-c749-42fb-8558-85f038d74ae6 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:51.892752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e3aa8-c749-42fb-8558-85f038d74ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:51.892752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e3aa8-c749-42fb-8558-85f038d74ae6 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:51.894075 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 546/1085] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:51.899436 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f862a7-d075-4e5a-bc9c-d55fefa12a99 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:51.899861 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f862a7-d075-4e5a-bc9c-d55fefa12a99 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:51.900158 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f862a7-d075-4e5a-bc9c-d55fefa12a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:51.918906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b0f862a7-d075-4e5a-bc9c-d55fefa12a99 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:51.920142 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b0f862a7-d075-4e5a-bc9c-d55fefa12a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:52.002237 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 540/1086] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:53:52.026703 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e3aa8-c749-42fb-8558-85f038d74ae6 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:52.115804 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c77cf-7eb1-4787-b6cc-dcfe6beb955f None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:52.116338 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c77cf-7eb1-4787-b6cc-dcfe6beb955f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:52.116649 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c77cf-7eb1-4787-b6cc-dcfe6beb955f None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:52.118009 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 541/1087] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:53:52.124043 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c8e9c-40c8-4863-bf44-00d0dec94aa8 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:52.124320 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c8e9c-40c8-4863-bf44-00d0dec94aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:52.124626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c8e9c-40c8-4863-bf44-00d0dec94aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:52.140947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-496c8e9c-40c8-4863-bf44-00d0dec94aa8 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:52.142125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-496c8e9c-40c8-4863-bf44-00d0dec94aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:52.147161 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e3aa8-c749-42fb-8558-85f038d74ae6 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:52.159500 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:52.186155 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c83bc1-88ef-4466-a4b8-3794e5b79dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:52.186960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c83bc1-88ef-4466-a4b8-3794e5b79dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:52.187242 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c83bc1-88ef-4466-a4b8-3794e5b79dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:52.187509 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c83bc1-88ef-4466-a4b8-3794e5b79dc2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:52.198558 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c83bc1-88ef-4466-a4b8-3794e5b79dc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:53:52.206744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-f7c83bc1-88ef-4466-a4b8-3794e5b79dc2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 21:53:52.206744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:52.206744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:52.206744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:52.206744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:52.206744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:52.206744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:52.206744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:52.206744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:52.206744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:52.206744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:52.206744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:52.206744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:53:52.206744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:53:52.206744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:53:52.206744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:53:52.207704 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:53:52.207704 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:53:52.207704 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:53:52.207704 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:53:52.207704 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:52.207704 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:52.207704 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:52.207704 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:52.207704 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:52.207704 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:52.207704 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:52.207704 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:52.207704 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:52.207704 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:52.207704 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:52.207704 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:52.208551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:52.208551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:52.208551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:52.208551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:52.208551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:53:52.208551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:53:52.208551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:53:52.208551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:53:52.208551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:53:52.208551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:53:52.208551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 21:53:52.208551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:52.208551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 547/1088] 10.222.0.35 () {56 vars in 1120 bytes} [Thu May 19 21:53:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:52.214574 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c83bc1-88ef-4466-a4b8-3794e5b79dc2 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:52.216108 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 542/1089] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:53:52.239531 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c8e9c-40c8-4863-bf44-00d0dec94aa8 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:52.262235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:52.320600 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c83bc1-88ef-4466-a4b8-3794e5b79dc2 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:52.350548 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c8e9c-40c8-4863-bf44-00d0dec94aa8 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:52.361147 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86389e9-eb7b-45b7-b984-d961ac4312c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:52.361821 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86389e9-eb7b-45b7-b984-d961ac4312c1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:52.362106 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86389e9-eb7b-45b7-b984-d961ac4312c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:52.362383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86389e9-eb7b-45b7-b984-d961ac4312c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:52.363130 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86389e9-eb7b-45b7-b984-d961ac4312c1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:52.363439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86389e9-eb7b-45b7-b984-d961ac4312c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:52.364876 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86389e9-eb7b-45b7-b984-d961ac4312c1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:52.375150 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 548/1090] 10.222.0.35 () {56 vars in 1115 bytes} [Thu May 19 21:53:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:52.380034 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86389e9-eb7b-45b7-b984-d961ac4312c1 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:52.395342 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7b083-9a95-46dd-9dec-694c87ae48cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:52.396168 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7b083-9a95-46dd-9dec-694c87ae48cd None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:52.396459 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7b083-9a95-46dd-9dec-694c87ae48cd None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:52.396799 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7b083-9a95-46dd-9dec-694c87ae48cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:52.408678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7b083-9a95-46dd-9dec-694c87ae48cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:53:52.416135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-43b7b083-9a95-46dd-9dec-694c87ae48cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:53:52.416135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:52.416135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:52.416135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:52.416135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:52.416135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:52.416135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:52.416135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:52.416135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:52.416135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:52.416135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:52.416135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:52.416135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:53:52.416135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:53:52.416135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:53:52.416135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:53:52.417167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:53:52.417167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:53:52.417167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:53:52.417167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:53:52.417167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:52.417167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:52.417167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:52.417167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:52.417167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:52.417167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:52.417167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:52.417167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:52.417167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:52.417167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:52.417167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:52.417167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:52.417997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:52.417997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:52.417997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:52.417997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:52.417997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:53:52.417997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:53:52.417997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:53:52.417997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:53:52.417997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:53:52.417997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:53:52.417997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:53:52.417997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:52.417997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 543/1091] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:53:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:53:52.423234 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7b083-9a95-46dd-9dec-694c87ae48cd None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:52.439738 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:52.496666 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86389e9-eb7b-45b7-b984-d961ac4312c1 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:52.503703 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:52.532527 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eec425-ad21-4b68-b687-3a813d64304f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:52.532761 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7b083-9a95-46dd-9dec-694c87ae48cd None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:52.533358 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eec425-ad21-4b68-b687-3a813d64304f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:52.533647 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eec425-ad21-4b68-b687-3a813d64304f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:52.533925 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eec425-ad21-4b68-b687-3a813d64304f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:52.545967 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eec425-ad21-4b68-b687-3a813d64304f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:52.547452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eec425-ad21-4b68-b687-3a813d64304f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:52.564685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-70eec425-ad21-4b68-b687-3a813d64304f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:52.564685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:52.564685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:52.564685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:52.564685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:52.564685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:52.564685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:52.564685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:52.564685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:52.564685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:52.564685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:52.564685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:52.564685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:53:52.564685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:53:52.564685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:53:52.566074 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:53:52.566074 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:52.566074 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:52.566074 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:52.566074 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:52.566074 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:52.566074 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:52.566074 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:52.566074 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:52.566074 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:52.566074 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:52.566074 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:52.566074 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:52.566074 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:52.566074 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:52.566074 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:52.566074 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:52.567398 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:53:52.567398 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:53:52.567398 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:52.567398 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:52.567398 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 549/1092] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:53:52.568708 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846270a-4d48-4187-8bd4-d035adfece62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:52.569498 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846270a-4d48-4187-8bd4-d035adfece62 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:52.569663 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846270a-4d48-4187-8bd4-d035adfece62 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:52.569915 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846270a-4d48-4187-8bd4-d035adfece62 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:52.570927 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846270a-4d48-4187-8bd4-d035adfece62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:52.571262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846270a-4d48-4187-8bd4-d035adfece62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:52.572027 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eec425-ad21-4b68-b687-3a813d64304f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:52.573253 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846270a-4d48-4187-8bd4-d035adfece62 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:52.590880 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 544/1093] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:53:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:52.596611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846270a-4d48-4187-8bd4-d035adfece62 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:52.676856 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:52.684693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eec425-ad21-4b68-b687-3a813d64304f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:52.706600 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846270a-4d48-4187-8bd4-d035adfece62 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:52.720879 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f0b83-6d73-4b33-959d-63500d1d9fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:52.721547 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f0b83-6d73-4b33-959d-63500d1d9fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:52.721830 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f0b83-6d73-4b33-959d-63500d1d9fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:52.722104 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f0b83-6d73-4b33-959d-63500d1d9fc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:52.722824 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f0b83-6d73-4b33-959d-63500d1d9fc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:52.723132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f0b83-6d73-4b33-959d-63500d1d9fc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:52.724538 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f0b83-6d73-4b33-959d-63500d1d9fc2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:52.736864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 550/1094] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:52.742700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f0b83-6d73-4b33-959d-63500d1d9fc2 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:52.742993 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b4f0f-fd8b-4e5e-bfd9-56fe61d8d61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:52.744599 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b4f0f-fd8b-4e5e-bfd9-56fe61d8d61b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:52.744883 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b4f0f-fd8b-4e5e-bfd9-56fe61d8d61b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:52.745169 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b4f0f-fd8b-4e5e-bfd9-56fe61d8d61b None admin] PATH_INFO: `/v3/users/59ce4b3eab0d402f80fd0322c382db50` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:52.746457 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b4f0f-fd8b-4e5e-bfd9-56fe61d8d61b None admin] RBAC: Authorizing `identity:get_user(user_id=59ce4b3eab0d402f80fd0322c382db50)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:52.747912 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b4f0f-fd8b-4e5e-bfd9-56fe61d8d61b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:52.749610 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 545/1095] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:53:52 2022] GET /identity/v3/users/59ce4b3eab0d402f80fd0322c382db50 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:52.755089 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b4f0f-fd8b-4e5e-bfd9-56fe61d8d61b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:52.763216 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:52.846461 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f0b83-6d73-4b33-959d-63500d1d9fc2 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:52.858446 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b4f0f-fd8b-4e5e-bfd9-56fe61d8d61b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:52.882075 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f915888-abb8-480e-aa22-b38c7bf6c8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:52.882869 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f915888-abb8-480e-aa22-b38c7bf6c8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:52.883152 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f915888-abb8-480e-aa22-b38c7bf6c8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:52.883430 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f915888-abb8-480e-aa22-b38c7bf6c8a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:52.891442 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f915888-abb8-480e-aa22-b38c7bf6c8a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:52.893097 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f915888-abb8-480e-aa22-b38c7bf6c8a5 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:52.895732 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e776da-d21f-4e29-bf43-a6cbe98a0a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:52.896396 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e776da-d21f-4e29-bf43-a6cbe98a0a3c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:52.896716 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e776da-d21f-4e29-bf43-a6cbe98a0a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:52.896995 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e776da-d21f-4e29-bf43-a6cbe98a0a3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:52.910932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:52.911689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-4f915888-abb8-480e-aa22-b38c7bf6c8a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 21:53:52.911689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:52.911689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:52.911689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:52.911689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:52.911689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:52.911689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:52.911689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:52.911689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:52.911689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:52.911689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:52.911689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:52.911689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:53:52.911689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:53:52.911689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:53:52.911689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:53:52.912588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:52.912588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:52.912588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:53:52.912588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:52.912588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:53:52.912588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:53:52.912588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:52.912588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:52.912588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:52.912588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:52.912588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:52.912588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:53:52.912588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:52.912588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:52.912588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:52.912588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:52.912588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:52.912588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:52.913655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:52.913655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:52.913655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:53:52.913655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:53:52.913655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:53:52.913655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:53:52.913655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:53:52.913655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:53:52.913655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 21:53:52.913655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:53:52.913655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 551/1096] 10.222.0.35 () {56 vars in 1093 bytes} [Thu May 19 21:53:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:53:52.918842 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f915888-abb8-480e-aa22-b38c7bf6c8a5 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:52.969759 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e776da-d21f-4e29-bf43-a6cbe98a0a3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:52.971217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e776da-d21f-4e29-bf43-a6cbe98a0a3c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:53.000599 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:53.024078 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f915888-abb8-480e-aa22-b38c7bf6c8a5 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:53.060175 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569848d4-7dc7-44be-90a8-619ab615e017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:53.060969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569848d4-7dc7-44be-90a8-619ab615e017 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:53.061252 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569848d4-7dc7-44be-90a8-619ab615e017 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:53.061531 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569848d4-7dc7-44be-90a8-619ab615e017 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:53.062379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569848d4-7dc7-44be-90a8-619ab615e017 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:53.062693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569848d4-7dc7-44be-90a8-619ab615e017 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:53.064139 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569848d4-7dc7-44be-90a8-619ab615e017 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:53.074805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 546/1097] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:53:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 21:53:53.080662 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e776da-d21f-4e29-bf43-a6cbe98a0a3c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:53.086042 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 552/1098] 10.222.0.35 () {56 vars in 1133 bytes} [Thu May 19 21:53:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:53.087137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569848d4-7dc7-44be-90a8-619ab615e017 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:53.128329 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:53.187828 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e776da-d21f-4e29-bf43-a6cbe98a0a3c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:53.190133 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569848d4-7dc7-44be-90a8-619ab615e017 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:53.235956 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51ab2f-228f-4d8a-8909-67147be6c6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:53.236564 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51ab2f-228f-4d8a-8909-67147be6c6cc None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:53.236852 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51ab2f-228f-4d8a-8909-67147be6c6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:53.237128 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51ab2f-228f-4d8a-8909-67147be6c6cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:53.240899 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:53.241383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55ee45-37cd-4f37-a83e-138b050d1f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:53.242329 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55ee45-37cd-4f37-a83e-138b050d1f08 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:53.242670 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55ee45-37cd-4f37-a83e-138b050d1f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:53.242875 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55ee45-37cd-4f37-a83e-138b050d1f08 None admin] PATH_INFO: `/v3/projects/db9e71855c464daa9754686f96594b72` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:53.244458 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55ee45-37cd-4f37-a83e-138b050d1f08 None admin] RBAC: Authorizing `identity:get_project(project_id=db9e71855c464daa9754686f96594b72)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:53.245908 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55ee45-37cd-4f37-a83e-138b050d1f08 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:53.247626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 547/1099] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:53:53 2022] GET /identity/v3/projects/db9e71855c464daa9754686f96594b72 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:53.253651 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55ee45-37cd-4f37-a83e-138b050d1f08 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:53.316361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51ab2f-228f-4d8a-8909-67147be6c6cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:53.317883 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51ab2f-228f-4d8a-8909-67147be6c6cc None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:53.360058 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55ee45-37cd-4f37-a83e-138b050d1f08 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:53.373029 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:53.398608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6c536-243b-491b-a627-4ed06aec3102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:53.399267 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6c536-243b-491b-a627-4ed06aec3102 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:53.399553 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6c536-243b-491b-a627-4ed06aec3102 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:53.399834 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6c536-243b-491b-a627-4ed06aec3102 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:53.400696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6c536-243b-491b-a627-4ed06aec3102 None admin] RBAC: Adding query filter params (role.id=04369f3c13174671a298fcd8175998d8, scope.project.id=db9e71855c464daa9754686f96594b72, user.id=59ce4b3eab0d402f80fd0322c382db50) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:53.401003 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6c536-243b-491b-a627-4ed06aec3102 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:53.402438 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6c536-243b-491b-a627-4ed06aec3102 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:53.408764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 548/1100] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:53:53 2022] GET /identity/v3/role_assignments?user.id=59ce4b3eab0d402f80fd0322c382db50&scope.project.id=db9e71855c464daa9754686f96594b72&role.id=04369f3c13174671a298fcd8175998d8 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:53.434732 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 553/1101] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:53:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:53:53.441060 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6c536-243b-491b-a627-4ed06aec3102 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:53.557760 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6c536-243b-491b-a627-4ed06aec3102 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:53.596910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac9c26-df29-4fa0-b8c0-6d48dbfcd555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:53.597724 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac9c26-df29-4fa0-b8c0-6d48dbfcd555 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:53.598010 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac9c26-df29-4fa0-b8c0-6d48dbfcd555 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:53.598289 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac9c26-df29-4fa0-b8c0-6d48dbfcd555 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:53.609262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac9c26-df29-4fa0-b8c0-6d48dbfcd555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:53.610727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac9c26-df29-4fa0-b8c0-6d48dbfcd555 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:53.630430 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-f9ac9c26-df29-4fa0-b8c0-6d48dbfcd555 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:53.630430 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:53.630430 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:53.630430 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:53.630430 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:53.630430 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:53.630430 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:53.630430 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:53.630430 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:53.630430 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:53.630430 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:53.630430 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:53.630430 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:53:53.630430 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:53:53.630430 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:53:53.631399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:53:53.631399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:53.631399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:53.631399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:53.631399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:53.631399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:53.631399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:53.631399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:53.631399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:53.631399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:53.631399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:53.631399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:53.631399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:53.631399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:53.631399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:53.631399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:53.631399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:53.632376 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:53:53.632376 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:53:53.632376 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:53:53.632376 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:53.632376 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 549/1102] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:53.638160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51ab2f-228f-4d8a-8909-67147be6c6cc None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:53.674289 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:53.744138 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51ab2f-228f-4d8a-8909-67147be6c6cc None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:53.778212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced876f7-963e-412f-b68c-9c0be56b98a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:53.778874 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced876f7-963e-412f-b68c-9c0be56b98a9 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:53.779153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced876f7-963e-412f-b68c-9c0be56b98a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:53.779420 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced876f7-963e-412f-b68c-9c0be56b98a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:53.780180 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced876f7-963e-412f-b68c-9c0be56b98a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:53.780612 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced876f7-963e-412f-b68c-9c0be56b98a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:53.781956 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced876f7-963e-412f-b68c-9c0be56b98a9 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:53.795219 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 554/1103] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:53.801159 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac9c26-df29-4fa0-b8c0-6d48dbfcd555 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:53.839128 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:53.913580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac9c26-df29-4fa0-b8c0-6d48dbfcd555 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:53.951806 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f8f38-6468-42f5-900c-9600bd18703a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:53.952645 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f8f38-6468-42f5-900c-9600bd18703a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:53.952933 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f8f38-6468-42f5-900c-9600bd18703a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:53.953214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f8f38-6468-42f5-900c-9600bd18703a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:53.960961 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f8f38-6468-42f5-900c-9600bd18703a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:53.963057 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f8f38-6468-42f5-900c-9600bd18703a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:53.976822 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-5e6f8f38-6468-42f5-900c-9600bd18703a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:53.976822 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:53:53.976822 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:53:53.976822 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:53:53.976822 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:53:53.976822 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:53:53.976822 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:53:53.976822 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:53:53.976822 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:53:53.976822 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:53:53.976822 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:53:53.976822 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:53:53.976822 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:53:53.976822 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:53:53.976822 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:53:53.978276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:53:53.978276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:53:53.978276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:53:53.978276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:53:53.978276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:53:53.978276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:53:53.978276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:53:53.978276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:53:53.978276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:53:53.978276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:53:53.978276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:53:53.978276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:53:53.978276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:53:53.978276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:53:53.978276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:53:53.978276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:53:53.978276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:53:53.979186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:53:53.979186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:53:53.979186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:53:53.979186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:53:53.979186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:53:53.979186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:53:53.979186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:53:53.979186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:53:53.980717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 550/1104] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:53:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:53:53.983937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced876f7-963e-412f-b68c-9c0be56b98a9 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:54.080026 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:54.086200 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced876f7-963e-412f-b68c-9c0be56b98a9 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:54.123718 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653de607-2102-479e-9087-c9be7c279419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:54.124288 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653de607-2102-479e-9087-c9be7c279419 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:54.124594 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653de607-2102-479e-9087-c9be7c279419 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:54.124868 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653de607-2102-479e-9087-c9be7c279419 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:54.125647 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653de607-2102-479e-9087-c9be7c279419 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:54.125953 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653de607-2102-479e-9087-c9be7c279419 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:54.127381 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653de607-2102-479e-9087-c9be7c279419 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:54.139859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 555/1105] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:53:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:54.146186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f8f38-6468-42f5-900c-9600bd18703a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:54.235643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:54.251570 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f8f38-6468-42f5-900c-9600bd18703a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:54.287170 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd00a2-e44a-4a57-a22f-843470bba2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:54.287825 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd00a2-e44a-4a57-a22f-843470bba2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:54.288156 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd00a2-e44a-4a57-a22f-843470bba2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:54.288456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd00a2-e44a-4a57-a22f-843470bba2c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:54.289289 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd00a2-e44a-4a57-a22f-843470bba2c2 None admin] RBAC: Adding query filter params (role.id=349b194bc80845e4a14c05f7cffcfe54, scope.project.id=89b20e18525c473e94a2b263148f1f5f, user.id=902ca8f1d59547a0ab187b4748311f58) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:54.289601 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd00a2-e44a-4a57-a22f-843470bba2c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:54.291150 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd00a2-e44a-4a57-a22f-843470bba2c2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:54.297142 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 551/1106] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:53:54 2022] GET /identity/v3/role_assignments?user.id=902ca8f1d59547a0ab187b4748311f58&scope.project.id=89b20e18525c473e94a2b263148f1f5f&role.id=349b194bc80845e4a14c05f7cffcfe54 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:53:55.717480 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf7da4-e3e7-44f9-bde1-aed819a9010d None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:55.718122 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf7da4-e3e7-44f9-bde1-aed819a9010d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:55.718122 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf7da4-e3e7-44f9-bde1-aed819a9010d None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:55.719374 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 556/1107] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:55.725043 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a45ba9-2799-4688-91e8-e7ff934e2330 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:55.725448 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a45ba9-2799-4688-91e8-e7ff934e2330 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:55.725617 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a45ba9-2799-4688-91e8-e7ff934e2330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:55.743870 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-77a45ba9-2799-4688-91e8-e7ff934e2330 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:55.745109 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-77a45ba9-2799-4688-91e8-e7ff934e2330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:55.823345 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 552/1108] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:53:55.849618 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf7da4-e3e7-44f9-bde1-aed819a9010d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:55.955177 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf7da4-e3e7-44f9-bde1-aed819a9010d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:55.990177 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a341f-e4e0-4371-b7ee-436aa0a1e0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:55.990891 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a341f-e4e0-4371-b7ee-436aa0a1e0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:55.991422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a341f-e4e0-4371-b7ee-436aa0a1e0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:55.991696 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a341f-e4e0-4371-b7ee-436aa0a1e0b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:55.992885 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a341f-e4e0-4371-b7ee-436aa0a1e0b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:55.995169 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a341f-e4e0-4371-b7ee-436aa0a1e0b3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:55.996800 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 557/1109] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:53:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:56.002604 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a45ba9-2799-4688-91e8-e7ff934e2330 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:56.083870 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:56.104265 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a45ba9-2799-4688-91e8-e7ff934e2330 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:56.139294 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f91239-1019-46ea-b94b-1e82a9a2f69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:56.139972 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f91239-1019-46ea-b94b-1e82a9a2f69b None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:56.140251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f91239-1019-46ea-b94b-1e82a9a2f69b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:56.140562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f91239-1019-46ea-b94b-1e82a9a2f69b None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:56.141269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f91239-1019-46ea-b94b-1e82a9a2f69b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:56.142688 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f91239-1019-46ea-b94b-1e82a9a2f69b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:56.162977 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 553/1110] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 21:53:56 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:53:58.481035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a944ac5-84d3-4e86-99c4-5c512b7ee618 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:58.481618 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a944ac5-84d3-4e86-99c4-5c512b7ee618 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:58.481618 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a944ac5-84d3-4e86-99c4-5c512b7ee618 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:58.482981 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 558/1111] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:53:58.488883 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e213ee-9862-40b9-83d9-e0426d61463d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:58.489395 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e213ee-9862-40b9-83d9-e0426d61463d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:58.489512 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e213ee-9862-40b9-83d9-e0426d61463d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:58.506372 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-d8e213ee-9862-40b9-83d9-e0426d61463d None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:53:58.507581 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d8e213ee-9862-40b9-83d9-e0426d61463d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:53:58.586156 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 554/1112] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:53:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:53:58.611220 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a944ac5-84d3-4e86-99c4-5c512b7ee618 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:58.639901 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:58.719267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a944ac5-84d3-4e86-99c4-5c512b7ee618 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:58.754317 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3761d1-0856-48da-92e8-64ef552edb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:58.755183 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3761d1-0856-48da-92e8-64ef552edb4e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:58.755469 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3761d1-0856-48da-92e8-64ef552edb4e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:58.755743 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3761d1-0856-48da-92e8-64ef552edb4e None admin] PATH_INFO: `/v3/roles/3fb2a96d6ee74a7dbd046488f5ec322b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:58.757399 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3761d1-0856-48da-92e8-64ef552edb4e None admin] RBAC: Authorizing `identity:get_role(role_id=3fb2a96d6ee74a7dbd046488f5ec322b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:58.758792 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3761d1-0856-48da-92e8-64ef552edb4e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:58.760829 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 559/1113] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:53:58 2022] GET /identity/v3/roles/3fb2a96d6ee74a7dbd046488f5ec322b => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:58.766808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e213ee-9862-40b9-83d9-e0426d61463d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:58.831819 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:58.871883 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e213ee-9862-40b9-83d9-e0426d61463d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:58.917873 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc1057-caee-4bea-a644-e4568cd4f07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:58.919133 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc1057-caee-4bea-a644-e4568cd4f07b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:58.919559 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc1057-caee-4bea-a644-e4568cd4f07b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:58.919974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc1057-caee-4bea-a644-e4568cd4f07b None admin] PATH_INFO: `/v3/users/c6dfff6e08224814ba7c11adcebabb43` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:58.937465 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc1057-caee-4bea-a644-e4568cd4f07b None admin] RBAC: Authorizing `identity:get_user(user_id=c6dfff6e08224814ba7c11adcebabb43)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:58.938903 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc1057-caee-4bea-a644-e4568cd4f07b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:58.940607 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 555/1114] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:53:58 2022] GET /identity/v3/users/c6dfff6e08224814ba7c11adcebabb43 => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:58.947104 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3761d1-0856-48da-92e8-64ef552edb4e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:59.041476 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:59.050293 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3761d1-0856-48da-92e8-64ef552edb4e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:59.088097 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2696c-2914-4149-ac8c-7cd24088e7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:59.088773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2696c-2914-4149-ac8c-7cd24088e7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:59.089059 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2696c-2914-4149-ac8c-7cd24088e7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:59.089339 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2696c-2914-4149-ac8c-7cd24088e7b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:59.158052 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2696c-2914-4149-ac8c-7cd24088e7b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:59.159537 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2696c-2914-4149-ac8c-7cd24088e7b6 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:59.253964 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:59.263725 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 560/1115] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:53:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:53:59.274460 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc1057-caee-4bea-a644-e4568cd4f07b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:59.379788 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc1057-caee-4bea-a644-e4568cd4f07b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:59.405006 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:59.416271 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058ae7b-eb2b-4324-afc7-30a0562e8ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:59.417156 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058ae7b-eb2b-4324-afc7-30a0562e8ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:59.417434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058ae7b-eb2b-4324-afc7-30a0562e8ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:59.417703 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058ae7b-eb2b-4324-afc7-30a0562e8ed2 None admin] PATH_INFO: `/v3/projects/db9e71855c464daa9754686f96594b72` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:59.418881 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058ae7b-eb2b-4324-afc7-30a0562e8ed2 None admin] RBAC: Authorizing `identity:get_project(project_id=db9e71855c464daa9754686f96594b72)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:59.420307 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058ae7b-eb2b-4324-afc7-30a0562e8ed2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:59.422020 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 556/1116] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:53:59 2022] GET /identity/v3/projects/db9e71855c464daa9754686f96594b72 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:53:59.428315 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2696c-2914-4149-ac8c-7cd24088e7b6 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:53:59.533577 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2696c-2914-4149-ac8c-7cd24088e7b6 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:53:59.567951 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86b265-6550-4a47-a1c3-0ed0b0e2f5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:53:59.568629 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86b265-6550-4a47-a1c3-0ed0b0e2f5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:53:59.568911 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86b265-6550-4a47-a1c3-0ed0b0e2f5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:53:59.569182 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86b265-6550-4a47-a1c3-0ed0b0e2f5d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:53:59.569997 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86b265-6550-4a47-a1c3-0ed0b0e2f5d5 None admin] RBAC: Adding query filter params (role.id=3fb2a96d6ee74a7dbd046488f5ec322b, scope.project.id=db9e71855c464daa9754686f96594b72, user.id=c6dfff6e08224814ba7c11adcebabb43) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:53:59.570312 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86b265-6550-4a47-a1c3-0ed0b0e2f5d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:53:59.571805 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86b265-6550-4a47-a1c3-0ed0b0e2f5d5 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:53:59.577436 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 561/1117] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:53:59 2022] GET /identity/v3/role_assignments?user.id=c6dfff6e08224814ba7c11adcebabb43&scope.project.id=db9e71855c464daa9754686f96594b72&role.id=3fb2a96d6ee74a7dbd046488f5ec322b => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:01.897236 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa491e-9024-4d26-8238-00c0bfefb518 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:01.897795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa491e-9024-4d26-8238-00c0bfefb518 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:01.897795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa491e-9024-4d26-8238-00c0bfefb518 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:01.899145 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 557/1118] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:54:01.904538 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ca54a-94af-416e-8f3f-170fc76ed0c5 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:01.905017 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ca54a-94af-416e-8f3f-170fc76ed0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:01.905109 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ca54a-94af-416e-8f3f-170fc76ed0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:01.922457 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-7e7ca54a-94af-416e-8f3f-170fc76ed0c5 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:54:01.923670 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7e7ca54a-94af-416e-8f3f-170fc76ed0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:54:01.976883 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:01.998247 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 562/1119] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:54:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:54:02.021123 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa491e-9024-4d26-8238-00c0bfefb518 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:02.125555 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa491e-9024-4d26-8238-00c0bfefb518 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:02.161137 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f081d-720f-40a1-aed6-3327794fa860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:02.161913 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f081d-720f-40a1-aed6-3327794fa860 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:02.162197 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f081d-720f-40a1-aed6-3327794fa860 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:02.162472 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f081d-720f-40a1-aed6-3327794fa860 None admin] PATH_INFO: `/v3/roles/3fb2a96d6ee74a7dbd046488f5ec322b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:02.163950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f081d-720f-40a1-aed6-3327794fa860 None admin] RBAC: Authorizing `identity:get_role(role_id=3fb2a96d6ee74a7dbd046488f5ec322b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:02.166062 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f081d-720f-40a1-aed6-3327794fa860 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:02.167442 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 558/1120] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:54:02 2022] GET /identity/v3/roles/3fb2a96d6ee74a7dbd046488f5ec322b => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:02.173316 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ca54a-94af-416e-8f3f-170fc76ed0c5 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:02.289446 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ca54a-94af-416e-8f3f-170fc76ed0c5 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:02.327691 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539936b3-1eaa-4826-bd4b-13cdf36db2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:02.328593 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539936b3-1eaa-4826-bd4b-13cdf36db2af None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:02.328881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539936b3-1eaa-4826-bd4b-13cdf36db2af None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:02.329159 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539936b3-1eaa-4826-bd4b-13cdf36db2af None admin] PATH_INFO: `/v3/users/c6dfff6e08224814ba7c11adcebabb43` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:02.330355 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539936b3-1eaa-4826-bd4b-13cdf36db2af None admin] RBAC: Authorizing `identity:get_user(user_id=c6dfff6e08224814ba7c11adcebabb43)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:02.331798 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539936b3-1eaa-4826-bd4b-13cdf36db2af None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:02.333485 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 563/1121] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:54:02 2022] GET /identity/v3/users/c6dfff6e08224814ba7c11adcebabb43 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:02.340907 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f081d-720f-40a1-aed6-3327794fa860 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:02.402976 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:02.443359 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f081d-720f-40a1-aed6-3327794fa860 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:02.479083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397ed6e-5cf0-4b0a-84fc-58d1a79502e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:02.479927 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397ed6e-5cf0-4b0a-84fc-58d1a79502e0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:02.480203 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397ed6e-5cf0-4b0a-84fc-58d1a79502e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:02.480506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397ed6e-5cf0-4b0a-84fc-58d1a79502e0 None admin] PATH_INFO: `/v3/projects/db9e71855c464daa9754686f96594b72` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:02.481675 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397ed6e-5cf0-4b0a-84fc-58d1a79502e0 None admin] RBAC: Authorizing `identity:get_project(project_id=db9e71855c464daa9754686f96594b72)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:02.483095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397ed6e-5cf0-4b0a-84fc-58d1a79502e0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:02.484798 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 559/1122] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:54:02 2022] GET /identity/v3/projects/db9e71855c464daa9754686f96594b72 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:02.490861 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539936b3-1eaa-4826-bd4b-13cdf36db2af None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:02.555879 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:02.605494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539936b3-1eaa-4826-bd4b-13cdf36db2af None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:02.649376 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6cd1e-b52a-40b6-a742-c6920ed761da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:02.650997 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6cd1e-b52a-40b6-a742-c6920ed761da None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:02.651281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6cd1e-b52a-40b6-a742-c6920ed761da None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:02.651560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6cd1e-b52a-40b6-a742-c6920ed761da None admin] PATH_INFO: `/v3/projects/db9e71855c464daa9754686f96594b72/users/c6dfff6e08224814ba7c11adcebabb43/roles/3fb2a96d6ee74a7dbd046488f5ec322b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:02.654000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6cd1e-b52a-40b6-a742-c6920ed761da None admin] RBAC: Authorizing `identity:create_grant(project_id=db9e71855c464daa9754686f96594b72, user_id=c6dfff6e08224814ba7c11adcebabb43, role_id=3fb2a96d6ee74a7dbd046488f5ec322b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:02.655491 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6cd1e-b52a-40b6-a742-c6920ed761da None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:02.680184 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 564/1123] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 21:54:02 2022] PUT /identity/v3/projects/db9e71855c464daa9754686f96594b72/users/c6dfff6e08224814ba7c11adcebabb43/roles/3fb2a96d6ee74a7dbd046488f5ec322b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:54:04.971461 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e039f-e2ac-4342-b05e-cad5ae42cb5a None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:04.971991 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e039f-e2ac-4342-b05e-cad5ae42cb5a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:04.971991 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e039f-e2ac-4342-b05e-cad5ae42cb5a None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:04.973418 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 560/1124] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:54:04.980075 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5669dd-b326-42bf-8802-2312d0031fbd None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:04.980575 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5669dd-b326-42bf-8802-2312d0031fbd None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:04.980667 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5669dd-b326-42bf-8802-2312d0031fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:04.999081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-1a5669dd-b326-42bf-8802-2312d0031fbd None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:54:05.000319 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1a5669dd-b326-42bf-8802-2312d0031fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:54:05.068087 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 565/1125] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:54:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:54:05.092326 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e039f-e2ac-4342-b05e-cad5ae42cb5a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:05.197227 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e039f-e2ac-4342-b05e-cad5ae42cb5a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:05.224221 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:05.232368 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0cb404-9b60-489e-bdfa-df3ea0be6025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:05.233259 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cb404-9b60-489e-bdfa-df3ea0be6025 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:05.233542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cb404-9b60-489e-bdfa-df3ea0be6025 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:05.233813 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cb404-9b60-489e-bdfa-df3ea0be6025 None admin] PATH_INFO: `/v3/roles/3fb2a96d6ee74a7dbd046488f5ec322b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:05.235300 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0cb404-9b60-489e-bdfa-df3ea0be6025 None admin] RBAC: Authorizing `identity:get_role(role_id=3fb2a96d6ee74a7dbd046488f5ec322b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:05.236713 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0cb404-9b60-489e-bdfa-df3ea0be6025 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:05.238088 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 561/1126] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:54:05 2022] GET /identity/v3/roles/3fb2a96d6ee74a7dbd046488f5ec322b => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:05.245005 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5669dd-b326-42bf-8802-2312d0031fbd None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:05.298397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:05.354581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5669dd-b326-42bf-8802-2312d0031fbd None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:05.396904 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5a105-7ab2-4b3d-811b-a5f1c283d771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:05.397774 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5a105-7ab2-4b3d-811b-a5f1c283d771 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:05.398060 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5a105-7ab2-4b3d-811b-a5f1c283d771 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:05.398335 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5a105-7ab2-4b3d-811b-a5f1c283d771 None admin] PATH_INFO: `/v3/users/c6dfff6e08224814ba7c11adcebabb43` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:05.399583 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5a105-7ab2-4b3d-811b-a5f1c283d771 None admin] RBAC: Authorizing `identity:get_user(user_id=c6dfff6e08224814ba7c11adcebabb43)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:05.401282 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5a105-7ab2-4b3d-811b-a5f1c283d771 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:05.402921 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 566/1127] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:54:05 2022] GET /identity/v3/users/c6dfff6e08224814ba7c11adcebabb43 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:05.408896 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0cb404-9b60-489e-bdfa-df3ea0be6025 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:05.511161 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0cb404-9b60-489e-bdfa-df3ea0be6025 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:05.546621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb3dcb-d59e-4050-b68c-35b71cc95539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:05.547268 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb3dcb-d59e-4050-b68c-35b71cc95539 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:05.547553 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb3dcb-d59e-4050-b68c-35b71cc95539 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:05.547983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb3dcb-d59e-4050-b68c-35b71cc95539 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:05.618286 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:05.627806 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb3dcb-d59e-4050-b68c-35b71cc95539 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:05.629298 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb3dcb-d59e-4050-b68c-35b71cc95539 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:05.738999 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 562/1128] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:54:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:54:05.746055 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5a105-7ab2-4b3d-811b-a5f1c283d771 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:05.858429 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5a105-7ab2-4b3d-811b-a5f1c283d771 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:05.871819 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:05.902763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c033ac-3b0a-4d58-9681-82c2d9510596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:05.903615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c033ac-3b0a-4d58-9681-82c2d9510596 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:05.903904 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c033ac-3b0a-4d58-9681-82c2d9510596 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:05.904183 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c033ac-3b0a-4d58-9681-82c2d9510596 None admin] PATH_INFO: `/v3/projects/db9e71855c464daa9754686f96594b72` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:05.905399 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c033ac-3b0a-4d58-9681-82c2d9510596 None admin] RBAC: Authorizing `identity:get_project(project_id=db9e71855c464daa9754686f96594b72)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:05.906844 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c033ac-3b0a-4d58-9681-82c2d9510596 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:05.908571 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 567/1129] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:54:05 2022] GET /identity/v3/projects/db9e71855c464daa9754686f96594b72 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:05.914655 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb3dcb-d59e-4050-b68c-35b71cc95539 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:06.015423 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:06.021651 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb3dcb-d59e-4050-b68c-35b71cc95539 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:06.057333 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb942b-077f-4960-bd58-04a060cece3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:06.057988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb942b-077f-4960-bd58-04a060cece3f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:06.058266 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb942b-077f-4960-bd58-04a060cece3f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:06.058537 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb942b-077f-4960-bd58-04a060cece3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:06.059361 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb942b-077f-4960-bd58-04a060cece3f None admin] RBAC: Adding query filter params (role.id=3fb2a96d6ee74a7dbd046488f5ec322b, scope.project.id=db9e71855c464daa9754686f96594b72, user.id=c6dfff6e08224814ba7c11adcebabb43) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:54:06.059685 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb942b-077f-4960-bd58-04a060cece3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:06.061107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb942b-077f-4960-bd58-04a060cece3f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:06.066805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 563/1130] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:54:05 2022] GET /identity/v3/role_assignments?user.id=c6dfff6e08224814ba7c11adcebabb43&scope.project.id=db9e71855c464daa9754686f96594b72&role.id=3fb2a96d6ee74a7dbd046488f5ec322b => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:08.358025 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea127d8-900e-4e33-be4a-641dc7ac5e11 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:08.358580 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea127d8-900e-4e33-be4a-641dc7ac5e11 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:08.358580 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea127d8-900e-4e33-be4a-641dc7ac5e11 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:08.359944 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 568/1131] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:54:08.365187 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139acd49-447d-49d0-ad5a-f78b9aa8e54f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:08.365603 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139acd49-447d-49d0-ad5a-f78b9aa8e54f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:08.365747 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139acd49-447d-49d0-ad5a-f78b9aa8e54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:08.383261 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-139acd49-447d-49d0-ad5a-f78b9aa8e54f None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:54:08.385267 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-139acd49-447d-49d0-ad5a-f78b9aa8e54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:54:08.457402 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 564/1132] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:54:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:54:08.481206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea127d8-900e-4e33-be4a-641dc7ac5e11 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:08.584022 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea127d8-900e-4e33-be4a-641dc7ac5e11 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:08.620906 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5644c-c31c-43f9-b416-162eb35e3824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:08.621612 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5644c-c31c-43f9-b416-162eb35e3824 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:08.621893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5644c-c31c-43f9-b416-162eb35e3824 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:08.622164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5644c-c31c-43f9-b416-162eb35e3824 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:08.623326 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5644c-c31c-43f9-b416-162eb35e3824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:08.624785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5644c-c31c-43f9-b416-162eb35e3824 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:08.626441 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 569/1133] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:54:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:08.632386 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139acd49-447d-49d0-ad5a-f78b9aa8e54f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:08.734499 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:08.745777 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139acd49-447d-49d0-ad5a-f78b9aa8e54f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:08.784558 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f969cc1-533c-4591-ac59-fb8b07cadca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:08.785219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f969cc1-533c-4591-ac59-fb8b07cadca8 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:08.785506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f969cc1-533c-4591-ac59-fb8b07cadca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:08.785786 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f969cc1-533c-4591-ac59-fb8b07cadca8 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:08.786491 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f969cc1-533c-4591-ac59-fb8b07cadca8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:08.787918 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f969cc1-533c-4591-ac59-fb8b07cadca8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:08.823070 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 565/1134] 10.222.0.35 () {60 vars in 1141 bytes} [Thu May 19 21:54:08 2022] POST /identity/v3/projects => generated 311 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:54:11.111665 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379c1c3-5ad7-4114-b398-7b2b725bc4d1 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:11.112303 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379c1c3-5ad7-4114-b398-7b2b725bc4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:11.112303 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379c1c3-5ad7-4114-b398-7b2b725bc4d1 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:11.113630 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 570/1135] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:54:11.119651 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a300e-4b8c-426f-b9e7-07ed10e1ac23 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:11.120075 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a300e-4b8c-426f-b9e7-07ed10e1ac23 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:11.120203 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a300e-4b8c-426f-b9e7-07ed10e1ac23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:11.137643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-e26a300e-4b8c-426f-b9e7-07ed10e1ac23 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:54:11.138850 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e26a300e-4b8c-426f-b9e7-07ed10e1ac23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:54:11.206657 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 566/1136] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:54:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:54:11.230845 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379c1c3-5ad7-4114-b398-7b2b725bc4d1 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:11.283388 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:11.346304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379c1c3-5ad7-4114-b398-7b2b725bc4d1 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:11.383264 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8d648-398f-4d4b-b513-78eaf53bbaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:11.384695 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8d648-398f-4d4b-b513-78eaf53bbaa7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:11.385068 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8d648-398f-4d4b-b513-78eaf53bbaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:11.385353 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8d648-398f-4d4b-b513-78eaf53bbaa7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:11.386542 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8d648-398f-4d4b-b513-78eaf53bbaa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:11.387982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8d648-398f-4d4b-b513-78eaf53bbaa7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:11.389661 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 571/1137] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:54:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:11.395398 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a300e-4b8c-426f-b9e7-07ed10e1ac23 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:11.468540 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:11.499292 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a300e-4b8c-426f-b9e7-07ed10e1ac23 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:11.534221 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c771f-da73-4f8b-a2b6-ef1d895d9ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:11.534893 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c771f-da73-4f8b-a2b6-ef1d895d9ec2 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:11.535179 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c771f-da73-4f8b-a2b6-ef1d895d9ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:11.535458 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c771f-da73-4f8b-a2b6-ef1d895d9ec2 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:11.536167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c771f-da73-4f8b-a2b6-ef1d895d9ec2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:11.537629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c771f-da73-4f8b-a2b6-ef1d895d9ec2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:11.558921 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 567/1138] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 21:54:11 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:54:13.913521 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d648f7b-b469-4dd8-9cac-2cf235703edb None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:13.914083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d648f7b-b469-4dd8-9cac-2cf235703edb None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:13.914083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d648f7b-b469-4dd8-9cac-2cf235703edb None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:13.915993 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 572/1139] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:54:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:54:13.921434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d401ab-07d2-4b1a-893d-a00c51369871 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:13.921868 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d401ab-07d2-4b1a-893d-a00c51369871 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:13.921978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d401ab-07d2-4b1a-893d-a00c51369871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:13.939451 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-59d401ab-07d2-4b1a-893d-a00c51369871 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:54:13.940678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-59d401ab-07d2-4b1a-893d-a00c51369871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:54:14.013525 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 568/1140] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:54:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:54:14.037832 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d648f7b-b469-4dd8-9cac-2cf235703edb None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:14.142807 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d648f7b-b469-4dd8-9cac-2cf235703edb None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:14.169452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:14.187656 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715a2dc-0126-43d2-87e8-69a31a6f4ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:14.188481 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715a2dc-0126-43d2-87e8-69a31a6f4ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:14.188761 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715a2dc-0126-43d2-87e8-69a31a6f4ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:14.189033 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715a2dc-0126-43d2-87e8-69a31a6f4ac6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:14.198952 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715a2dc-0126-43d2-87e8-69a31a6f4ac6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:54:14.206504 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-c715a2dc-0126-43d2-87e8-69a31a6f4ac6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:54:14.206504 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:54:14.206504 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:54:14.206504 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:54:14.206504 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:54:14.206504 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:54:14.206504 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:54:14.206504 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:54:14.206504 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:54:14.206504 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:54:14.206504 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:54:14.206504 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:54:14.206504 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:54:14.206504 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:54:14.206504 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:54:14.206504 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:54:14.207710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:54:14.207710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:54:14.207710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:54:14.207710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:54:14.207710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:54:14.207710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:54:14.207710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:54:14.207710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:54:14.207710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:54:14.207710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:54:14.207710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:54:14.207710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:54:14.207710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:54:14.207710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:54:14.207710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:54:14.207710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:54:14.208835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:54:14.208835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:54:14.208835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:54:14.208835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:54:14.208835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:54:14.208835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:54:14.208835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:54:14.208835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:54:14.208835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:54:14.208835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:54:14.208835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:54:14.208835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:54:14.208835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 573/1141] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:54:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:54:14.214976 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d401ab-07d2-4b1a-893d-a00c51369871 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:14.281971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:14.334935 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d401ab-07d2-4b1a-893d-a00c51369871 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:14.379012 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f96ab-ac43-49ca-b71f-476de353cc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:14.379692 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f96ab-ac43-49ca-b71f-476de353cc80 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:14.379976 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f96ab-ac43-49ca-b71f-476de353cc80 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:14.380252 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f96ab-ac43-49ca-b71f-476de353cc80 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:14.381043 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f96ab-ac43-49ca-b71f-476de353cc80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:54:14.381351 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f96ab-ac43-49ca-b71f-476de353cc80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:14.382721 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f96ab-ac43-49ca-b71f-476de353cc80 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:14.391669 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 569/1142] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:54:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:14.397578 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715a2dc-0126-43d2-87e8-69a31a6f4ac6 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:14.507995 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715a2dc-0126-43d2-87e8-69a31a6f4ac6 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:14.543681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079d123-f33d-4233-8dcf-26e66726f2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:14.544667 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079d123-f33d-4233-8dcf-26e66726f2ea None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:14.544950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079d123-f33d-4233-8dcf-26e66726f2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:14.545251 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079d123-f33d-4233-8dcf-26e66726f2ea None admin] PATH_INFO: `/v3/users/7a59636450ae459a87d1f85883a8d30b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:14.558198 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079d123-f33d-4233-8dcf-26e66726f2ea None admin] RBAC: Authorizing `identity:get_user(user_id=7a59636450ae459a87d1f85883a8d30b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:14.559665 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079d123-f33d-4233-8dcf-26e66726f2ea None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:14.561352 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 574/1143] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:54:14 2022] GET /identity/v3/users/7a59636450ae459a87d1f85883a8d30b => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:14.567246 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f96ab-ac43-49ca-b71f-476de353cc80 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:14.673967 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f96ab-ac43-49ca-b71f-476de353cc80 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:14.695918 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:14.711133 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f22465-05c8-4664-9db1-f0367b008a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:14.711787 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f22465-05c8-4664-9db1-f0367b008a66 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:14.712650 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f22465-05c8-4664-9db1-f0367b008a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:14.712930 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f22465-05c8-4664-9db1-f0367b008a66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:14.781597 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f22465-05c8-4664-9db1-f0367b008a66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:14.782956 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f22465-05c8-4664-9db1-f0367b008a66 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:14.880811 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 570/1144] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:54:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:54:14.887850 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079d123-f33d-4233-8dcf-26e66726f2ea None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:14.922518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:14.989507 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079d123-f33d-4233-8dcf-26e66726f2ea None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:15.024973 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af7c20-cc79-4aff-9771-3e2e7c05ec87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:15.025812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af7c20-cc79-4aff-9771-3e2e7c05ec87 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:15.026090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af7c20-cc79-4aff-9771-3e2e7c05ec87 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:15.026361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af7c20-cc79-4aff-9771-3e2e7c05ec87 None admin] PATH_INFO: `/v3/projects/81cc7840189242dc9cfd3d71c7df500d` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:15.027538 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af7c20-cc79-4aff-9771-3e2e7c05ec87 None admin] RBAC: Authorizing `identity:get_project(project_id=81cc7840189242dc9cfd3d71c7df500d)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:15.028991 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af7c20-cc79-4aff-9771-3e2e7c05ec87 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:15.030673 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 575/1145] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:54:14 2022] GET /identity/v3/projects/81cc7840189242dc9cfd3d71c7df500d => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:54:15.037060 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f22465-05c8-4664-9db1-f0367b008a66 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:15.059540 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:15.147671 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f22465-05c8-4664-9db1-f0367b008a66 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:15.184632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8919447-ff1e-4918-b222-ac3861a384e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:15.185292 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8919447-ff1e-4918-b222-ac3861a384e3 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:15.185578 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8919447-ff1e-4918-b222-ac3861a384e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:15.185855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8919447-ff1e-4918-b222-ac3861a384e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:15.186698 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8919447-ff1e-4918-b222-ac3861a384e3 None admin] RBAC: Adding query filter params (role.id=04369f3c13174671a298fcd8175998d8, scope.project.id=81cc7840189242dc9cfd3d71c7df500d, user.id=7a59636450ae459a87d1f85883a8d30b) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:54:15.187013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8919447-ff1e-4918-b222-ac3861a384e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:15.188503 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8919447-ff1e-4918-b222-ac3861a384e3 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:15.193913 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 571/1146] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:54:15 2022] GET /identity/v3/role_assignments?user.id=7a59636450ae459a87d1f85883a8d30b&scope.project.id=81cc7840189242dc9cfd3d71c7df500d&role.id=04369f3c13174671a298fcd8175998d8 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:17.457106 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a1d98-dd21-4e8d-bbab-869f3ea05f54 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:17.457635 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a1d98-dd21-4e8d-bbab-869f3ea05f54 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:17.457751 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a1d98-dd21-4e8d-bbab-869f3ea05f54 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:17.459044 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 576/1147] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:54:17.465176 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace3b70-e563-48b9-ba3a-422b89c81eea None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:17.465615 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace3b70-e563-48b9-ba3a-422b89c81eea None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:17.465708 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace3b70-e563-48b9-ba3a-422b89c81eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:17.482128 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6ace3b70-e563-48b9-ba3a-422b89c81eea None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:54:17.483289 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6ace3b70-e563-48b9-ba3a-422b89c81eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:54:17.552107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 572/1148] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:54:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:54:17.575289 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a1d98-dd21-4e8d-bbab-869f3ea05f54 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:17.680672 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a1d98-dd21-4e8d-bbab-869f3ea05f54 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:17.682360 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:17.718310 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b3db3-4e03-4994-a5b0-c115ee859754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:17.719108 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b3db3-4e03-4994-a5b0-c115ee859754 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:17.719397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b3db3-4e03-4994-a5b0-c115ee859754 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:17.719677 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b3db3-4e03-4994-a5b0-c115ee859754 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:17.730431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b3db3-4e03-4994-a5b0-c115ee859754 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:54:17.738065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-a88b3db3-4e03-4994-a5b0-c115ee859754 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:54:17.738065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:54:17.738065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:54:17.738065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:54:17.738065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:54:17.738065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:54:17.738065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:54:17.738065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:54:17.738065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:54:17.738065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:54:17.738065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:54:17.738065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:54:17.738065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:54:17.738065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:54:17.738065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:54:17.738065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:54:17.739162 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:54:17.739162 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:54:17.739162 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:54:17.739162 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:54:17.739162 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:54:17.739162 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:54:17.739162 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:54:17.739162 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:54:17.739162 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:54:17.739162 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:54:17.739162 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:54:17.739162 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:54:17.739162 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:54:17.739162 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:54:17.739162 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:54:17.739162 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:54:17.740191 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:54:17.740191 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:54:17.740191 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:54:17.740191 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:54:17.740191 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:54:17.740191 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:54:17.740191 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:54:17.740191 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:54:17.740191 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:54:17.740191 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:54:17.740191 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:54:17.740191 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:54:17.740191 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 577/1149] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:54:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:54:17.754074 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace3b70-e563-48b9-ba3a-422b89c81eea None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:17.769874 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:17.854631 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace3b70-e563-48b9-ba3a-422b89c81eea None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:17.890385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676841ff-471a-43b5-9639-f76c6d299681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:17.891039 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676841ff-471a-43b5-9639-f76c6d299681 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:17.891316 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676841ff-471a-43b5-9639-f76c6d299681 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:17.891588 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676841ff-471a-43b5-9639-f76c6d299681 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:17.892327 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676841ff-471a-43b5-9639-f76c6d299681 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:54:17.892663 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676841ff-471a-43b5-9639-f76c6d299681 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:17.894026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676841ff-471a-43b5-9639-f76c6d299681 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:17.902064 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 573/1150] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:54:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:17.908316 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b3db3-4e03-4994-a5b0-c115ee859754 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:18.008807 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b3db3-4e03-4994-a5b0-c115ee859754 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:18.044464 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e84739-fc71-4890-b483-7e671500ed58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:18.045353 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e84739-fc71-4890-b483-7e671500ed58 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:18.045645 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e84739-fc71-4890-b483-7e671500ed58 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:18.045924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e84739-fc71-4890-b483-7e671500ed58 None admin] PATH_INFO: `/v3/users/7a59636450ae459a87d1f85883a8d30b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:18.047153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e84739-fc71-4890-b483-7e671500ed58 None admin] RBAC: Authorizing `identity:get_user(user_id=7a59636450ae459a87d1f85883a8d30b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:18.048627 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e84739-fc71-4890-b483-7e671500ed58 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:18.050281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 578/1151] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:54:17 2022] GET /identity/v3/users/7a59636450ae459a87d1f85883a8d30b => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:18.057288 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676841ff-471a-43b5-9639-f76c6d299681 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:18.151264 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:18.176171 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676841ff-471a-43b5-9639-f76c6d299681 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:18.210153 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa8026-2e60-4934-aab3-cfccd288b8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:18.211000 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa8026-2e60-4934-aab3-cfccd288b8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:18.211278 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa8026-2e60-4934-aab3-cfccd288b8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:18.211548 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa8026-2e60-4934-aab3-cfccd288b8d2 None admin] PATH_INFO: `/v3/projects/81cc7840189242dc9cfd3d71c7df500d` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:18.212970 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa8026-2e60-4934-aab3-cfccd288b8d2 None admin] RBAC: Authorizing `identity:get_project(project_id=81cc7840189242dc9cfd3d71c7df500d)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:18.214434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa8026-2e60-4934-aab3-cfccd288b8d2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:18.216198 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 574/1152] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:54:18 2022] GET /identity/v3/projects/81cc7840189242dc9cfd3d71c7df500d => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:18.222287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e84739-fc71-4890-b483-7e671500ed58 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:18.254404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:18.329537 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e84739-fc71-4890-b483-7e671500ed58 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:18.363221 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40250b1a-1982-49db-9551-09a9c4a9104e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:18.364122 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40250b1a-1982-49db-9551-09a9c4a9104e None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:18.364432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40250b1a-1982-49db-9551-09a9c4a9104e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:18.364717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40250b1a-1982-49db-9551-09a9c4a9104e None admin] PATH_INFO: `/v3/projects/81cc7840189242dc9cfd3d71c7df500d/users/7a59636450ae459a87d1f85883a8d30b/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:18.366978 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40250b1a-1982-49db-9551-09a9c4a9104e None admin] RBAC: Authorizing `identity:create_grant(project_id=81cc7840189242dc9cfd3d71c7df500d, user_id=7a59636450ae459a87d1f85883a8d30b, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:18.369567 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40250b1a-1982-49db-9551-09a9c4a9104e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:18.385305 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 579/1153] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 21:54:18 2022] PUT /identity/v3/projects/81cc7840189242dc9cfd3d71c7df500d/users/7a59636450ae459a87d1f85883a8d30b/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:54:20.742581 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204e90b-6df5-405a-b9f2-351930abd3f2 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:20.743139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204e90b-6df5-405a-b9f2-351930abd3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:20.743139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204e90b-6df5-405a-b9f2-351930abd3f2 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:20.745173 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 575/1154] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:54:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:54:20.750431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07111f32-7560-44ca-ae9a-7b60f6617925 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:20.750821 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07111f32-7560-44ca-ae9a-7b60f6617925 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:20.751003 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07111f32-7560-44ca-ae9a-7b60f6617925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:20.767851 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-07111f32-7560-44ca-ae9a-7b60f6617925 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:54:20.769123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-07111f32-7560-44ca-ae9a-7b60f6617925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:54:20.838542 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 580/1155] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:54:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:54:20.862169 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204e90b-6df5-405a-b9f2-351930abd3f2 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:20.966826 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204e90b-6df5-405a-b9f2-351930abd3f2 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:21.011126 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cb0e2-d944-489f-9666-7c00294cd434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:21.011843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cb0e2-d944-489f-9666-7c00294cd434 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:21.012124 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cb0e2-d944-489f-9666-7c00294cd434 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:21.012396 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cb0e2-d944-489f-9666-7c00294cd434 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:21.022754 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8cb0e2-d944-489f-9666-7c00294cd434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:54:21.031322 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-7d8cb0e2-d944-489f-9666-7c00294cd434 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:54:21.031322 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:54:21.031322 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:54:21.031322 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:54:21.031322 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:54:21.031322 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:54:21.031322 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:54:21.031322 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:54:21.031322 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:54:21.031322 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:54:21.031322 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:54:21.031322 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:54:21.031322 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:54:21.031322 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:54:21.031322 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:54:21.031322 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:54:21.032552 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:54:21.032552 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:54:21.032552 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:54:21.032552 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:54:21.032552 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:54:21.032552 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:54:21.032552 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:54:21.032552 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:54:21.032552 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:54:21.032552 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:54:21.032552 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:54:21.032552 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:54:21.032552 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:54:21.032552 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:54:21.032552 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:54:21.032552 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:54:21.033460 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:54:21.033460 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:54:21.033460 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:54:21.033460 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:54:21.033460 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:54:21.033460 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:54:21.033460 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:54:21.033460 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:54:21.033460 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:54:21.033460 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:54:21.033460 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:54:21.033460 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:54:21.033460 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 576/1156] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:54:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:54:21.038705 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07111f32-7560-44ca-ae9a-7b60f6617925 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:21.060351 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:21.149057 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07111f32-7560-44ca-ae9a-7b60f6617925 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:21.183335 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ee9a5-8d34-4e77-b131-174634145733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:21.184017 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ee9a5-8d34-4e77-b131-174634145733 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:21.184303 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ee9a5-8d34-4e77-b131-174634145733 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:21.184616 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ee9a5-8d34-4e77-b131-174634145733 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:21.185405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ee9a5-8d34-4e77-b131-174634145733 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:54:21.185709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ee9a5-8d34-4e77-b131-174634145733 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:21.187124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ee9a5-8d34-4e77-b131-174634145733 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:21.196145 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 581/1157] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:54:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:21.202589 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cb0e2-d944-489f-9666-7c00294cd434 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:21.206386 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:21.314093 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cb0e2-d944-489f-9666-7c00294cd434 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:21.350969 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d367dd-b65d-4cbd-92bd-1094142b24fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:21.351838 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d367dd-b65d-4cbd-92bd-1094142b24fa None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:21.352118 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d367dd-b65d-4cbd-92bd-1094142b24fa None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:21.352392 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d367dd-b65d-4cbd-92bd-1094142b24fa None admin] PATH_INFO: `/v3/users/7a59636450ae459a87d1f85883a8d30b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:21.354552 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d367dd-b65d-4cbd-92bd-1094142b24fa None admin] RBAC: Authorizing `identity:get_user(user_id=7a59636450ae459a87d1f85883a8d30b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:21.355979 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d367dd-b65d-4cbd-92bd-1094142b24fa None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:21.357646 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 577/1158] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:54:21 2022] GET /identity/v3/users/7a59636450ae459a87d1f85883a8d30b => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:21.363357 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ee9a5-8d34-4e77-b131-174634145733 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:21.447592 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:21.467434 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ee9a5-8d34-4e77-b131-174634145733 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:21.500799 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9392372-f3b1-446d-9dfa-59cba08d0b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:21.501468 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9392372-f3b1-446d-9dfa-59cba08d0b9f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:21.501757 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9392372-f3b1-446d-9dfa-59cba08d0b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:21.502038 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9392372-f3b1-446d-9dfa-59cba08d0b9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:21.574897 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9392372-f3b1-446d-9dfa-59cba08d0b9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:21.576269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9392372-f3b1-446d-9dfa-59cba08d0b9f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:21.658237 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:21.678287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 582/1159] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:54:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:54:21.684993 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d367dd-b65d-4cbd-92bd-1094142b24fa None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:21.757111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:21.787601 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d367dd-b65d-4cbd-92bd-1094142b24fa None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:21.822845 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d28b8c-0c7c-4ad6-8632-394552603fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:21.823704 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d28b8c-0c7c-4ad6-8632-394552603fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:21.823982 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d28b8c-0c7c-4ad6-8632-394552603fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:21.824254 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d28b8c-0c7c-4ad6-8632-394552603fa8 None admin] PATH_INFO: `/v3/projects/81cc7840189242dc9cfd3d71c7df500d` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:21.825548 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d28b8c-0c7c-4ad6-8632-394552603fa8 None admin] RBAC: Authorizing `identity:get_project(project_id=81cc7840189242dc9cfd3d71c7df500d)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:21.826922 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d28b8c-0c7c-4ad6-8632-394552603fa8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:21.828646 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 578/1160] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:54:21 2022] GET /identity/v3/projects/81cc7840189242dc9cfd3d71c7df500d => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:21.834755 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9392372-f3b1-446d-9dfa-59cba08d0b9f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:21.945378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9392372-f3b1-446d-9dfa-59cba08d0b9f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:21.988307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ba8cd-c33c-4499-bfa3-0f1666489f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:21.989034 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ba8cd-c33c-4499-bfa3-0f1666489f8f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:21.989280 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ba8cd-c33c-4499-bfa3-0f1666489f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:21.989560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ba8cd-c33c-4499-bfa3-0f1666489f8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:21.990387 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ba8cd-c33c-4499-bfa3-0f1666489f8f None admin] RBAC: Adding query filter params (role.id=04369f3c13174671a298fcd8175998d8, scope.project.id=81cc7840189242dc9cfd3d71c7df500d, user.id=7a59636450ae459a87d1f85883a8d30b) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:54:21.990702 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ba8cd-c33c-4499-bfa3-0f1666489f8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:21.992439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ba8cd-c33c-4499-bfa3-0f1666489f8f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:21.998849 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 583/1161] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:54:21 2022] GET /identity/v3/role_assignments?user.id=7a59636450ae459a87d1f85883a8d30b&scope.project.id=81cc7840189242dc9cfd3d71c7df500d&role.id=04369f3c13174671a298fcd8175998d8 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:24.269903 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4f5c5-04ab-4bf7-b2ce-2fa2b14ecc56 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:24.270462 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4f5c5-04ab-4bf7-b2ce-2fa2b14ecc56 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:24.270462 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4f5c5-04ab-4bf7-b2ce-2fa2b14ecc56 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:24.271814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 579/1162] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:54:24.277116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109872e7-c63c-44b6-b349-60a270411495 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:24.277552 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109872e7-c63c-44b6-b349-60a270411495 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:24.277678 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109872e7-c63c-44b6-b349-60a270411495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:24.295456 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-109872e7-c63c-44b6-b349-60a270411495 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:54:24.296686 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-109872e7-c63c-44b6-b349-60a270411495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:54:24.343846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:24.378965 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 584/1163] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:54:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:54:24.400905 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4f5c5-04ab-4bf7-b2ce-2fa2b14ecc56 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:24.513325 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4f5c5-04ab-4bf7-b2ce-2fa2b14ecc56 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:24.549425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a0f9c-77c6-4ae5-9d78-7eec1ec789d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:24.549991 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a0f9c-77c6-4ae5-9d78-7eec1ec789d8 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:24.550278 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a0f9c-77c6-4ae5-9d78-7eec1ec789d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:24.550557 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a0f9c-77c6-4ae5-9d78-7eec1ec789d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:24.562502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:24.621150 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a0f9c-77c6-4ae5-9d78-7eec1ec789d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:24.622631 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a0f9c-77c6-4ae5-9d78-7eec1ec789d8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:24.724589 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 580/1164] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:54:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:54:24.730786 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109872e7-c63c-44b6-b349-60a270411495 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:24.843502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109872e7-c63c-44b6-b349-60a270411495 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:24.883785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db6fd0-cb78-4e88-8e74-62fd4a18d5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:24.885186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db6fd0-cb78-4e88-8e74-62fd4a18d5dd None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:24.885470 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db6fd0-cb78-4e88-8e74-62fd4a18d5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:24.885746 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db6fd0-cb78-4e88-8e74-62fd4a18d5dd None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:24.892873 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db6fd0-cb78-4e88-8e74-62fd4a18d5dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:24.894329 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db6fd0-cb78-4e88-8e74-62fd4a18d5dd None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:24.908201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-27db6fd0-cb78-4e88-8e74-62fd4a18d5dd None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 21:54:24.908201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:54:24.908201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 19 21:54:24.908201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 19 21:54:24.908201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:54:24.908201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:54:24.908201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:54:24.908201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:54:24.908201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 19 21:54:24.908201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:54:24.908201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:54:24.908201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:54:24.908201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:54:24.908201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:54:24.908201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:54:24.908201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:54:24.908201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:54:24.909468 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:54:24.909468 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:54:24.909468 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:54:24.909468 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:54:24.909468 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:54:24.909468 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:54:24.909468 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:54:24.909468 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:54:24.909468 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:54:24.909468 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:54:24.909468 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:54:24.909468 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:54:24.909468 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:54:24.909468 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:54:24.909468 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:54:24.909468 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:54:24.910800 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:54:24.910800 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:54:24.910800 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:54:24.910800 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:54:24.910800 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:54:24.910800 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:54:24.910800 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:54:24.910800 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:54:24.910800 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:54:24.910800 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:54:24.910800 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 19 21:54:24.910800 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:54:24.910800 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 21:54:24.910800 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:54:24.910800 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 585/1165] 10.222.0.35 () {56 vars in 1117 bytes} [Thu May 19 21:54:24 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:54:24.916003 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a0f9c-77c6-4ae5-9d78-7eec1ec789d8 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:24.958423 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:25.019976 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a0f9c-77c6-4ae5-9d78-7eec1ec789d8 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:25.054912 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41574bf-ea0d-4a89-98ab-ff606586ac96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:25.055682 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41574bf-ea0d-4a89-98ab-ff606586ac96 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:25.056477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41574bf-ea0d-4a89-98ab-ff606586ac96 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:25.056753 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41574bf-ea0d-4a89-98ab-ff606586ac96 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:25.057470 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41574bf-ea0d-4a89-98ab-ff606586ac96 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:54:25.057771 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41574bf-ea0d-4a89-98ab-ff606586ac96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:25.059121 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41574bf-ea0d-4a89-98ab-ff606586ac96 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:25.066083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 581/1166] 10.222.0.35 () {56 vars in 1115 bytes} [Thu May 19 21:54:24 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:27.318154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b2970-fc27-414b-8f4a-f6ce910e6a83 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:27.318732 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b2970-fc27-414b-8f4a-f6ce910e6a83 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:27.318732 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b2970-fc27-414b-8f4a-f6ce910e6a83 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:27.320096 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 586/1167] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:54:27.326630 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5dd58b-f366-49a4-b6fd-1875903070d8 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:27.327150 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5dd58b-f366-49a4-b6fd-1875903070d8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:27.327265 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5dd58b-f366-49a4-b6fd-1875903070d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:27.345856 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0d5dd58b-f366-49a4-b6fd-1875903070d8 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:54:27.347063 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0d5dd58b-f366-49a4-b6fd-1875903070d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:54:27.416202 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 582/1168] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:54:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:54:27.439596 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b2970-fc27-414b-8f4a-f6ce910e6a83 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:27.484115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:27.551456 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b2970-fc27-414b-8f4a-f6ce910e6a83 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:27.595033 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66161b51-076c-43f4-b293-9b9b25c83a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:27.595602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66161b51-076c-43f4-b293-9b9b25c83a1c None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:27.595884 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66161b51-076c-43f4-b293-9b9b25c83a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:27.596155 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66161b51-076c-43f4-b293-9b9b25c83a1c None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:27.596925 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66161b51-076c-43f4-b293-9b9b25c83a1c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:27.598297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66161b51-076c-43f4-b293-9b9b25c83a1c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:27.613249 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 587/1169] 10.222.0.35 () {60 vars in 1138 bytes} [Thu May 19 21:54:27 2022] POST /identity/v3/domains => generated 267 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:54:30.002459 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb83d9-eab8-47f7-bb78-4a7988008c8c None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:30.003070 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb83d9-eab8-47f7-bb78-4a7988008c8c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:30.003070 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb83d9-eab8-47f7-bb78-4a7988008c8c None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:30.004388 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 583/1170] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:54:30.010435 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37e1db-ee7b-4945-a5d0-e6c92b86da76 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:30.010881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37e1db-ee7b-4945-a5d0-e6c92b86da76 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:30.010987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37e1db-ee7b-4945-a5d0-e6c92b86da76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:30.027798 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-ac37e1db-ee7b-4945-a5d0-e6c92b86da76 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:54:30.029049 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ac37e1db-ee7b-4945-a5d0-e6c92b86da76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:54:30.097853 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 588/1171] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:54:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:54:30.121728 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb83d9-eab8-47f7-bb78-4a7988008c8c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:30.157997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:30.231234 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb83d9-eab8-47f7-bb78-4a7988008c8c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:30.268435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e31a23-4fd9-4141-825f-fe889ecc42a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:30.269217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e31a23-4fd9-4141-825f-fe889ecc42a1 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:30.269497 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e31a23-4fd9-4141-825f-fe889ecc42a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:30.269767 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e31a23-4fd9-4141-825f-fe889ecc42a1 None admin] PATH_INFO: `/v3/domains/5ceeba6c8f3b48bab616badb05ec2bd2` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:30.280345 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e31a23-4fd9-4141-825f-fe889ecc42a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5ceeba6c8f3b48bab616badb05ec2bd2)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:30.281817 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e31a23-4fd9-4141-825f-fe889ecc42a1 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:30.283478 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 584/1172] 10.222.0.35 () {56 vars in 1183 bytes} [Thu May 19 21:54:30 2022] GET /identity/v3/domains/5ceeba6c8f3b48bab616badb05ec2bd2 => generated 267 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:30.290135 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37e1db-ee7b-4945-a5d0-e6c92b86da76 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:30.317804 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:30.402239 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37e1db-ee7b-4945-a5d0-e6c92b86da76 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:30.437253 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49080ac2-4478-419f-a44e-df2c841c63dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:30.437912 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49080ac2-4478-419f-a44e-df2c841c63dc None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:30.438200 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49080ac2-4478-419f-a44e-df2c841c63dc None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:30.438478 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49080ac2-4478-419f-a44e-df2c841c63dc None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:30.439188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49080ac2-4478-419f-a44e-df2c841c63dc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:30.440663 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49080ac2-4478-419f-a44e-df2c841c63dc None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:30.467199 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 589/1173] 10.222.0.35 () {60 vars in 1141 bytes} [Thu May 19 21:54:30 2022] POST /identity/v3/projects => generated 361 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:54:32.778325 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1974b-a1c2-4d8c-868c-86cc333a2d36 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:32.778858 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1974b-a1c2-4d8c-868c-86cc333a2d36 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:32.778858 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1974b-a1c2-4d8c-868c-86cc333a2d36 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:32.780243 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 585/1174] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:54:32.785737 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74a9f0-e0b7-485e-b674-c90523e54753 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:32.786230 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74a9f0-e0b7-485e-b674-c90523e54753 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:32.786321 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74a9f0-e0b7-485e-b674-c90523e54753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:32.803170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4b74a9f0-e0b7-485e-b674-c90523e54753 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:54:32.804352 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4b74a9f0-e0b7-485e-b674-c90523e54753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:54:32.872794 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 590/1175] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:54:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:54:32.897599 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1974b-a1c2-4d8c-868c-86cc333a2d36 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:32.998596 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:33.007102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1974b-a1c2-4d8c-868c-86cc333a2d36 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:33.040133 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92decbf4-3acd-4e76-bda0-dba5108c3fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:33.041612 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92decbf4-3acd-4e76-bda0-dba5108c3fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:33.041891 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92decbf4-3acd-4e76-bda0-dba5108c3fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:33.042157 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92decbf4-3acd-4e76-bda0-dba5108c3fd6 None admin] PATH_INFO: `/v3/domains/5ceeba6c8f3b48bab616badb05ec2bd2` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:33.043334 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92decbf4-3acd-4e76-bda0-dba5108c3fd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5ceeba6c8f3b48bab616badb05ec2bd2)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:33.044903 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92decbf4-3acd-4e76-bda0-dba5108c3fd6 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:33.046605 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 586/1176] 10.222.0.35 () {56 vars in 1183 bytes} [Thu May 19 21:54:32 2022] GET /identity/v3/domains/5ceeba6c8f3b48bab616badb05ec2bd2 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:33.052529 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74a9f0-e0b7-485e-b674-c90523e54753 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:33.062890 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:33.153361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74a9f0-e0b7-485e-b674-c90523e54753 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:33.189371 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dedbdc-8cca-4b27-876e-86a6121c5074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:33.190042 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dedbdc-8cca-4b27-876e-86a6121c5074 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:33.190330 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dedbdc-8cca-4b27-876e-86a6121c5074 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:33.190609 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dedbdc-8cca-4b27-876e-86a6121c5074 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:33.191320 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dedbdc-8cca-4b27-876e-86a6121c5074 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:33.192797 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dedbdc-8cca-4b27-876e-86a6121c5074 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:33.219041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 591/1177] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 21:54:33 2022] POST /identity/v3/users => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:54:35.521427 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918b179-44d8-4b38-87e8-67a945bb7e66 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:35.521980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918b179-44d8-4b38-87e8-67a945bb7e66 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:35.521980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918b179-44d8-4b38-87e8-67a945bb7e66 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:35.523327 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 587/1178] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:54:35.529289 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae9da4-b0ab-42c4-a59f-0e79d28ece27 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:35.529710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae9da4-b0ab-42c4-a59f-0e79d28ece27 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:35.529851 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae9da4-b0ab-42c4-a59f-0e79d28ece27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:35.547192 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-f7ae9da4-b0ab-42c4-a59f-0e79d28ece27 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:54:35.548391 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f7ae9da4-b0ab-42c4-a59f-0e79d28ece27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:54:35.607689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:35.617041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 592/1179] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:54:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:54:35.641152 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918b179-44d8-4b38-87e8-67a945bb7e66 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:35.749783 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918b179-44d8-4b38-87e8-67a945bb7e66 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:35.793307 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1b7b4-b6aa-45c4-9a2c-09fa5cd3a5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:35.794098 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1b7b4-b6aa-45c4-9a2c-09fa5cd3a5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:35.794381 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1b7b4-b6aa-45c4-9a2c-09fa5cd3a5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:35.794653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1b7b4-b6aa-45c4-9a2c-09fa5cd3a5d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:35.805019 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1b7b4-b6aa-45c4-9a2c-09fa5cd3a5d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:54:35.814184 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-0df1b7b4-b6aa-45c4-9a2c-09fa5cd3a5d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:54:35.814184 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:54:35.814184 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:54:35.814184 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:54:35.814184 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:54:35.814184 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:54:35.814184 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:54:35.814184 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:54:35.814184 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:54:35.814184 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:54:35.814184 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:54:35.814184 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:54:35.814184 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:54:35.814184 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:54:35.814184 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:54:35.814184 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:54:35.815354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:54:35.815354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:54:35.815354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:54:35.815354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:54:35.815354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:54:35.815354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:54:35.815354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:54:35.815354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:54:35.815354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:54:35.815354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:54:35.815354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:54:35.815354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:54:35.815354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:54:35.815354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:54:35.815354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:54:35.815354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:54:35.816213 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:54:35.816213 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:54:35.816213 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:54:35.816213 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:54:35.816213 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:54:35.816213 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:54:35.816213 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:54:35.816213 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:54:35.816213 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:54:35.816213 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:54:35.816213 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:54:35.816213 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:54:35.816213 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 588/1180] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:54:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:54:35.822451 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae9da4-b0ab-42c4-a59f-0e79d28ece27 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:35.931660 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae9da4-b0ab-42c4-a59f-0e79d28ece27 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:35.973765 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa174d-a550-40e6-95fc-1fffcfc71cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:35.974456 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa174d-a550-40e6-95fc-1fffcfc71cfb None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:35.974742 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa174d-a550-40e6-95fc-1fffcfc71cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:35.975019 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa174d-a550-40e6-95fc-1fffcfc71cfb None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:35.975771 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa174d-a550-40e6-95fc-1fffcfc71cfb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:54:35.976080 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa174d-a550-40e6-95fc-1fffcfc71cfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:35.977649 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa174d-a550-40e6-95fc-1fffcfc71cfb None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:35.987093 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 593/1181] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:54:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:35.993797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1b7b4-b6aa-45c4-9a2c-09fa5cd3a5d3 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:36.019111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:36.105182 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1b7b4-b6aa-45c4-9a2c-09fa5cd3a5d3 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:36.141657 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3272a-516d-43ae-a91b-d9cddb290e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:36.142526 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3272a-516d-43ae-a91b-d9cddb290e3f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:36.142807 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3272a-516d-43ae-a91b-d9cddb290e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:36.143078 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3272a-516d-43ae-a91b-d9cddb290e3f None admin] PATH_INFO: `/v3/users/c57f5a7872374f8ba59cff87bea1a908` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:36.156682 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3272a-516d-43ae-a91b-d9cddb290e3f None admin] RBAC: Authorizing `identity:get_user(user_id=c57f5a7872374f8ba59cff87bea1a908)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:36.158121 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3272a-516d-43ae-a91b-d9cddb290e3f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:36.159773 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 589/1182] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:54:35 2022] GET /identity/v3/users/c57f5a7872374f8ba59cff87bea1a908 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:36.166188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa174d-a550-40e6-95fc-1fffcfc71cfb None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:36.239545 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:36.285520 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa174d-a550-40e6-95fc-1fffcfc71cfb None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:36.320123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba3caa-b69a-4b3f-9729-702cc3a822b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:36.320800 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba3caa-b69a-4b3f-9729-702cc3a822b2 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:36.321088 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba3caa-b69a-4b3f-9729-702cc3a822b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:36.321468 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba3caa-b69a-4b3f-9729-702cc3a822b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:36.400799 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba3caa-b69a-4b3f-9729-702cc3a822b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:36.402268 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba3caa-b69a-4b3f-9729-702cc3a822b2 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:36.465629 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:36.512169 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 594/1183] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:54:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:54:36.518024 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3272a-516d-43ae-a91b-d9cddb290e3f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:36.601565 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:36.621968 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3272a-516d-43ae-a91b-d9cddb290e3f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:36.658631 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658e41d-3cb2-4bf5-aecf-7ad2877a9d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:36.659490 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658e41d-3cb2-4bf5-aecf-7ad2877a9d6f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:36.659769 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658e41d-3cb2-4bf5-aecf-7ad2877a9d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:36.660041 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658e41d-3cb2-4bf5-aecf-7ad2877a9d6f None admin] PATH_INFO: `/v3/projects/a0dc9055337f43d182794128cfd437c6` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:36.661260 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658e41d-3cb2-4bf5-aecf-7ad2877a9d6f None admin] RBAC: Authorizing `identity:get_project(project_id=a0dc9055337f43d182794128cfd437c6)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:36.662700 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658e41d-3cb2-4bf5-aecf-7ad2877a9d6f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:36.664422 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 590/1184] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:54:36 2022] GET /identity/v3/projects/a0dc9055337f43d182794128cfd437c6 => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:36.674311 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba3caa-b69a-4b3f-9729-702cc3a822b2 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:36.779667 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba3caa-b69a-4b3f-9729-702cc3a822b2 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:36.813823 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0ed51-0b51-4d6d-b91f-63aa6c547164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:36.814483 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0ed51-0b51-4d6d-b91f-63aa6c547164 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:36.814766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0ed51-0b51-4d6d-b91f-63aa6c547164 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:36.815042 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0ed51-0b51-4d6d-b91f-63aa6c547164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:36.815877 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0ed51-0b51-4d6d-b91f-63aa6c547164 None admin] RBAC: Adding query filter params (role.id=04369f3c13174671a298fcd8175998d8, scope.project.id=a0dc9055337f43d182794128cfd437c6, user.id=c57f5a7872374f8ba59cff87bea1a908) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:54:36.816188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0ed51-0b51-4d6d-b91f-63aa6c547164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:36.817662 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0ed51-0b51-4d6d-b91f-63aa6c547164 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:36.823318 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 595/1185] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:54:36 2022] GET /identity/v3/role_assignments?user.id=c57f5a7872374f8ba59cff87bea1a908&scope.project.id=a0dc9055337f43d182794128cfd437c6&role.id=04369f3c13174671a298fcd8175998d8 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:39.068336 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e480b0-b513-4109-bf88-413dede7aa73 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:39.068888 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e480b0-b513-4109-bf88-413dede7aa73 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:39.068999 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e480b0-b513-4109-bf88-413dede7aa73 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:39.070274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 591/1186] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:54:39.075756 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55dcc5c-f84a-4cf9-9f21-74f8b7e734b4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:39.076162 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55dcc5c-f84a-4cf9-9f21-74f8b7e734b4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:39.076314 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55dcc5c-f84a-4cf9-9f21-74f8b7e734b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:39.093706 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a55dcc5c-f84a-4cf9-9f21-74f8b7e734b4 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:54:39.094937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a55dcc5c-f84a-4cf9-9f21-74f8b7e734b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:54:39.110584 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:39.165856 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 596/1187] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:54:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:54:39.188697 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e480b0-b513-4109-bf88-413dede7aa73 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:39.295441 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e480b0-b513-4109-bf88-413dede7aa73 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:39.336041 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce8345-e8a6-4500-b5d1-63e1601304a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:39.337471 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce8345-e8a6-4500-b5d1-63e1601304a1 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:39.337825 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce8345-e8a6-4500-b5d1-63e1601304a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:39.338103 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce8345-e8a6-4500-b5d1-63e1601304a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:39.348578 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce8345-e8a6-4500-b5d1-63e1601304a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:54:39.356445 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-49ce8345-e8a6-4500-b5d1-63e1601304a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:54:39.356445 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:54:39.356445 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:54:39.356445 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:54:39.356445 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:54:39.356445 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:54:39.356445 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:54:39.356445 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:54:39.356445 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:54:39.356445 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:54:39.356445 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:54:39.356445 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:54:39.356445 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:54:39.356445 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:54:39.356445 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:54:39.356445 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:54:39.357730 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:54:39.357730 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:54:39.357730 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:54:39.357730 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:54:39.357730 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:54:39.357730 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:54:39.357730 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:54:39.357730 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:54:39.357730 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:54:39.357730 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:54:39.357730 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:54:39.357730 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:54:39.357730 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:54:39.357730 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:54:39.357730 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:54:39.357730 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:54:39.358623 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:54:39.358623 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:54:39.358623 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:54:39.358623 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:54:39.358623 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:54:39.358623 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:54:39.358623 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:54:39.358623 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:54:39.358623 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:54:39.358623 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:54:39.358623 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:54:39.358623 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:54:39.358623 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 592/1188] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:54:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:54:39.364134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55dcc5c-f84a-4cf9-9f21-74f8b7e734b4 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:39.464136 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55dcc5c-f84a-4cf9-9f21-74f8b7e734b4 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:39.498834 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830d272-5df7-42db-ab29-1029ec73937f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:39.499502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830d272-5df7-42db-ab29-1029ec73937f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:39.499787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830d272-5df7-42db-ab29-1029ec73937f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:39.500066 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830d272-5df7-42db-ab29-1029ec73937f None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:39.500834 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d830d272-5df7-42db-ab29-1029ec73937f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:54:39.501140 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d830d272-5df7-42db-ab29-1029ec73937f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:39.502524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d830d272-5df7-42db-ab29-1029ec73937f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:39.511269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 597/1189] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:54:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:39.517368 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce8345-e8a6-4500-b5d1-63e1601304a1 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:39.529364 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:39.630432 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce8345-e8a6-4500-b5d1-63e1601304a1 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:39.664258 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b099fa-ab72-4f10-9659-83517327671b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:39.676643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b099fa-ab72-4f10-9659-83517327671b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:39.676643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b099fa-ab72-4f10-9659-83517327671b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:39.676643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b099fa-ab72-4f10-9659-83517327671b None admin] PATH_INFO: `/v3/users/c57f5a7872374f8ba59cff87bea1a908` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:39.676643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b099fa-ab72-4f10-9659-83517327671b None admin] RBAC: Authorizing `identity:get_user(user_id=c57f5a7872374f8ba59cff87bea1a908)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:39.677115 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b099fa-ab72-4f10-9659-83517327671b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:39.678452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 593/1190] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:54:39 2022] GET /identity/v3/users/c57f5a7872374f8ba59cff87bea1a908 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:39.684863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830d272-5df7-42db-ab29-1029ec73937f None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:39.701169 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:39.789933 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830d272-5df7-42db-ab29-1029ec73937f None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:39.824288 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33aa4d-0894-4452-aed6-13b21157552d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:39.825198 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33aa4d-0894-4452-aed6-13b21157552d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:39.825486 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33aa4d-0894-4452-aed6-13b21157552d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:39.825768 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33aa4d-0894-4452-aed6-13b21157552d None admin] PATH_INFO: `/v3/projects/a0dc9055337f43d182794128cfd437c6` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:39.827037 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33aa4d-0894-4452-aed6-13b21157552d None admin] RBAC: Authorizing `identity:get_project(project_id=a0dc9055337f43d182794128cfd437c6)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:39.828543 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33aa4d-0894-4452-aed6-13b21157552d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:39.830323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 598/1191] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:54:39 2022] GET /identity/v3/projects/a0dc9055337f43d182794128cfd437c6 => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:39.836324 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b099fa-ab72-4f10-9659-83517327671b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:39.924543 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:39.949564 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b099fa-ab72-4f10-9659-83517327671b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:39.991020 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a577f1-4aa3-4ab0-91a6-d70865ba6df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:39.991909 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a577f1-4aa3-4ab0-91a6-d70865ba6df5 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:39.992468 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a577f1-4aa3-4ab0-91a6-d70865ba6df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:39.992756 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a577f1-4aa3-4ab0-91a6-d70865ba6df5 None admin] PATH_INFO: `/v3/projects/a0dc9055337f43d182794128cfd437c6/users/c57f5a7872374f8ba59cff87bea1a908/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:39.995540 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a577f1-4aa3-4ab0-91a6-d70865ba6df5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0dc9055337f43d182794128cfd437c6, user_id=c57f5a7872374f8ba59cff87bea1a908, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:39.997004 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a577f1-4aa3-4ab0-91a6-d70865ba6df5 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:40.010391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 594/1192] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 21:54:39 2022] PUT /identity/v3/projects/a0dc9055337f43d182794128cfd437c6/users/c57f5a7872374f8ba59cff87bea1a908/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:54:42.234872 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca998a-0d32-491d-b1b3-523b6d8e5b31 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:42.235439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca998a-0d32-491d-b1b3-523b6d8e5b31 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:42.235439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca998a-0d32-491d-b1b3-523b6d8e5b31 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:42.236861 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 599/1193] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:54:42.241991 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498579a-694a-44bd-8552-6e605926672a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:42.242640 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498579a-694a-44bd-8552-6e605926672a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:42.242762 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498579a-694a-44bd-8552-6e605926672a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:42.259831 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7498579a-694a-44bd-8552-6e605926672a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:54:42.261026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7498579a-694a-44bd-8552-6e605926672a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:54:42.329334 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 595/1194] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:54:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:54:42.356176 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca998a-0d32-491d-b1b3-523b6d8e5b31 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:42.453693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:42.473971 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca998a-0d32-491d-b1b3-523b6d8e5b31 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:42.510369 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6517b-8cf3-4f16-9424-c883c723a202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:42.511080 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6517b-8cf3-4f16-9424-c883c723a202 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:42.511369 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6517b-8cf3-4f16-9424-c883c723a202 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:42.511651 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6517b-8cf3-4f16-9424-c883c723a202 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:42.522015 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6517b-8cf3-4f16-9424-c883c723a202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:54:42.530405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-b8c6517b-8cf3-4f16-9424-c883c723a202 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:54:42.530405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:54:42.530405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:54:42.530405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:54:42.530405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:54:42.530405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:54:42.530405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:54:42.530405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:54:42.530405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:54:42.530405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:54:42.530405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:54:42.530405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:54:42.530405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:54:42.530405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:54:42.530405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:54:42.530405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:54:42.531564 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:54:42.531564 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:54:42.531564 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:54:42.531564 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:54:42.531564 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:54:42.531564 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:54:42.531564 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:54:42.531564 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:54:42.531564 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:54:42.531564 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:54:42.531564 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:54:42.531564 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:54:42.531564 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:54:42.531564 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:54:42.531564 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:54:42.531564 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:54:42.532512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:54:42.532512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:54:42.532512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:54:42.532512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:54:42.532512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:54:42.532512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:54:42.532512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:54:42.532512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:54:42.532512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:54:42.532512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:54:42.532512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:54:42.532512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:54:42.532512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 600/1195] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:54:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:54:42.537971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498579a-694a-44bd-8552-6e605926672a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:42.606808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:42.643412 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498579a-694a-44bd-8552-6e605926672a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:42.679542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39b913-5c19-4482-8837-c5bbba6a9302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:42.680211 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39b913-5c19-4482-8837-c5bbba6a9302 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:42.680549 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39b913-5c19-4482-8837-c5bbba6a9302 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:42.680970 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39b913-5c19-4482-8837-c5bbba6a9302 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:42.682086 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac39b913-5c19-4482-8837-c5bbba6a9302 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:54:42.682398 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac39b913-5c19-4482-8837-c5bbba6a9302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:42.683776 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac39b913-5c19-4482-8837-c5bbba6a9302 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:42.700034 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 596/1196] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:54:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:42.705853 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6517b-8cf3-4f16-9424-c883c723a202 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:42.818121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6517b-8cf3-4f16-9424-c883c723a202 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:42.862026 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c911964-77ba-48a1-85c4-55e6d54e36a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:42.862896 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c911964-77ba-48a1-85c4-55e6d54e36a7 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:42.863181 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c911964-77ba-48a1-85c4-55e6d54e36a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:42.863458 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c911964-77ba-48a1-85c4-55e6d54e36a7 None admin] PATH_INFO: `/v3/users/c57f5a7872374f8ba59cff87bea1a908` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:42.864676 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c911964-77ba-48a1-85c4-55e6d54e36a7 None admin] RBAC: Authorizing `identity:get_user(user_id=c57f5a7872374f8ba59cff87bea1a908)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:42.866112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c911964-77ba-48a1-85c4-55e6d54e36a7 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:42.868059 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 601/1197] 10.222.0.35 () {56 vars in 1177 bytes} [Thu May 19 21:54:42 2022] GET /identity/v3/users/c57f5a7872374f8ba59cff87bea1a908 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:42.873873 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39b913-5c19-4482-8837-c5bbba6a9302 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:42.980092 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39b913-5c19-4482-8837-c5bbba6a9302 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:43.011143 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:43.019412 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98050e2a-7060-461a-971f-e2786ea2af8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:43.020067 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98050e2a-7060-461a-971f-e2786ea2af8a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:43.020350 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98050e2a-7060-461a-971f-e2786ea2af8a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:43.020655 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98050e2a-7060-461a-971f-e2786ea2af8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:43.088334 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98050e2a-7060-461a-971f-e2786ea2af8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:43.089706 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98050e2a-7060-461a-971f-e2786ea2af8a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:43.189601 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 597/1198] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:54:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:54:43.195517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c911964-77ba-48a1-85c4-55e6d54e36a7 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:43.214846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:43.306276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c911964-77ba-48a1-85c4-55e6d54e36a7 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:43.341395 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbb54d-2d3d-4585-b6e5-248e7298ebee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:43.342181 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbb54d-2d3d-4585-b6e5-248e7298ebee None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:43.342468 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbb54d-2d3d-4585-b6e5-248e7298ebee None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:43.342749 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbb54d-2d3d-4585-b6e5-248e7298ebee None admin] PATH_INFO: `/v3/projects/a0dc9055337f43d182794128cfd437c6` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:43.343935 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbb54d-2d3d-4585-b6e5-248e7298ebee None admin] RBAC: Authorizing `identity:get_project(project_id=a0dc9055337f43d182794128cfd437c6)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:43.345402 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbb54d-2d3d-4585-b6e5-248e7298ebee None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:43.347110 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 602/1199] 10.222.0.35 () {56 vars in 1186 bytes} [Thu May 19 21:54:43 2022] GET /identity/v3/projects/a0dc9055337f43d182794128cfd437c6 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:43.353999 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98050e2a-7060-461a-971f-e2786ea2af8a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:54:43.385792 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:43.459525 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98050e2a-7060-461a-971f-e2786ea2af8a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:54:43.495736 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2971a2-f72c-458c-a600-aaed66725d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:54:43.496387 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2971a2-f72c-458c-a600-aaed66725d4f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:54:43.496694 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2971a2-f72c-458c-a600-aaed66725d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:54:43.496971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2971a2-f72c-458c-a600-aaed66725d4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:54:43.497806 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2971a2-f72c-458c-a600-aaed66725d4f None admin] RBAC: Adding query filter params (role.id=04369f3c13174671a298fcd8175998d8, scope.project.id=a0dc9055337f43d182794128cfd437c6, user.id=c57f5a7872374f8ba59cff87bea1a908) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:54:43.498120 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2971a2-f72c-458c-a600-aaed66725d4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:54:43.499550 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2971a2-f72c-458c-a600-aaed66725d4f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:54:43.505409 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 598/1200] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:54:43 2022] GET /identity/v3/role_assignments?user.id=c57f5a7872374f8ba59cff87bea1a908&scope.project.id=a0dc9055337f43d182794128cfd437c6&role.id=04369f3c13174671a298fcd8175998d8 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:54:53.336771 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=62 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:54:53.502723 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=54 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:46.389085 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c81920-6407-4373-b8bc-3d8d88eed1d9 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:46.389686 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c81920-6407-4373-b8bc-3d8d88eed1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:46.389686 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c81920-6407-4373-b8bc-3d8d88eed1d9 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:46.391080 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 603/1201] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:55:46.400812 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bce24-d66f-4a88-ab88-370990ee0abe None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:46.400812 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bce24-d66f-4a88-ab88-370990ee0abe None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:46.400812 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bce24-d66f-4a88-ab88-370990ee0abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:46.424533 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0a0bce24-d66f-4a88-ab88-370990ee0abe None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:55:46.426898 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0a0bce24-d66f-4a88-ab88-370990ee0abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:46.537304 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 599/1202] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:55:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:55:46.568116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c81920-6407-4373-b8bc-3d8d88eed1d9 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:46.737261 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c81920-6407-4373-b8bc-3d8d88eed1d9 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:46.791075 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a2749-5f26-4ec0-9050-f1662e7783fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:46.792002 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a2749-5f26-4ec0-9050-f1662e7783fa None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:46.792294 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a2749-5f26-4ec0-9050-f1662e7783fa None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:46.792603 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a2749-5f26-4ec0-9050-f1662e7783fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:46.809793 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a2749-5f26-4ec0-9050-f1662e7783fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:46.811324 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a2749-5f26-4ec0-9050-f1662e7783fa None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:46.833882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-f23a2749-5f26-4ec0-9050-f1662e7783fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:55:46.833882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:55:46.833882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:55:46.833882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:55:46.833882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:55:46.833882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:55:46.833882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:55:46.833882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:55:46.833882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:55:46.833882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:55:46.833882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:55:46.833882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:55:46.833882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:55:46.833882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:55:46.833882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:55:46.834992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:55:46.834992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:55:46.834992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:55:46.834992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:55:46.834992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:55:46.834992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:55:46.834992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:55:46.834992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:55:46.834992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:55:46.834992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:55:46.834992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:55:46.834992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:55:46.834992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:55:46.834992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:55:46.834992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:55:46.834992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:55:46.834992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:55:46.836862 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:55:46.836862 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:55:46.836862 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:55:46.836862 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:55:46.836862 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 604/1203] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:55:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:55:46.842791 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0bce24-d66f-4a88-ab88-370990ee0abe None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:46.977330 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0bce24-d66f-4a88-ab88-370990ee0abe None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:47.031372 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:47.040869 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1c662-4b3a-499d-8c44-4308e0bc8fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:47.041751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1c662-4b3a-499d-8c44-4308e0bc8fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:47.042064 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1c662-4b3a-499d-8c44-4308e0bc8fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:47.042376 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1c662-4b3a-499d-8c44-4308e0bc8fb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:47.043261 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1c662-4b3a-499d-8c44-4308e0bc8fb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:55:47.043601 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1c662-4b3a-499d-8c44-4308e0bc8fb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:47.045077 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1c662-4b3a-499d-8c44-4308e0bc8fb0 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:47.068520 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 600/1204] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:55:47.074413 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a2749-5f26-4ec0-9050-f1662e7783fa None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:47.172631 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:47.245471 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a2749-5f26-4ec0-9050-f1662e7783fa None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:47.295049 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b8393-aaf5-46cb-8d5d-1e9498b12a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:47.295663 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b8393-aaf5-46cb-8d5d-1e9498b12a23 None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:47.295954 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b8393-aaf5-46cb-8d5d-1e9498b12a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:47.296235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b8393-aaf5-46cb-8d5d-1e9498b12a23 None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:47.297008 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b8393-aaf5-46cb-8d5d-1e9498b12a23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:47.298460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b8393-aaf5-46cb-8d5d-1e9498b12a23 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:47.329085 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 605/1205] 10.222.0.35 () {60 vars in 1132 bytes} [Thu May 19 21:55:47 2022] POST /identity/v3/users => generated 251 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:55:49.998819 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925879d-acba-439f-9a18-9f961f47cc5c None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:49.999370 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925879d-acba-439f-9a18-9f961f47cc5c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:49.999370 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925879d-acba-439f-9a18-9f961f47cc5c None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:50.001297 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 601/1206] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:55:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:55:50.007208 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9252d3a-3c72-4ba0-9557-4b01bd66557f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:50.007647 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9252d3a-3c72-4ba0-9557-4b01bd66557f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:50.007858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9252d3a-3c72-4ba0-9557-4b01bd66557f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:50.030613 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d9252d3a-3c72-4ba0-9557-4b01bd66557f None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:55:50.032098 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d9252d3a-3c72-4ba0-9557-4b01bd66557f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:50.112616 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 606/1207] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:55:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:55:50.138881 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925879d-acba-439f-9a18-9f961f47cc5c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:50.264049 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925879d-acba-439f-9a18-9f961f47cc5c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:50.310279 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e705cd-2fd7-48f4-9432-89ddf94cdf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:50.311156 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e705cd-2fd7-48f4-9432-89ddf94cdf77 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:50.311499 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e705cd-2fd7-48f4-9432-89ddf94cdf77 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:50.311835 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e705cd-2fd7-48f4-9432-89ddf94cdf77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:50.324098 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e705cd-2fd7-48f4-9432-89ddf94cdf77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:55:50.333040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-c3e705cd-2fd7-48f4-9432-89ddf94cdf77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:55:50.333040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:55:50.333040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:55:50.333040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:55:50.333040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:55:50.333040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:55:50.333040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:55:50.333040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:55:50.333040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:55:50.333040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:55:50.333040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:55:50.333040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:55:50.333040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:55:50.333040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:55:50.333040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:55:50.333040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:55:50.334246 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:55:50.334246 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:55:50.334246 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:55:50.334246 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:55:50.334246 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:55:50.334246 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:55:50.334246 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:55:50.334246 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:55:50.334246 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:55:50.334246 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:55:50.334246 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:55:50.334246 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:55:50.334246 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:55:50.334246 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:55:50.334246 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:55:50.334246 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:55:50.335868 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:55:50.335868 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:55:50.335868 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:55:50.335868 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:55:50.335868 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:55:50.335868 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:55:50.335868 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:55:50.335868 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:55:50.335868 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:55:50.335868 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:55:50.335868 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:55:50.335868 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:55:50.335868 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 602/1208] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 21:55:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:55:50.346590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9252d3a-3c72-4ba0-9557-4b01bd66557f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:50.393289 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:50.470781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9252d3a-3c72-4ba0-9557-4b01bd66557f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:50.517341 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1b81a-a5df-4a40-a756-277d881e4454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:50.517939 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1b81a-a5df-4a40-a756-277d881e4454 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:50.518221 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1b81a-a5df-4a40-a756-277d881e4454 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:50.518516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1b81a-a5df-4a40-a756-277d881e4454 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:50.519240 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1b81a-a5df-4a40-a756-277d881e4454 None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:55:50.519547 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1b81a-a5df-4a40-a756-277d881e4454 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:50.521217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1b81a-a5df-4a40-a756-277d881e4454 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:50.531769 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 607/1209] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 21:55:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:55:50.537652 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e705cd-2fd7-48f4-9432-89ddf94cdf77 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:50.604611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:50.670468 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e705cd-2fd7-48f4-9432-89ddf94cdf77 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:50.719431 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf707e1-c59d-4273-b761-b2050856d82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:50.721319 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf707e1-c59d-4273-b761-b2050856d82b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:50.721319 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf707e1-c59d-4273-b761-b2050856d82b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:50.721319 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf707e1-c59d-4273-b761-b2050856d82b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:50.732803 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf707e1-c59d-4273-b761-b2050856d82b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:50.734268 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf707e1-c59d-4273-b761-b2050856d82b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:50.753906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-bdf707e1-c59d-4273-b761-b2050856d82b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:55:50.753906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:55:50.753906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:55:50.753906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:55:50.753906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:55:50.753906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:55:50.753906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:55:50.753906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:55:50.753906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:55:50.753906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:55:50.753906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:55:50.753906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:55:50.753906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:55:50.753906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:55:50.753906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:55:50.754875 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:55:50.754875 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:55:50.754875 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:55:50.754875 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:55:50.754875 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:55:50.754875 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:55:50.754875 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:55:50.754875 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:55:50.754875 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:55:50.754875 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:55:50.754875 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:55:50.754875 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:55:50.754875 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:55:50.754875 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:55:50.754875 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:55:50.754875 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:55:50.754875 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:55:50.761906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:55:50.761906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:55:50.761906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:55:50.761906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:55:50.761906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 603/1210] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:55:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:55:50.762195 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1b81a-a5df-4a40-a756-277d881e4454 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:50.914110 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:50.918573 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1b81a-a5df-4a40-a756-277d881e4454 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:50.974506 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096185d9-1f55-4807-8c54-5af7ad4782ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:50.975205 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096185d9-1f55-4807-8c54-5af7ad4782ef None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:50.975493 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096185d9-1f55-4807-8c54-5af7ad4782ef None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:50.975774 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096185d9-1f55-4807-8c54-5af7ad4782ef None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:50.977805 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096185d9-1f55-4807-8c54-5af7ad4782ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:55:50.978156 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096185d9-1f55-4807-8c54-5af7ad4782ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:50.979607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096185d9-1f55-4807-8c54-5af7ad4782ef None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:50.996381 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 608/1211] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:55:51.003453 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf707e1-c59d-4273-b761-b2050856d82b None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:51.138180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf707e1-c59d-4273-b761-b2050856d82b None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:51.140139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:51.197355 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a784612-3fdd-4d4e-a527-74a7265b1f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:51.200627 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a784612-3fdd-4d4e-a527-74a7265b1f6d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:51.203565 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a784612-3fdd-4d4e-a527-74a7265b1f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:51.203565 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a784612-3fdd-4d4e-a527-74a7265b1f6d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:51.212833 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a784612-3fdd-4d4e-a527-74a7265b1f6d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:51.214389 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a784612-3fdd-4d4e-a527-74a7265b1f6d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:51.234627 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-1a784612-3fdd-4d4e-a527-74a7265b1f6d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 21:55:51.234627 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:55:51.234627 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:55:51.234627 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:55:51.234627 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:55:51.234627 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:55:51.234627 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:55:51.234627 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:55:51.234627 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:55:51.234627 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:55:51.234627 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:55:51.234627 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:55:51.234627 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:55:51.234627 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:55:51.234627 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:55:51.234627 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:55:51.241541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:55:51.241541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:55:51.241541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:55:51.241541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:55:51.241541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:55:51.241541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:55:51.241541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:55:51.241541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:55:51.241541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:55:51.241541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:55:51.241541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:55:51.241541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:55:51.241541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:55:51.241541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:55:51.241541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:55:51.241541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:55:51.241541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:55:51.241541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:55:51.242630 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:55:51.242630 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:55:51.242630 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:55:51.242630 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:55:51.242630 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:55:51.242630 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:55:51.242630 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:55:51.242630 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:55:51.242630 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 21:55:51.242630 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:55:51.242630 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 604/1212] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:55:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:55:51.243672 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096185d9-1f55-4807-8c54-5af7ad4782ef None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:51.387906 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096185d9-1f55-4807-8c54-5af7ad4782ef None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:51.436838 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff498a19-3b67-476b-a205-1a6027b5c51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:51.437672 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff498a19-3b67-476b-a205-1a6027b5c51e None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:51.438000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff498a19-3b67-476b-a205-1a6027b5c51e None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:51.438433 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff498a19-3b67-476b-a205-1a6027b5c51e None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:51.439987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff498a19-3b67-476b-a205-1a6027b5c51e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:55:51.440609 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff498a19-3b67-476b-a205-1a6027b5c51e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:51.443492 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff498a19-3b67-476b-a205-1a6027b5c51e None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:51.471087 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 609/1213] 10.222.0.35 () {56 vars in 1143 bytes} [Thu May 19 21:55:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:55:51.473086 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a784612-3fdd-4d4e-a527-74a7265b1f6d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:51.618416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a784612-3fdd-4d4e-a527-74a7265b1f6d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:51.665824 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd16d0c-2130-4aea-9b54-d8d87c1b1ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:51.666484 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd16d0c-2130-4aea-9b54-d8d87c1b1ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:51.666763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd16d0c-2130-4aea-9b54-d8d87c1b1ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:51.667033 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd16d0c-2130-4aea-9b54-d8d87c1b1ad9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:51.708679 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:51.755701 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd16d0c-2130-4aea-9b54-d8d87c1b1ad9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:51.757424 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd16d0c-2130-4aea-9b54-d8d87c1b1ad9 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:51.918943 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 605/1214] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:55:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:55:51.924816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff498a19-3b67-476b-a205-1a6027b5c51e None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:51.947170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:52.056761 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff498a19-3b67-476b-a205-1a6027b5c51e None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:52.100239 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e9497-5015-4b90-89bd-7d0ed4775e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:52.101303 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e9497-5015-4b90-89bd-7d0ed4775e72 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:52.101622 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e9497-5015-4b90-89bd-7d0ed4775e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:52.102406 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e9497-5015-4b90-89bd-7d0ed4775e72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:52.115791 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e9497-5015-4b90-89bd-7d0ed4775e72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:52.117610 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e9497-5015-4b90-89bd-7d0ed4775e72 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:52.138185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-b19e9497-5015-4b90-89bd-7d0ed4775e72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:55:52.138185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:55:52.138185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:55:52.138185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:55:52.138185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:55:52.138185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:55:52.138185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:55:52.138185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:55:52.138185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:55:52.138185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:55:52.138185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:55:52.138185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:55:52.138185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:55:52.138185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:55:52.138185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:55:52.139544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:55:52.139544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:55:52.139544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:55:52.139544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:55:52.139544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:55:52.139544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:55:52.139544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:55:52.139544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:55:52.139544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:55:52.139544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:55:52.139544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:55:52.139544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:55:52.139544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:55:52.139544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:55:52.139544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:55:52.139544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:55:52.139544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:55:52.140834 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:55:52.140834 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:55:52.140834 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:55:52.140834 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:55:52.140834 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 610/1215] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:55:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:55:52.145319 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd16d0c-2130-4aea-9b54-d8d87c1b1ad9 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:52.223786 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:52.279859 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd16d0c-2130-4aea-9b54-d8d87c1b1ad9 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:52.321846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db938c3-fed9-4bf2-b3f0-faaa6337216a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:52.322585 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db938c3-fed9-4bf2-b3f0-faaa6337216a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:52.322958 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db938c3-fed9-4bf2-b3f0-faaa6337216a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:52.323329 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db938c3-fed9-4bf2-b3f0-faaa6337216a None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:52.324168 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db938c3-fed9-4bf2-b3f0-faaa6337216a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:55:52.324601 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db938c3-fed9-4bf2-b3f0-faaa6337216a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:52.326087 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db938c3-fed9-4bf2-b3f0-faaa6337216a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:52.347184 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 606/1216] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:55:52.352849 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e9497-5015-4b90-89bd-7d0ed4775e72 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:52.449137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:52.487104 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e9497-5015-4b90-89bd-7d0ed4775e72 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:52.534955 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8666697-fc1e-472d-8f60-bf1fe6a60b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:52.535886 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8666697-fc1e-472d-8f60-bf1fe6a60b9a None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:52.536172 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8666697-fc1e-472d-8f60-bf1fe6a60b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:52.536477 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8666697-fc1e-472d-8f60-bf1fe6a60b9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:52.546790 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8666697-fc1e-472d-8f60-bf1fe6a60b9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:52.548264 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8666697-fc1e-472d-8f60-bf1fe6a60b9a None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:52.563980 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-e8666697-fc1e-472d-8f60-bf1fe6a60b9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:55:52.563980 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:55:52.563980 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:55:52.563980 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:55:52.563980 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:55:52.563980 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:55:52.563980 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:55:52.563980 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:55:52.563980 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:55:52.563980 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:55:52.563980 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:55:52.563980 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:55:52.563980 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:55:52.563980 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:55:52.563980 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:55:52.565305 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:55:52.565305 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:55:52.565305 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:55:52.565305 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:55:52.565305 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:55:52.565305 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:55:52.565305 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:55:52.565305 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:55:52.565305 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:55:52.565305 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:55:52.565305 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:55:52.565305 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:55:52.565305 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:55:52.565305 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:55:52.565305 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:55:52.565305 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:55:52.565305 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:55:52.566574 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:55:52.566574 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:55:52.566574 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:55:52.566574 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:55:52.566574 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:55:52.566574 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:55:52.566574 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:55:52.566574 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:55:52.570724 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 611/1217] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:55:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:55:52.572287 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db938c3-fed9-4bf2-b3f0-faaa6337216a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:52.709368 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db938c3-fed9-4bf2-b3f0-faaa6337216a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:52.741947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:52.761131 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb076d0-d14c-4b27-919b-b7f8c1a146cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:52.761911 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb076d0-d14c-4b27-919b-b7f8c1a146cd None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:52.762251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb076d0-d14c-4b27-919b-b7f8c1a146cd None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:52.762593 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb076d0-d14c-4b27-919b-b7f8c1a146cd None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:52.763456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb076d0-d14c-4b27-919b-b7f8c1a146cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:55:52.763829 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb076d0-d14c-4b27-919b-b7f8c1a146cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:52.765382 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb076d0-d14c-4b27-919b-b7f8c1a146cd None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:52.779092 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 607/1218] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:55:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:55:52.786510 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8666697-fc1e-472d-8f60-bf1fe6a60b9a None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:52.918682 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8666697-fc1e-472d-8f60-bf1fe6a60b9a None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:52.953450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:52.960389 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6c894-5c7e-40db-b3c6-44d1f885a1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:52.961126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6c894-5c7e-40db-b3c6-44d1f885a1cb None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:52.961937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6c894-5c7e-40db-b3c6-44d1f885a1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:52.962259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6c894-5c7e-40db-b3c6-44d1f885a1cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:52.963587 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6c894-5c7e-40db-b3c6-44d1f885a1cb None admin] RBAC: Adding query filter params (role.id=372e9dc71b5a4a4daddc43ab384fa67b, scope.project.id=89b20e18525c473e94a2b263148f1f5f, user.id=b1004beeeaed4af4a92c89ad31008b32) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:55:52.964142 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6c894-5c7e-40db-b3c6-44d1f885a1cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:52.966799 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6c894-5c7e-40db-b3c6-44d1f885a1cb None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:52.976139 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 612/1219] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:55:52 2022] GET /identity/v3/role_assignments?user.id=b1004beeeaed4af4a92c89ad31008b32&scope.project.id=89b20e18525c473e94a2b263148f1f5f&role.id=372e9dc71b5a4a4daddc43ab384fa67b => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:55:55.286242 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df0252-b19f-48ac-b472-d51787b95cd7 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:55.286818 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df0252-b19f-48ac-b472-d51787b95cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:55.286818 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df0252-b19f-48ac-b472-d51787b95cd7 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:55.288614 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 608/1220] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:55:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:55:55.295471 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76350341-cac5-423a-a784-15e99f5ec025 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:55.295985 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76350341-cac5-423a-a784-15e99f5ec025 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:55.296098 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76350341-cac5-423a-a784-15e99f5ec025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:55.316208 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-76350341-cac5-423a-a784-15e99f5ec025 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:55:55.317517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-76350341-cac5-423a-a784-15e99f5ec025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:55:55.400435 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 613/1221] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:55:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:55:55.425638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df0252-b19f-48ac-b472-d51787b95cd7 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:55.534158 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df0252-b19f-48ac-b472-d51787b95cd7 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:55.572653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad22ee-d084-4ecc-ad49-f226aa3ccf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:55.573374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad22ee-d084-4ecc-ad49-f226aa3ccf15 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:55.573652 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad22ee-d084-4ecc-ad49-f226aa3ccf15 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:55.573925 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad22ee-d084-4ecc-ad49-f226aa3ccf15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:55.587251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad22ee-d084-4ecc-ad49-f226aa3ccf15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:55:55.597391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-8fad22ee-d084-4ecc-ad49-f226aa3ccf15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:55:55.597391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:55:55.597391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:55:55.597391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:55:55.597391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:55:55.597391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:55:55.597391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:55:55.597391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:55:55.597391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:55:55.597391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:55:55.597391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:55:55.597391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:55:55.597391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:55:55.597391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:55:55.597391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:55:55.597391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:55:55.598664 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:55:55.598664 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:55:55.598664 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:55:55.598664 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:55:55.598664 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:55:55.598664 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:55:55.598664 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:55:55.598664 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:55:55.598664 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:55:55.598664 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:55:55.598664 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:55:55.598664 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:55:55.598664 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:55:55.598664 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:55:55.598664 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:55:55.598664 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:55:55.599477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:55:55.599477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:55:55.599477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:55:55.599477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:55:55.599477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:55:55.599477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:55:55.599477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:55:55.599477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:55:55.599477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:55:55.599477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:55:55.599477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:55:55.599477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:55:55.599477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 609/1222] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 21:55:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:55:55.607683 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76350341-cac5-423a-a784-15e99f5ec025 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:55.730823 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76350341-cac5-423a-a784-15e99f5ec025 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:55.760466 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:55.771760 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684da256-f014-439e-b549-34444d91bead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:55.772464 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684da256-f014-439e-b549-34444d91bead None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:55.772751 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684da256-f014-439e-b549-34444d91bead None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:55.773027 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684da256-f014-439e-b549-34444d91bead None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:55.773784 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684da256-f014-439e-b549-34444d91bead None admin] RBAC: Adding query filter params (name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:55:55.774193 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684da256-f014-439e-b549-34444d91bead None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:55.775648 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684da256-f014-439e-b549-34444d91bead None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:55.783908 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 614/1223] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 21:55:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:55:55.789916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad22ee-d084-4ecc-ad49-f226aa3ccf15 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:55.845197 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:55.926888 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad22ee-d084-4ecc-ad49-f226aa3ccf15 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:55.965005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1105fb8-6de7-4ea8-b645-0ffe73bd661a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:55.965822 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1105fb8-6de7-4ea8-b645-0ffe73bd661a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:55.966108 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1105fb8-6de7-4ea8-b645-0ffe73bd661a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:55.966392 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1105fb8-6de7-4ea8-b645-0ffe73bd661a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:55.980078 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1105fb8-6de7-4ea8-b645-0ffe73bd661a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:55.981585 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1105fb8-6de7-4ea8-b645-0ffe73bd661a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:56.003809 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-a1105fb8-6de7-4ea8-b645-0ffe73bd661a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:55:56.003809 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:55:56.003809 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:55:56.003809 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:55:56.003809 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:55:56.003809 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:55:56.003809 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:55:56.003809 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:55:56.003809 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:55:56.003809 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:55:56.003809 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:55:56.003809 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:55:56.003809 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:55:56.003809 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:55:56.003809 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:55:56.005026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:55:56.005026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:55:56.005026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:55:56.005026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:55:56.005026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:55:56.005026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:55:56.005026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:55:56.005026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:55:56.005026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:55:56.005026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:55:56.005026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:55:56.005026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:55:56.005026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:55:56.005026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:55:56.005026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:55:56.005026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:55:56.005026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:55:56.006182 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:55:56.006182 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:55:56.006182 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:55:56.006182 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:55:56.006182 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 610/1224] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:55:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:55:56.013264 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684da256-f014-439e-b549-34444d91bead None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:56.135799 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684da256-f014-439e-b549-34444d91bead None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:56.179676 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7b43e-5146-43e4-8aeb-20b3267be780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:56.181044 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7b43e-5146-43e4-8aeb-20b3267be780 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:56.181382 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7b43e-5146-43e4-8aeb-20b3267be780 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:56.181598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7b43e-5146-43e4-8aeb-20b3267be780 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:56.182340 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7b43e-5146-43e4-8aeb-20b3267be780 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:55:56.182739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7b43e-5146-43e4-8aeb-20b3267be780 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:56.184133 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7b43e-5146-43e4-8aeb-20b3267be780 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:56.198776 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 615/1225] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:55:56.206255 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1105fb8-6de7-4ea8-b645-0ffe73bd661a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:56.318946 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:56.326712 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1105fb8-6de7-4ea8-b645-0ffe73bd661a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:56.371314 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa008f-5ad1-4465-a0e4-888eabf5b5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:56.372300 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa008f-5ad1-4465-a0e4-888eabf5b5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:56.372678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa008f-5ad1-4465-a0e4-888eabf5b5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:56.372995 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa008f-5ad1-4465-a0e4-888eabf5b5e4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:56.383952 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa008f-5ad1-4465-a0e4-888eabf5b5e4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:56.386018 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa008f-5ad1-4465-a0e4-888eabf5b5e4 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:56.404862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-19aa008f-5ad1-4465-a0e4-888eabf5b5e4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 21:55:56.404862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:55:56.404862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:55:56.404862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:55:56.404862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:55:56.404862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:55:56.404862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:55:56.404862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:55:56.404862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:55:56.404862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:55:56.404862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:55:56.404862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:55:56.404862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:55:56.404862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:55:56.404862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:55:56.404862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:55:56.406032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:55:56.406032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:55:56.406032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:55:56.406032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:55:56.406032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:55:56.406032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:55:56.406032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:55:56.406032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:55:56.406032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:55:56.406032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:55:56.406032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:55:56.406032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:55:56.406032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:55:56.406032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:55:56.406032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:55:56.406032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:55:56.406032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:55:56.406032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:55:56.406950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:55:56.406950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:55:56.406950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:55:56.406950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:55:56.406950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:55:56.406950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:55:56.406950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:55:56.406950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:55:56.406950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 21:55:56.406950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:55:56.406950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 611/1226] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:55:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:55:56.412816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7b43e-5146-43e4-8aeb-20b3267be780 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:56.470788 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:56.558769 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7b43e-5146-43e4-8aeb-20b3267be780 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:56.604457 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f836d-0f58-4ed5-a790-d85cf4866aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:56.605173 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f836d-0f58-4ed5-a790-d85cf4866aec None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:56.605462 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f836d-0f58-4ed5-a790-d85cf4866aec None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:56.605740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f836d-0f58-4ed5-a790-d85cf4866aec None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:56.606588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f836d-0f58-4ed5-a790-d85cf4866aec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:55:56.606918 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f836d-0f58-4ed5-a790-d85cf4866aec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:56.608351 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f836d-0f58-4ed5-a790-d85cf4866aec None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:56.634023 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 616/1227] 10.222.0.35 () {56 vars in 1143 bytes} [Thu May 19 21:55:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:55:56.635488 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa008f-5ad1-4465-a0e4-888eabf5b5e4 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:56.762175 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa008f-5ad1-4465-a0e4-888eabf5b5e4 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:56.802304 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03f9fc-ef30-4d82-8875-909652ab38d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:56.803128 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03f9fc-ef30-4d82-8875-909652ab38d2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:56.803414 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03f9fc-ef30-4d82-8875-909652ab38d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:56.803692 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03f9fc-ef30-4d82-8875-909652ab38d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:56.816432 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03f9fc-ef30-4d82-8875-909652ab38d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:56.817990 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03f9fc-ef30-4d82-8875-909652ab38d2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:56.837805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-3d03f9fc-ef30-4d82-8875-909652ab38d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:55:56.837805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:55:56.837805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:55:56.837805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:55:56.837805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:55:56.837805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:55:56.837805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:55:56.837805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:55:56.837805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:55:56.837805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:55:56.837805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:55:56.837805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:55:56.837805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:55:56.837805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:55:56.837805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:55:56.838983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:55:56.838983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:55:56.838983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:55:56.838983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:55:56.838983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:55:56.838983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:55:56.838983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:55:56.838983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:55:56.838983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:55:56.838983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:55:56.838983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:55:56.838983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:55:56.838983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:55:56.838983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:55:56.838983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:55:56.838983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:55:56.838983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:55:56.839945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:55:56.839945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:55:56.839945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:55:56.839945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:55:56.839945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 612/1228] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:55:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:55:56.845590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f836d-0f58-4ed5-a790-d85cf4866aec None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:56.959257 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f836d-0f58-4ed5-a790-d85cf4866aec None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:56.961907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:56.999045 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79df04-f8f2-4c1e-a16e-80f46cdb9e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:56.999728 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79df04-f8f2-4c1e-a16e-80f46cdb9e69 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:57.000006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79df04-f8f2-4c1e-a16e-80f46cdb9e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:57.000452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79df04-f8f2-4c1e-a16e-80f46cdb9e69 None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:57.001167 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79df04-f8f2-4c1e-a16e-80f46cdb9e69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:55:57.001514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79df04-f8f2-4c1e-a16e-80f46cdb9e69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:57.003120 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79df04-f8f2-4c1e-a16e-80f46cdb9e69 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:57.019800 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 617/1229] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:55:57.027275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03f9fc-ef30-4d82-8875-909652ab38d2 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:57.036847 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:57.143940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03f9fc-ef30-4d82-8875-909652ab38d2 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:57.183597 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea903d4-4260-43fa-9551-0ac872868824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:57.184383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea903d4-4260-43fa-9551-0ac872868824 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:57.184704 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea903d4-4260-43fa-9551-0ac872868824 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:57.184972 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea903d4-4260-43fa-9551-0ac872868824 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:57.191981 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea903d4-4260-43fa-9551-0ac872868824 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:57.193719 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea903d4-4260-43fa-9551-0ac872868824 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:57.211928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-9ea903d4-4260-43fa-9551-0ac872868824 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:55:57.211928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:55:57.211928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:55:57.211928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:55:57.211928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:55:57.211928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:55:57.211928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:55:57.211928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:55:57.211928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:55:57.211928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:55:57.211928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:55:57.211928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:55:57.211928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:55:57.211928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:55:57.211928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:55:57.213139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:55:57.213139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:55:57.213139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:55:57.213139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:55:57.213139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:55:57.213139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:55:57.213139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:55:57.213139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:55:57.213139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:55:57.213139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:55:57.213139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:55:57.213139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:55:57.213139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:55:57.213139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:55:57.213139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:55:57.213139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:55:57.213139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:55:57.214447 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:55:57.214447 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:55:57.214447 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:55:57.214447 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:55:57.214447 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:55:57.214447 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:55:57.214447 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:55:57.214447 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:55:57.214447 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 613/1230] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:55:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:55:57.219346 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79df04-f8f2-4c1e-a16e-80f46cdb9e69 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:57.341062 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79df04-f8f2-4c1e-a16e-80f46cdb9e69 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:57.381894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402cfe5-4e04-4e00-a7f1-65d2c813adc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:57.382653 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402cfe5-4e04-4e00-a7f1-65d2c813adc3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:57.382933 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402cfe5-4e04-4e00-a7f1-65d2c813adc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:57.383209 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402cfe5-4e04-4e00-a7f1-65d2c813adc3 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:57.384731 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402cfe5-4e04-4e00-a7f1-65d2c813adc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:55:57.385127 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402cfe5-4e04-4e00-a7f1-65d2c813adc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:57.386805 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402cfe5-4e04-4e00-a7f1-65d2c813adc3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:57.404501 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 618/1231] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:55:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:55:57.410551 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea903d4-4260-43fa-9551-0ac872868824 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:55:57.488539 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:57.533303 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea903d4-4260-43fa-9551-0ac872868824 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:55:57.573613 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448def9-1367-42b1-a72f-28e253711996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:55:57.574528 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448def9-1367-42b1-a72f-28e253711996 None admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:57.574813 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448def9-1367-42b1-a72f-28e253711996 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:57.575091 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448def9-1367-42b1-a72f-28e253711996 None admin] PATH_INFO: `/v3/projects/89b20e18525c473e94a2b263148f1f5f/users/b1004beeeaed4af4a92c89ad31008b32/roles/372e9dc71b5a4a4daddc43ab384fa67b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:57.594719 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448def9-1367-42b1-a72f-28e253711996 None admin] RBAC: Authorizing `identity:create_grant(project_id=89b20e18525c473e94a2b263148f1f5f, user_id=b1004beeeaed4af4a92c89ad31008b32, role_id=372e9dc71b5a4a4daddc43ab384fa67b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:55:57.596470 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448def9-1367-42b1-a72f-28e253711996 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:55:57.614297 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 614/1232] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 21:55:57 2022] PUT /identity/v3/projects/89b20e18525c473e94a2b263148f1f5f/users/b1004beeeaed4af4a92c89ad31008b32/roles/372e9dc71b5a4a4daddc43ab384fa67b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:55:59.983651 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55580ab0-1bc1-4e95-8d4a-f5826184a44e None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:59.984223 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55580ab0-1bc1-4e95-8d4a-f5826184a44e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:59.984223 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55580ab0-1bc1-4e95-8d4a-f5826184a44e None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:55:59.985955 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 619/1233] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:55:59.992062 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82a74b-943c-45cc-9601-92f88cb6d6b7 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:55:59.992563 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82a74b-943c-45cc-9601-92f88cb6d6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:55:59.993302 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82a74b-943c-45cc-9601-92f88cb6d6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:00.011768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3a82a74b-943c-45cc-9601-92f88cb6d6b7 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:56:00.013134 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3a82a74b-943c-45cc-9601-92f88cb6d6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:00.101283 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 615/1234] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:55:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:56:00.131308 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55580ab0-1bc1-4e95-8d4a-f5826184a44e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:00.163131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:00.253632 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55580ab0-1bc1-4e95-8d4a-f5826184a44e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:00.291313 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935ab0f-9511-477a-8b03-bd2945b59f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:00.292210 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935ab0f-9511-477a-8b03-bd2945b59f6c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:00.292528 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935ab0f-9511-477a-8b03-bd2945b59f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:00.292847 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935ab0f-9511-477a-8b03-bd2945b59f6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:00.305972 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935ab0f-9511-477a-8b03-bd2945b59f6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:56:00.314803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-4935ab0f-9511-477a-8b03-bd2945b59f6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 21:56:00.314803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:56:00.314803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:56:00.314803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:56:00.314803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:56:00.314803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:56:00.314803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:56:00.314803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:56:00.314803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:56:00.314803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:56:00.314803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:56:00.314803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:56:00.314803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:56:00.314803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:56:00.314803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:56:00.314803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:56:00.315937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:56:00.315937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:56:00.315937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:56:00.315937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:56:00.315937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:56:00.315937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:56:00.315937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:56:00.315937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:56:00.315937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:56:00.315937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:56:00.315937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:56:00.315937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:56:00.315937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:56:00.315937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:56:00.315937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:56:00.315937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:56:00.316859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:56:00.316859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:56:00.316859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:56:00.316859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:56:00.316859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:56:00.316859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:56:00.316859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:56:00.316859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:56:00.316859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:56:00.316859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:56:00.316859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 21:56:00.316859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:56:00.316859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 620/1235] 10.222.0.35 () {56 vars in 1102 bytes} [Thu May 19 21:56:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:56:00.323675 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82a74b-943c-45cc-9601-92f88cb6d6b7 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:00.379193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:00.446881 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82a74b-943c-45cc-9601-92f88cb6d6b7 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:00.485419 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1182bd9-5dc7-4e3e-9e2a-7e8282f2ee2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:00.486097 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1182bd9-5dc7-4e3e-9e2a-7e8282f2ee2e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:00.486378 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1182bd9-5dc7-4e3e-9e2a-7e8282f2ee2e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:00.486656 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1182bd9-5dc7-4e3e-9e2a-7e8282f2ee2e None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:00.487468 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1182bd9-5dc7-4e3e-9e2a-7e8282f2ee2e None admin] RBAC: Adding query filter params (name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:00.487769 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1182bd9-5dc7-4e3e-9e2a-7e8282f2ee2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:00.489257 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1182bd9-5dc7-4e3e-9e2a-7e8282f2ee2e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:00.499621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 616/1236] 10.222.0.35 () {56 vars in 1103 bytes} [Thu May 19 21:56:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:00.505776 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935ab0f-9511-477a-8b03-bd2945b59f6c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:00.605453 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:00.624856 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935ab0f-9511-477a-8b03-bd2945b59f6c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:00.663441 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef9092-9e47-4fb1-b1c6-cabae2e93195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:00.664253 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef9092-9e47-4fb1-b1c6-cabae2e93195 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:00.664622 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef9092-9e47-4fb1-b1c6-cabae2e93195 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:00.664901 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef9092-9e47-4fb1-b1c6-cabae2e93195 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:00.676883 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef9092-9e47-4fb1-b1c6-cabae2e93195 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:00.678439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef9092-9e47-4fb1-b1c6-cabae2e93195 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:00.697400 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-f9ef9092-9e47-4fb1-b1c6-cabae2e93195 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:56:00.697400 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:56:00.697400 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:56:00.697400 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:56:00.697400 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:56:00.697400 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:56:00.697400 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:56:00.697400 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:56:00.697400 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:56:00.697400 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:56:00.697400 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:56:00.697400 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:56:00.697400 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:56:00.697400 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:56:00.697400 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:56:00.698398 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:56:00.698398 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:56:00.698398 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:56:00.698398 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:56:00.698398 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:56:00.698398 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:56:00.698398 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:56:00.698398 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:56:00.698398 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:56:00.698398 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:56:00.698398 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:56:00.698398 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:56:00.698398 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:56:00.698398 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:56:00.698398 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:56:00.698398 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:56:00.698398 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:56:00.699278 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:56:00.699278 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:56:00.699278 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:56:00.699278 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:56:00.699278 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 621/1237] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:56:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 21:56:00.705026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1182bd9-5dc7-4e3e-9e2a-7e8282f2ee2e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:00.820614 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1182bd9-5dc7-4e3e-9e2a-7e8282f2ee2e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:00.830721 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:00.859059 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366be0f6-5611-45df-94e9-0b795bd25903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:00.859749 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366be0f6-5611-45df-94e9-0b795bd25903 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:00.860040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366be0f6-5611-45df-94e9-0b795bd25903 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:00.860322 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366be0f6-5611-45df-94e9-0b795bd25903 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:00.861098 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366be0f6-5611-45df-94e9-0b795bd25903 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:00.861417 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366be0f6-5611-45df-94e9-0b795bd25903 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:00.862814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366be0f6-5611-45df-94e9-0b795bd25903 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:00.881360 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 617/1238] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:00.882640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef9092-9e47-4fb1-b1c6-cabae2e93195 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:01.013700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef9092-9e47-4fb1-b1c6-cabae2e93195 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:01.062673 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2e8fe-1a40-4d8d-89f5-ad63d641d589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:01.063553 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2e8fe-1a40-4d8d-89f5-ad63d641d589 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:01.063873 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2e8fe-1a40-4d8d-89f5-ad63d641d589 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:01.064185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2e8fe-1a40-4d8d-89f5-ad63d641d589 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:01.068081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:01.076711 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2e8fe-1a40-4d8d-89f5-ad63d641d589 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:01.079470 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2e8fe-1a40-4d8d-89f5-ad63d641d589 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:01.099717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-c7a2e8fe-1a40-4d8d-89f5-ad63d641d589 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 21:56:01.099717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:56:01.099717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:56:01.099717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:56:01.099717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:56:01.099717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:56:01.099717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:56:01.099717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:56:01.099717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:56:01.099717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:56:01.099717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:56:01.099717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:56:01.099717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:56:01.099717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:56:01.099717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:56:01.099717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:56:01.101047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:56:01.101047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:56:01.101047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:56:01.101047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:56:01.101047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:56:01.101047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:56:01.101047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:56:01.101047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:56:01.101047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:56:01.101047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:56:01.101047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:56:01.101047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:56:01.101047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:56:01.101047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:56:01.101047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:56:01.101047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:56:01.101047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:56:01.101047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:56:01.102681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:56:01.102681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:56:01.102681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:56:01.102681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:56:01.102681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:56:01.102681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:56:01.102681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:56:01.102681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:56:01.102681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 21:56:01.102681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:56:01.102681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 622/1239] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:56:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:56:01.109264 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366be0f6-5611-45df-94e9-0b795bd25903 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:01.225139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366be0f6-5611-45df-94e9-0b795bd25903 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:01.269584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23650dc1-c2ee-4889-a87a-bbf214d51949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:01.270376 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23650dc1-c2ee-4889-a87a-bbf214d51949 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:01.270771 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23650dc1-c2ee-4889-a87a-bbf214d51949 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:01.270935 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23650dc1-c2ee-4889-a87a-bbf214d51949 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:01.271893 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23650dc1-c2ee-4889-a87a-bbf214d51949 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:01.272209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23650dc1-c2ee-4889-a87a-bbf214d51949 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:01.274014 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23650dc1-c2ee-4889-a87a-bbf214d51949 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:01.294813 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 618/1240] 10.222.0.35 () {56 vars in 1143 bytes} [Thu May 19 21:56:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:01.300690 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2e8fe-1a40-4d8d-89f5-ad63d641d589 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:01.429219 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2e8fe-1a40-4d8d-89f5-ad63d641d589 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:01.473884 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25055ca4-bca6-4a4b-a042-98c4203ce85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:01.474628 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25055ca4-bca6-4a4b-a042-98c4203ce85c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:01.474914 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25055ca4-bca6-4a4b-a042-98c4203ce85c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:01.475201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25055ca4-bca6-4a4b-a042-98c4203ce85c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:01.546634 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:01.557377 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25055ca4-bca6-4a4b-a042-98c4203ce85c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:01.559044 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25055ca4-bca6-4a4b-a042-98c4203ce85c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:01.688123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 623/1241] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:56:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:56:01.694093 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23650dc1-c2ee-4889-a87a-bbf214d51949 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:01.725989 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:01.811089 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23650dc1-c2ee-4889-a87a-bbf214d51949 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:01.850057 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b29486-2d2b-471d-8d8d-38416e28dfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:01.850880 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b29486-2d2b-471d-8d8d-38416e28dfd2 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:01.851163 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b29486-2d2b-471d-8d8d-38416e28dfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:01.851437 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b29486-2d2b-471d-8d8d-38416e28dfd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:01.863123 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b29486-2d2b-471d-8d8d-38416e28dfd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:01.864631 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b29486-2d2b-471d-8d8d-38416e28dfd2 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:01.886714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-29b29486-2d2b-471d-8d8d-38416e28dfd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:56:01.886714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:56:01.886714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:56:01.886714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:56:01.886714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:56:01.886714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:56:01.886714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:56:01.886714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:56:01.886714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:56:01.886714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:56:01.886714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:56:01.886714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:56:01.886714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:56:01.886714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:56:01.886714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:56:01.887772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:56:01.887772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:56:01.887772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:56:01.887772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:56:01.887772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:56:01.887772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:56:01.887772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:56:01.887772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:56:01.887772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:56:01.887772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:56:01.887772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:56:01.887772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:56:01.887772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:56:01.887772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:56:01.887772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:56:01.887772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:56:01.887772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:56:01.888726 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:56:01.888726 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:56:01.888726 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:56:01.888726 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:56:01.888726 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 619/1242] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:56:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:56:01.893958 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25055ca4-bca6-4a4b-a042-98c4203ce85c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:02.012361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:02.018863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25055ca4-bca6-4a4b-a042-98c4203ce85c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:02.059188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245b049-1fcc-4302-88e9-990ea100b47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:02.060136 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245b049-1fcc-4302-88e9-990ea100b47c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:02.060274 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245b049-1fcc-4302-88e9-990ea100b47c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:02.060787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245b049-1fcc-4302-88e9-990ea100b47c None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:02.061357 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3245b049-1fcc-4302-88e9-990ea100b47c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:02.061669 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3245b049-1fcc-4302-88e9-990ea100b47c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:02.063080 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3245b049-1fcc-4302-88e9-990ea100b47c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:02.076589 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 624/1243] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:02.082487 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b29486-2d2b-471d-8d8d-38416e28dfd2 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:02.190842 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:02.219273 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b29486-2d2b-471d-8d8d-38416e28dfd2 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:02.264527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d5cd6-5453-447e-93f2-c9f5ba7a3682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:02.265340 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d5cd6-5453-447e-93f2-c9f5ba7a3682 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:02.265623 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d5cd6-5453-447e-93f2-c9f5ba7a3682 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:02.265902 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d5cd6-5453-447e-93f2-c9f5ba7a3682 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:02.276267 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d5cd6-5453-447e-93f2-c9f5ba7a3682 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:02.277997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d5cd6-5453-447e-93f2-c9f5ba7a3682 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:02.293988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-b68d5cd6-5453-447e-93f2-c9f5ba7a3682 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:56:02.293988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:56:02.293988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:56:02.293988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:56:02.293988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:56:02.293988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:56:02.293988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:56:02.293988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:56:02.293988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:56:02.293988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:56:02.293988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:56:02.293988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:56:02.293988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:56:02.293988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:56:02.293988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:56:02.296059 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:56:02.296059 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:56:02.296059 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:56:02.296059 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:56:02.296059 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:56:02.296059 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:56:02.296059 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:56:02.296059 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:56:02.296059 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:56:02.296059 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:56:02.296059 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:56:02.296059 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:56:02.296059 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:56:02.296059 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:56:02.296059 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:56:02.296059 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:56:02.296059 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:56:02.297874 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:56:02.297874 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:56:02.297874 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:56:02.297874 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:56:02.297874 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:56:02.297874 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:56:02.297874 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:56:02.297874 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:56:02.297874 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 620/1244] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:56:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:56:02.302166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245b049-1fcc-4302-88e9-990ea100b47c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:02.440012 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245b049-1fcc-4302-88e9-990ea100b47c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:02.481398 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15751c3-d868-4730-90c6-3efdc6d1d1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:02.482082 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15751c3-d868-4730-90c6-3efdc6d1d1a9 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:02.482365 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15751c3-d868-4730-90c6-3efdc6d1d1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:02.482639 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15751c3-d868-4730-90c6-3efdc6d1d1a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:02.483435 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15751c3-d868-4730-90c6-3efdc6d1d1a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:02.483743 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15751c3-d868-4730-90c6-3efdc6d1d1a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:02.485336 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15751c3-d868-4730-90c6-3efdc6d1d1a9 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:02.499704 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 625/1245] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:56:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:56:02.505735 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d5cd6-5453-447e-93f2-c9f5ba7a3682 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:02.644948 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d5cd6-5453-447e-93f2-c9f5ba7a3682 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:02.687096 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df629f-ed9a-4461-8a6b-a6862a5bb40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:02.687834 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df629f-ed9a-4461-8a6b-a6862a5bb40f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:02.688225 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df629f-ed9a-4461-8a6b-a6862a5bb40f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:02.688544 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df629f-ed9a-4461-8a6b-a6862a5bb40f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:02.689587 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df629f-ed9a-4461-8a6b-a6862a5bb40f None admin] RBAC: Adding query filter params (role.id=372e9dc71b5a4a4daddc43ab384fa67b, scope.project.id=89b20e18525c473e94a2b263148f1f5f, user.id=b1004beeeaed4af4a92c89ad31008b32) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:02.689939 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df629f-ed9a-4461-8a6b-a6862a5bb40f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:02.691414 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df629f-ed9a-4461-8a6b-a6862a5bb40f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:02.712437 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 621/1246] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:56:02 2022] GET /identity/v3/role_assignments?user.id=b1004beeeaed4af4a92c89ad31008b32&scope.project.id=89b20e18525c473e94a2b263148f1f5f&role.id=372e9dc71b5a4a4daddc43ab384fa67b => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:05.249232 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb2ec3-1e6f-461a-b4f6-40a757236791 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:05.249821 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb2ec3-1e6f-461a-b4f6-40a757236791 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:05.249821 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb2ec3-1e6f-461a-b4f6-40a757236791 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:05.251431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 626/1247] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:56:05.256857 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796e860-59ad-4156-ae09-3793602319c7 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:05.257265 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796e860-59ad-4156-ae09-3793602319c7 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:05.257401 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796e860-59ad-4156-ae09-3793602319c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:05.263198 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:05.276334 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-f796e860-59ad-4156-ae09-3793602319c7 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:56:05.277583 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f796e860-59ad-4156-ae09-3793602319c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:05.359373 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 622/1248] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:56:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:56:05.389460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb2ec3-1e6f-461a-b4f6-40a757236791 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:05.412748 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:05.525544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb2ec3-1e6f-461a-b4f6-40a757236791 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:05.565594 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e6327-21b8-4b8c-abc9-5238a742c4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:05.566403 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e6327-21b8-4b8c-abc9-5238a742c4cd None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:05.566688 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e6327-21b8-4b8c-abc9-5238a742c4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:05.566978 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e6327-21b8-4b8c-abc9-5238a742c4cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:05.578057 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e6327-21b8-4b8c-abc9-5238a742c4cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:56:05.586189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-f56e6327-21b8-4b8c-abc9-5238a742c4cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:56:05.586189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:56:05.586189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:56:05.586189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:56:05.586189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:56:05.586189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:56:05.586189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:56:05.586189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:56:05.586189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:56:05.586189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:56:05.586189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:56:05.586189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:56:05.586189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:56:05.586189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:56:05.586189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:56:05.586189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:56:05.588250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:56:05.588250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:56:05.588250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:56:05.588250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:56:05.588250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:56:05.588250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:56:05.588250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:56:05.588250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:56:05.588250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:56:05.588250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:56:05.588250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:56:05.588250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:56:05.588250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:56:05.588250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:56:05.588250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:56:05.588250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:56:05.589375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:56:05.589375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:56:05.589375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:56:05.589375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:56:05.589375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:56:05.589375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:56:05.589375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:56:05.589375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:56:05.589375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:56:05.589375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:56:05.589375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:56:05.589375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:56:05.589375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 627/1249] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:56:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:56:05.594213 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796e860-59ad-4156-ae09-3793602319c7 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:05.731625 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796e860-59ad-4156-ae09-3793602319c7 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:05.772753 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:05.780907 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad3250-8d58-4f48-91d9-b0e1e63fae21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:05.781464 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad3250-8d58-4f48-91d9-b0e1e63fae21 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:05.781797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad3250-8d58-4f48-91d9-b0e1e63fae21 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:05.782091 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad3250-8d58-4f48-91d9-b0e1e63fae21 None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:05.783105 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad3250-8d58-4f48-91d9-b0e1e63fae21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:05.783581 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad3250-8d58-4f48-91d9-b0e1e63fae21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:05.785219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad3250-8d58-4f48-91d9-b0e1e63fae21 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:05.798602 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 623/1250] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:56:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:05.805034 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e6327-21b8-4b8c-abc9-5238a742c4cd None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:05.894252 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:05.924092 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e6327-21b8-4b8c-abc9-5238a742c4cd None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:05.962310 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6c8ff-cee4-42f9-8c5a-0ced91d8f412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:05.963491 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6c8ff-cee4-42f9-8c5a-0ced91d8f412 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:05.963951 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6c8ff-cee4-42f9-8c5a-0ced91d8f412 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:05.964362 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6c8ff-cee4-42f9-8c5a-0ced91d8f412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:05.976366 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6c8ff-cee4-42f9-8c5a-0ced91d8f412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:05.978155 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6c8ff-cee4-42f9-8c5a-0ced91d8f412 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:05.998654 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-efd6c8ff-cee4-42f9-8c5a-0ced91d8f412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:56:05.998654 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:56:05.998654 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:56:05.998654 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:56:05.998654 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:56:05.998654 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:56:05.998654 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:56:05.998654 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:56:05.998654 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:56:05.998654 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:56:05.998654 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:56:05.998654 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:56:05.998654 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:56:05.998654 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:56:05.998654 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:56:05.999739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:56:05.999739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:56:05.999739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:56:05.999739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:56:05.999739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:56:05.999739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:56:05.999739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:56:05.999739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:56:05.999739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:56:05.999739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:56:05.999739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:56:05.999739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:56:05.999739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:56:05.999739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:56:05.999739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:56:05.999739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:56:05.999739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:56:06.000835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:56:06.000835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:56:06.000835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:56:06.000835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:56:06.005312 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 628/1251] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:56:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:56:06.013568 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad3250-8d58-4f48-91d9-b0e1e63fae21 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:06.137741 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad3250-8d58-4f48-91d9-b0e1e63fae21 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:06.182503 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5ae7e-b4d8-4251-9cab-2afbe7ae7a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:06.183254 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5ae7e-b4d8-4251-9cab-2afbe7ae7a34 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:06.183544 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5ae7e-b4d8-4251-9cab-2afbe7ae7a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:06.183821 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5ae7e-b4d8-4251-9cab-2afbe7ae7a34 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:06.184641 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5ae7e-b4d8-4251-9cab-2afbe7ae7a34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:06.184964 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5ae7e-b4d8-4251-9cab-2afbe7ae7a34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:06.186457 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5ae7e-b4d8-4251-9cab-2afbe7ae7a34 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:06.201338 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 624/1252] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:06.207116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6c8ff-cee4-42f9-8c5a-0ced91d8f412 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:06.331184 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6c8ff-cee4-42f9-8c5a-0ced91d8f412 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:06.363471 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:06.375364 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda6ea2-82a4-4dd2-8662-b19a0692c6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:06.376379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda6ea2-82a4-4dd2-8662-b19a0692c6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:06.376704 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda6ea2-82a4-4dd2-8662-b19a0692c6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:06.377020 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda6ea2-82a4-4dd2-8662-b19a0692c6a3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:06.387174 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda6ea2-82a4-4dd2-8662-b19a0692c6a3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:06.388733 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda6ea2-82a4-4dd2-8662-b19a0692c6a3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:06.404979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-7bda6ea2-82a4-4dd2-8662-b19a0692c6a3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 21:56:06.404979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:56:06.404979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:56:06.404979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:56:06.404979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:56:06.404979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:56:06.404979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:56:06.404979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:56:06.404979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:56:06.404979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:56:06.404979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:56:06.404979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:56:06.404979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:56:06.404979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:56:06.404979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:56:06.404979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:56:06.406103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:56:06.406103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:56:06.406103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:56:06.406103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:56:06.406103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:56:06.406103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:56:06.406103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:56:06.406103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:56:06.406103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:56:06.406103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:56:06.406103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:56:06.406103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:56:06.406103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:56:06.406103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:56:06.406103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:56:06.406103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:56:06.406103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:56:06.406103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:56:06.407507 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:56:06.407507 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:56:06.407507 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:56:06.407507 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:56:06.407507 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:56:06.407507 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:56:06.407507 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:56:06.407507 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:56:06.407507 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 21:56:06.407507 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:56:06.407507 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 629/1253] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:56:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:56:06.412841 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5ae7e-b4d8-4251-9cab-2afbe7ae7a34 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:06.490960 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:06.546600 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5ae7e-b4d8-4251-9cab-2afbe7ae7a34 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:06.588696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc6257-cd1b-4511-8ded-72dc94e18b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:06.589491 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc6257-cd1b-4511-8ded-72dc94e18b0d None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:06.589848 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc6257-cd1b-4511-8ded-72dc94e18b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:06.590196 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc6257-cd1b-4511-8ded-72dc94e18b0d None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:06.591505 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc6257-cd1b-4511-8ded-72dc94e18b0d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:06.591981 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc6257-cd1b-4511-8ded-72dc94e18b0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:06.594296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc6257-cd1b-4511-8ded-72dc94e18b0d None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:06.623292 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 625/1254] 10.222.0.35 () {56 vars in 1143 bytes} [Thu May 19 21:56:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:06.629173 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda6ea2-82a4-4dd2-8662-b19a0692c6a3 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:06.760829 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda6ea2-82a4-4dd2-8662-b19a0692c6a3 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:06.798717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d32e22-e9b3-440d-ab7b-27bcf8a96704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:06.799544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d32e22-e9b3-440d-ab7b-27bcf8a96704 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:06.799656 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d32e22-e9b3-440d-ab7b-27bcf8a96704 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:06.799934 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d32e22-e9b3-440d-ab7b-27bcf8a96704 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:06.866545 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:06.881798 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d32e22-e9b3-440d-ab7b-27bcf8a96704 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:06.883509 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d32e22-e9b3-440d-ab7b-27bcf8a96704 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:07.009088 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 630/1255] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:56:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 21:56:07.015705 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc6257-cd1b-4511-8ded-72dc94e18b0d None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:07.138469 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc6257-cd1b-4511-8ded-72dc94e18b0d None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:07.154648 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:07.181965 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471e96d-8ce4-4b74-8927-2b4f407e5bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:07.182816 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471e96d-8ce4-4b74-8927-2b4f407e5bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:07.183127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471e96d-8ce4-4b74-8927-2b4f407e5bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:07.183412 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471e96d-8ce4-4b74-8927-2b4f407e5bb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:07.194635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471e96d-8ce4-4b74-8927-2b4f407e5bb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:07.196914 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471e96d-8ce4-4b74-8927-2b4f407e5bb7 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:07.217158 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-2471e96d-8ce4-4b74-8927-2b4f407e5bb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:56:07.217158 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:56:07.217158 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:56:07.217158 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:56:07.217158 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:56:07.217158 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:56:07.217158 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:56:07.217158 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:56:07.217158 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:56:07.217158 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:56:07.217158 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:56:07.217158 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:56:07.217158 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:56:07.217158 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:56:07.217158 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:56:07.218155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:56:07.218155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:56:07.218155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:56:07.218155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:56:07.218155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:56:07.218155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:56:07.218155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:56:07.218155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:56:07.218155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:56:07.218155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:56:07.218155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:56:07.218155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:56:07.218155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:56:07.218155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:56:07.218155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:56:07.218155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:56:07.218155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:56:07.219054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:56:07.219054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:56:07.219054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:56:07.219054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:56:07.219054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 626/1256] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:56:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:56:07.226521 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d32e22-e9b3-440d-ab7b-27bcf8a96704 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:07.341123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:07.353230 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d32e22-e9b3-440d-ab7b-27bcf8a96704 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:07.394488 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8de82-043e-4863-907b-f6d187a1c15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:07.395156 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8de82-043e-4863-907b-f6d187a1c15c None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:07.395503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8de82-043e-4863-907b-f6d187a1c15c None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:07.395782 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8de82-043e-4863-907b-f6d187a1c15c None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:07.396634 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8de82-043e-4863-907b-f6d187a1c15c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:07.397568 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8de82-043e-4863-907b-f6d187a1c15c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:07.399857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8de82-043e-4863-907b-f6d187a1c15c None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:07.412269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 631/1257] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:07.417927 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471e96d-8ce4-4b74-8927-2b4f407e5bb7 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:07.538127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471e96d-8ce4-4b74-8927-2b4f407e5bb7 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:07.583418 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a1f3c-6dbf-47d8-b88a-a676bf873a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:07.584235 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a1f3c-6dbf-47d8-b88a-a676bf873a1e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:07.584557 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a1f3c-6dbf-47d8-b88a-a676bf873a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:07.584839 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a1f3c-6dbf-47d8-b88a-a676bf873a1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:07.593035 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a1f3c-6dbf-47d8-b88a-a676bf873a1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:07.594445 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a1f3c-6dbf-47d8-b88a-a676bf873a1e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:07.609795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-a18a1f3c-6dbf-47d8-b88a-a676bf873a1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:56:07.609795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:56:07.609795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:56:07.609795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:56:07.609795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:56:07.609795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:56:07.609795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:56:07.609795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:56:07.609795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:56:07.609795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:56:07.609795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:56:07.609795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:56:07.609795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:56:07.609795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:56:07.609795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:56:07.610945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:56:07.610945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:56:07.610945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:56:07.610945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:56:07.610945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:56:07.610945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:56:07.610945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:56:07.610945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:56:07.610945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:56:07.610945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:56:07.610945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:56:07.610945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:56:07.610945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:56:07.610945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:56:07.610945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:56:07.610945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:56:07.610945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:56:07.611857 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:56:07.611857 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:56:07.611857 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:56:07.611857 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:56:07.611857 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:56:07.611857 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:56:07.611857 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:56:07.611857 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:56:07.611857 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 627/1258] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:56:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:56:07.617319 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8de82-043e-4863-907b-f6d187a1c15c None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:07.739812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8de82-043e-4863-907b-f6d187a1c15c None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:07.777417 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c2f35-64c0-4ec7-9b0b-0c7dc14c733f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:07.778103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c2f35-64c0-4ec7-9b0b-0c7dc14c733f None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:07.778459 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c2f35-64c0-4ec7-9b0b-0c7dc14c733f None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:07.778737 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c2f35-64c0-4ec7-9b0b-0c7dc14c733f None admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:07.779600 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c2f35-64c0-4ec7-9b0b-0c7dc14c733f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:07.779919 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c2f35-64c0-4ec7-9b0b-0c7dc14c733f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:07.781473 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c2f35-64c0-4ec7-9b0b-0c7dc14c733f None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:07.796153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 632/1259] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:56:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:07.802303 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a1f3c-6dbf-47d8-b88a-a676bf873a1e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:07.831943 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:07.935184 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a1f3c-6dbf-47d8-b88a-a676bf873a1e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:07.978042 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcde2e-0103-41ff-bc47-f8bb937a7c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:07.978804 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcde2e-0103-41ff-bc47-f8bb937a7c3b None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:07.979096 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcde2e-0103-41ff-bc47-f8bb937a7c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:07.979377 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcde2e-0103-41ff-bc47-f8bb937a7c3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:07.980225 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dcde2e-0103-41ff-bc47-f8bb937a7c3b None admin] RBAC: Adding query filter params (role.id=04369f3c13174671a298fcd8175998d8, scope.project.id=89b20e18525c473e94a2b263148f1f5f, user.id=b1004beeeaed4af4a92c89ad31008b32) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:07.980583 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dcde2e-0103-41ff-bc47-f8bb937a7c3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:07.982020 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dcde2e-0103-41ff-bc47-f8bb937a7c3b None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:07.988843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 628/1260] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:56:07 2022] GET /identity/v3/role_assignments?user.id=b1004beeeaed4af4a92c89ad31008b32&scope.project.id=89b20e18525c473e94a2b263148f1f5f&role.id=04369f3c13174671a298fcd8175998d8 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:10.228907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1905cbf-1f0e-4c08-83f9-1345669f4210 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:10.229481 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1905cbf-1f0e-4c08-83f9-1345669f4210 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:10.229481 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1905cbf-1f0e-4c08-83f9-1345669f4210 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:10.230871 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 633/1261] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:56:10.236828 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824cf6c-f3b0-41c2-9a3b-b7cdb507f29c None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:10.237340 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824cf6c-f3b0-41c2-9a3b-b7cdb507f29c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:10.237431 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824cf6c-f3b0-41c2-9a3b-b7cdb507f29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:10.254942 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-4824cf6c-f3b0-41c2-9a3b-b7cdb507f29c None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:56:10.256131 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4824cf6c-f3b0-41c2-9a3b-b7cdb507f29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:10.323944 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 629/1262] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:56:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:56:10.346766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1905cbf-1f0e-4c08-83f9-1345669f4210 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:10.358372 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:10.455394 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1905cbf-1f0e-4c08-83f9-1345669f4210 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:10.489993 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b35b1-d19e-4e43-bf9f-38fbccef7a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:10.491342 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b35b1-d19e-4e43-bf9f-38fbccef7a15 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:10.491822 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b35b1-d19e-4e43-bf9f-38fbccef7a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:10.492216 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b35b1-d19e-4e43-bf9f-38fbccef7a15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:10.507040 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b35b1-d19e-4e43-bf9f-38fbccef7a15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:56:10.514782 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-ff2b35b1-d19e-4e43-bf9f-38fbccef7a15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:56:10.514782 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:56:10.514782 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:56:10.514782 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:56:10.514782 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:56:10.514782 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:56:10.514782 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:56:10.514782 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:56:10.514782 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:56:10.514782 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:56:10.514782 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:56:10.514782 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:56:10.514782 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:56:10.514782 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:56:10.514782 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:56:10.514782 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:56:10.515950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:56:10.515950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:56:10.515950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:56:10.515950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:56:10.515950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:56:10.515950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:56:10.515950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:56:10.515950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:56:10.515950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:56:10.515950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:56:10.515950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:56:10.515950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:56:10.515950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:56:10.515950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:56:10.515950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:56:10.515950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:56:10.516998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:56:10.516998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:56:10.516998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:56:10.516998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:56:10.516998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:56:10.516998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:56:10.516998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:56:10.516998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:56:10.516998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:56:10.516998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:56:10.516998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:56:10.516998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:56:10.516998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 634/1263] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:56:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:56:10.522143 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824cf6c-f3b0-41c2-9a3b-b7cdb507f29c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:10.541118 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:10.630981 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824cf6c-f3b0-41c2-9a3b-b7cdb507f29c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:10.667816 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b87332-fe94-4521-bb75-4879d88ba6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:10.668526 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b87332-fe94-4521-bb75-4879d88ba6ef None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:10.668815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b87332-fe94-4521-bb75-4879d88ba6ef None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:10.669094 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b87332-fe94-4521-bb75-4879d88ba6ef None admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:10.669861 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b87332-fe94-4521-bb75-4879d88ba6ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:10.670174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b87332-fe94-4521-bb75-4879d88ba6ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:10.671550 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b87332-fe94-4521-bb75-4879d88ba6ef None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:10.679977 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 630/1264] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:56:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:10.685897 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b35b1-d19e-4e43-bf9f-38fbccef7a15 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:10.764716 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:10.799028 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b35b1-d19e-4e43-bf9f-38fbccef7a15 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:10.832668 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3b29b-dafc-4364-8e2d-9dbcb3a5c339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:10.833455 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3b29b-dafc-4364-8e2d-9dbcb3a5c339 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:10.833736 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3b29b-dafc-4364-8e2d-9dbcb3a5c339 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:10.834004 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3b29b-dafc-4364-8e2d-9dbcb3a5c339 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:10.844935 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3b29b-dafc-4364-8e2d-9dbcb3a5c339 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:10.846372 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3b29b-dafc-4364-8e2d-9dbcb3a5c339 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:10.863852 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-e8e3b29b-dafc-4364-8e2d-9dbcb3a5c339 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:56:10.863852 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:56:10.863852 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:56:10.863852 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:56:10.863852 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:56:10.863852 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:56:10.863852 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:56:10.863852 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:56:10.863852 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:56:10.863852 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:56:10.863852 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:56:10.863852 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:56:10.863852 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:56:10.863852 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:56:10.863852 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:56:10.865023 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:56:10.865023 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:56:10.865023 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:56:10.865023 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:56:10.865023 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:56:10.865023 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:56:10.865023 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:56:10.865023 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:56:10.865023 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:56:10.865023 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:56:10.865023 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:56:10.865023 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:56:10.865023 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:56:10.865023 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:56:10.865023 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:56:10.865023 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:56:10.865023 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:56:10.869746 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:56:10.869746 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:56:10.869746 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:56:10.869746 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:56:10.869746 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 635/1265] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:56:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:56:10.871321 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b87332-fe94-4521-bb75-4879d88ba6ef None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:10.952948 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:10.973862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b87332-fe94-4521-bb75-4879d88ba6ef None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:11.009804 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ca027-f4bb-4e09-a2b2-7fcd8bcdc87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:11.010505 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ca027-f4bb-4e09-a2b2-7fcd8bcdc87e None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:11.010785 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ca027-f4bb-4e09-a2b2-7fcd8bcdc87e None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:11.011071 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ca027-f4bb-4e09-a2b2-7fcd8bcdc87e None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:11.011958 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ca027-f4bb-4e09-a2b2-7fcd8bcdc87e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:11.012184 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ca027-f4bb-4e09-a2b2-7fcd8bcdc87e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:11.013603 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ca027-f4bb-4e09-a2b2-7fcd8bcdc87e None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:11.027302 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 631/1266] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:11.034698 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3b29b-dafc-4364-8e2d-9dbcb3a5c339 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:11.142699 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3b29b-dafc-4364-8e2d-9dbcb3a5c339 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:11.162087 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:11.177844 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e8fb9-54f2-4533-94f3-918efa3c9b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:11.178659 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e8fb9-54f2-4533-94f3-918efa3c9b59 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:11.178941 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e8fb9-54f2-4533-94f3-918efa3c9b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:11.179217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e8fb9-54f2-4533-94f3-918efa3c9b59 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:11.187771 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e8fb9-54f2-4533-94f3-918efa3c9b59 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:11.189247 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e8fb9-54f2-4533-94f3-918efa3c9b59 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:11.203233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-798e8fb9-54f2-4533-94f3-918efa3c9b59 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 21:56:11.203233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:56:11.203233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:56:11.203233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:56:11.203233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:56:11.203233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:56:11.203233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:56:11.203233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:56:11.203233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:56:11.203233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:56:11.203233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:56:11.203233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:56:11.203233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:56:11.203233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:56:11.203233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:56:11.203233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:56:11.207658 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:56:11.207658 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:56:11.207658 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:56:11.207658 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:56:11.207658 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:56:11.207658 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:56:11.207658 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:56:11.207658 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:56:11.207658 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:56:11.207658 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:56:11.207658 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:56:11.207658 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:56:11.207658 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:56:11.207658 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:56:11.207658 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:56:11.207658 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:56:11.207658 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:56:11.207658 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:56:11.208765 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:56:11.208765 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:56:11.208765 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:56:11.208765 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:56:11.208765 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:56:11.208765 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:56:11.208765 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:56:11.208765 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:56:11.208765 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 21:56:11.208765 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:56:11.208765 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 636/1267] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:56:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:56:11.210180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ca027-f4bb-4e09-a2b2-7fcd8bcdc87e None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:11.313274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ca027-f4bb-4e09-a2b2-7fcd8bcdc87e None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:11.350354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552d970-11c5-43f1-80a5-b6debe40b5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:11.351054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552d970-11c5-43f1-80a5-b6debe40b5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:11.351335 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552d970-11c5-43f1-80a5-b6debe40b5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:11.351662 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552d970-11c5-43f1-80a5-b6debe40b5e4 None admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:11.352972 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552d970-11c5-43f1-80a5-b6debe40b5e4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:11.353289 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552d970-11c5-43f1-80a5-b6debe40b5e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:11.354706 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552d970-11c5-43f1-80a5-b6debe40b5e4 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:11.363524 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:11.373660 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 632/1268] 10.222.0.35 () {56 vars in 1143 bytes} [Thu May 19 21:56:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:11.379426 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e8fb9-54f2-4533-94f3-918efa3c9b59 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:11.486260 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e8fb9-54f2-4533-94f3-918efa3c9b59 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:11.520385 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ad99d-222e-44cb-a2aa-62807daec14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:11.521196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ad99d-222e-44cb-a2aa-62807daec14d None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:11.521482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ad99d-222e-44cb-a2aa-62807daec14d None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:11.521759 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ad99d-222e-44cb-a2aa-62807daec14d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:11.532719 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ad99d-222e-44cb-a2aa-62807daec14d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:11.534179 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ad99d-222e-44cb-a2aa-62807daec14d None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:11.552740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-9e9ad99d-222e-44cb-a2aa-62807daec14d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:56:11.552740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:56:11.552740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:56:11.552740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:56:11.552740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:56:11.552740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:56:11.552740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:56:11.552740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:56:11.552740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:56:11.552740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:56:11.552740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:56:11.552740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:56:11.552740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:56:11.552740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:56:11.552740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:56:11.553960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:56:11.553960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:56:11.553960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:56:11.553960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:56:11.553960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:56:11.553960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:56:11.553960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:56:11.553960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:56:11.553960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:56:11.553960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:56:11.553960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:56:11.553960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:56:11.553960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:56:11.553960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:56:11.553960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:56:11.553960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:56:11.553960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:56:11.555250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:56:11.555250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:56:11.555250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:56:11.555250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:56:11.555250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 637/1269] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:56:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:56:11.559842 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552d970-11c5-43f1-80a5-b6debe40b5e4 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:11.670804 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552d970-11c5-43f1-80a5-b6debe40b5e4 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:11.707149 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74678d39-8ad1-405c-a18f-f8a990b8b87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:11.707898 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74678d39-8ad1-405c-a18f-f8a990b8b87a None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:11.708101 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74678d39-8ad1-405c-a18f-f8a990b8b87a None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:11.708379 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74678d39-8ad1-405c-a18f-f8a990b8b87a None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:11.709146 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74678d39-8ad1-405c-a18f-f8a990b8b87a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:11.709454 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74678d39-8ad1-405c-a18f-f8a990b8b87a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:11.710830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74678d39-8ad1-405c-a18f-f8a990b8b87a None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:11.723046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 633/1270] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 21:56:11.729634 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ad99d-222e-44cb-a2aa-62807daec14d None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:11.763331 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:11.834507 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ad99d-222e-44cb-a2aa-62807daec14d None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:11.869302 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e600d30-9ddf-4da9-9cca-6795d403a799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:11.870359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e600d30-9ddf-4da9-9cca-6795d403a799 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:11.870639 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e600d30-9ddf-4da9-9cca-6795d403a799 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:11.870912 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e600d30-9ddf-4da9-9cca-6795d403a799 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:11.877523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e600d30-9ddf-4da9-9cca-6795d403a799 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:11.878977 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e600d30-9ddf-4da9-9cca-6795d403a799 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:11.893052 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-4e600d30-9ddf-4da9-9cca-6795d403a799 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:56:11.893052 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:56:11.893052 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:56:11.893052 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:56:11.893052 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:56:11.893052 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:56:11.893052 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:56:11.893052 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:56:11.893052 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:56:11.893052 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:56:11.893052 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:56:11.893052 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:56:11.893052 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:56:11.893052 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:56:11.893052 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:56:11.894188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:56:11.894188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:56:11.894188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:56:11.894188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:56:11.894188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:56:11.894188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:56:11.894188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:56:11.894188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:56:11.894188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:56:11.894188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:56:11.894188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:56:11.894188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:56:11.894188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:56:11.894188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:56:11.894188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:56:11.894188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:56:11.894188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:56:11.895289 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:56:11.895289 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:56:11.895289 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:56:11.895289 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:56:11.895289 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:56:11.895289 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:56:11.895289 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:56:11.895289 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:56:11.895289 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 638/1271] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:56:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:56:11.908441 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74678d39-8ad1-405c-a18f-f8a990b8b87a None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:11.973794 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:12.023222 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74678d39-8ad1-405c-a18f-f8a990b8b87a None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:12.057373 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe3380-54dd-4efd-b3ab-5fa4693b5703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:12.058041 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe3380-54dd-4efd-b3ab-5fa4693b5703 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:12.058321 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe3380-54dd-4efd-b3ab-5fa4693b5703 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:12.058593 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe3380-54dd-4efd-b3ab-5fa4693b5703 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:12.059400 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe3380-54dd-4efd-b3ab-5fa4693b5703 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:12.059707 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe3380-54dd-4efd-b3ab-5fa4693b5703 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:12.061193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe3380-54dd-4efd-b3ab-5fa4693b5703 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:12.073891 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 634/1272] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:56:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:12.079854 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e600d30-9ddf-4da9-9cca-6795d403a799 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:12.179772 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:12.188709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e600d30-9ddf-4da9-9cca-6795d403a799 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:12.222581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194c028-bdb3-4c3c-b1d4-8858638541aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:12.223469 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194c028-bdb3-4c3c-b1d4-8858638541aa None admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:12.223747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194c028-bdb3-4c3c-b1d4-8858638541aa None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:12.224070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194c028-bdb3-4c3c-b1d4-8858638541aa None admin] PATH_INFO: `/v3/projects/89b20e18525c473e94a2b263148f1f5f/users/b1004beeeaed4af4a92c89ad31008b32/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:12.225974 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194c028-bdb3-4c3c-b1d4-8858638541aa None admin] RBAC: Authorizing `identity:create_grant(project_id=89b20e18525c473e94a2b263148f1f5f, user_id=b1004beeeaed4af4a92c89ad31008b32, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:12.227980 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194c028-bdb3-4c3c-b1d4-8858638541aa None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:12.240973 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 639/1273] 10.222.0.35 () {58 vars in 1439 bytes} [Thu May 19 21:56:12 2022] PUT /identity/v3/projects/89b20e18525c473e94a2b263148f1f5f/users/b1004beeeaed4af4a92c89ad31008b32/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 21:56:14.581818 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da684b8-8a98-4ec9-85e4-6b82f07aed0a None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:14.582373 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da684b8-8a98-4ec9-85e4-6b82f07aed0a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:14.582373 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da684b8-8a98-4ec9-85e4-6b82f07aed0a None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:14.583709 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 635/1274] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:56:14.589802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08484b-4055-4662-8f3e-38e37522e992 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:14.590216 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08484b-4055-4662-8f3e-38e37522e992 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:14.590362 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08484b-4055-4662-8f3e-38e37522e992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:14.607819 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4c08484b-4055-4662-8f3e-38e37522e992 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:56:14.609080 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4c08484b-4055-4662-8f3e-38e37522e992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:14.687728 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 640/1275] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:56:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:56:14.712303 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da684b8-8a98-4ec9-85e4-6b82f07aed0a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:14.814879 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da684b8-8a98-4ec9-85e4-6b82f07aed0a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:14.833530 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:14.852109 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09338d-c95b-4dc2-982b-5d6842044f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:14.852930 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09338d-c95b-4dc2-982b-5d6842044f90 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:14.853215 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09338d-c95b-4dc2-982b-5d6842044f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:14.853488 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09338d-c95b-4dc2-982b-5d6842044f90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:14.863533 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09338d-c95b-4dc2-982b-5d6842044f90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 21:56:14.871698 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-5b09338d-c95b-4dc2-982b-5d6842044f90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:56:14.871698 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:56:14.871698 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:56:14.871698 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:56:14.871698 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:56:14.871698 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:56:14.871698 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:56:14.871698 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:56:14.871698 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:56:14.871698 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:56:14.871698 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:56:14.871698 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:56:14.871698 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 21:56:14.871698 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 21:56:14.871698 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 21:56:14.871698 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 21:56:14.872816 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 21:56:14.872816 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 21:56:14.872816 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 21:56:14.872816 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 21:56:14.872816 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:56:14.872816 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:56:14.872816 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:56:14.872816 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:56:14.872816 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:56:14.872816 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:56:14.872816 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:56:14.872816 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:56:14.872816 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:56:14.872816 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:56:14.872816 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:56:14.872816 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:56:14.873668 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:56:14.873668 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:56:14.873668 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:56:14.873668 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:56:14.873668 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 21:56:14.873668 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 21:56:14.873668 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 21:56:14.873668 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 21:56:14.873668 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 21:56:14.873668 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 21:56:14.873668 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 21:56:14.873668 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:56:14.873668 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 636/1276] 10.222.0.35 () {56 vars in 1096 bytes} [Thu May 19 21:56:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:56:14.879155 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08484b-4055-4662-8f3e-38e37522e992 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:14.960250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:14.982713 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08484b-4055-4662-8f3e-38e37522e992 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:15.022782 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45830235-6a1f-433f-8381-0ce5d4a8d382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:15.023691 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45830235-6a1f-433f-8381-0ce5d4a8d382 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:15.024676 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45830235-6a1f-433f-8381-0ce5d4a8d382 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:15.024975 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45830235-6a1f-433f-8381-0ce5d4a8d382 None admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:15.025817 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45830235-6a1f-433f-8381-0ce5d4a8d382 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:15.026199 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45830235-6a1f-433f-8381-0ce5d4a8d382 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:15.027950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45830235-6a1f-433f-8381-0ce5d4a8d382 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:15.039053 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 641/1277] 10.222.0.35 () {56 vars in 1099 bytes} [Thu May 19 21:56:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:15.045963 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09338d-c95b-4dc2-982b-5d6842044f90 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:15.152032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09338d-c95b-4dc2-982b-5d6842044f90 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:15.185822 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37067e1-c1e6-4d15-9ac7-73b8115305ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:15.186576 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37067e1-c1e6-4d15-9ac7-73b8115305ae None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:15.186862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37067e1-c1e6-4d15-9ac7-73b8115305ae None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:15.187141 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37067e1-c1e6-4d15-9ac7-73b8115305ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:15.199305 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37067e1-c1e6-4d15-9ac7-73b8115305ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:15.200791 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37067e1-c1e6-4d15-9ac7-73b8115305ae None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:15.217820 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-c37067e1-c1e6-4d15-9ac7-73b8115305ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:56:15.217820 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:56:15.217820 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:56:15.217820 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:56:15.217820 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:56:15.217820 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:56:15.217820 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:56:15.217820 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:56:15.217820 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:56:15.217820 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:56:15.217820 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:56:15.217820 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:56:15.217820 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:56:15.217820 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:56:15.217820 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:56:15.218855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:56:15.218855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:56:15.218855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:56:15.218855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:56:15.218855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:56:15.218855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:56:15.218855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:56:15.218855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:56:15.218855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:56:15.218855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:56:15.218855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:56:15.218855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:56:15.218855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:56:15.218855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:56:15.218855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:56:15.218855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:56:15.218855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:56:15.219959 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:56:15.219959 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:56:15.219959 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:56:15.219959 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:56:15.219959 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 637/1278] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:56:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:56:15.224710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45830235-6a1f-433f-8381-0ce5d4a8d382 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:15.331176 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45830235-6a1f-433f-8381-0ce5d4a8d382 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:15.365711 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cb92c-5532-423a-85dc-0e14ac269ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:15.366381 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cb92c-5532-423a-85dc-0e14ac269ace None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:15.366668 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cb92c-5532-423a-85dc-0e14ac269ace None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:15.366947 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cb92c-5532-423a-85dc-0e14ac269ace None admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:15.368202 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cb92c-5532-423a-85dc-0e14ac269ace None admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:15.369038 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cb92c-5532-423a-85dc-0e14ac269ace None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:15.370182 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cb92c-5532-423a-85dc-0e14ac269ace None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:15.382113 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 642/1279] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:15.388558 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37067e1-c1e6-4d15-9ac7-73b8115305ae None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:15.420348 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:15.504805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37067e1-c1e6-4d15-9ac7-73b8115305ae None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:15.538823 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91069b46-913e-4d7a-ab60-909b4b5015e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:15.540229 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91069b46-913e-4d7a-ab60-909b4b5015e9 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:15.540781 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91069b46-913e-4d7a-ab60-909b4b5015e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:15.541165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91069b46-913e-4d7a-ab60-909b4b5015e9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:15.555354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91069b46-913e-4d7a-ab60-909b4b5015e9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:15.557455 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91069b46-913e-4d7a-ab60-909b4b5015e9 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:15.572906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-91069b46-913e-4d7a-ab60-909b4b5015e9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 21:56:15.572906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:56:15.572906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:56:15.572906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:56:15.572906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:56:15.572906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:56:15.572906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:56:15.572906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:56:15.572906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:56:15.572906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:56:15.572906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:56:15.572906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:56:15.572906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 21:56:15.572906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 21:56:15.572906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 21:56:15.572906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 21:56:15.574054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:56:15.574054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:56:15.574054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 21:56:15.574054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:56:15.574054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 21:56:15.574054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 21:56:15.574054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:56:15.574054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:56:15.574054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:56:15.574054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:56:15.574054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:56:15.574054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:56:15.574054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:56:15.574054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:56:15.574054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:56:15.574054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:56:15.574054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:56:15.574054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:56:15.575219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:56:15.575219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:56:15.575219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 21:56:15.575219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 21:56:15.575219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 21:56:15.575219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 21:56:15.575219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 21:56:15.575219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 21:56:15.575219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 21:56:15.575219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:56:15.575219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 638/1280] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:56:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:56:15.579987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cb92c-5532-423a-85dc-0e14ac269ace None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:15.583809 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:15.684185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cb92c-5532-423a-85dc-0e14ac269ace None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:15.719692 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b5fdd-8364-421a-9a94-3315ed89c7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:15.720373 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b5fdd-8364-421a-9a94-3315ed89c7dd None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:15.720687 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b5fdd-8364-421a-9a94-3315ed89c7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:15.720966 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b5fdd-8364-421a-9a94-3315ed89c7dd None admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:15.721808 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b5fdd-8364-421a-9a94-3315ed89c7dd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:15.722120 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b5fdd-8364-421a-9a94-3315ed89c7dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:15.723557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b5fdd-8364-421a-9a94-3315ed89c7dd None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:15.740653 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 643/1281] 10.222.0.35 () {56 vars in 1143 bytes} [Thu May 19 21:56:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:15.746733 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91069b46-913e-4d7a-ab60-909b4b5015e9 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:15.840649 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:15.850331 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91069b46-913e-4d7a-ab60-909b4b5015e9 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:15.884913 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b8c9d-ead1-490c-a5ff-4d076883c05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:15.885590 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b8c9d-ead1-490c-a5ff-4d076883c05f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:15.885874 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b8c9d-ead1-490c-a5ff-4d076883c05f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:15.886150 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b8c9d-ead1-490c-a5ff-4d076883c05f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:15.954479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b8c9d-ead1-490c-a5ff-4d076883c05f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:15.955928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b8c9d-ead1-490c-a5ff-4d076883c05f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:16.045067 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:16.056359 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 639/1282] 10.222.0.35 () {58 vars in 1282 bytes} [Thu May 19 21:56:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 21:56:16.062160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b5fdd-8364-421a-9a94-3315ed89c7dd None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:16.124670 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:16.166326 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b5fdd-8364-421a-9a94-3315ed89c7dd None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:16.201076 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6ddd9-2c21-42ef-8673-e21548739500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:16.201859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6ddd9-2c21-42ef-8673-e21548739500 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:16.202137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6ddd9-2c21-42ef-8673-e21548739500 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:16.202406 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6ddd9-2c21-42ef-8673-e21548739500 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:16.212237 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6ddd9-2c21-42ef-8673-e21548739500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:16.213606 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6ddd9-2c21-42ef-8673-e21548739500 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:16.231229 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-4fa6ddd9-2c21-42ef-8673-e21548739500 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:56:16.231229 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:56:16.231229 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:56:16.231229 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:56:16.231229 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:56:16.231229 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:56:16.231229 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:56:16.231229 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:56:16.231229 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:56:16.231229 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:56:16.231229 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:56:16.231229 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:56:16.231229 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 21:56:16.231229 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 21:56:16.231229 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 21:56:16.232385 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 21:56:16.232385 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:56:16.232385 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:56:16.232385 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:56:16.232385 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:56:16.232385 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:56:16.232385 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:56:16.232385 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:56:16.232385 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:56:16.232385 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:56:16.232385 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:56:16.232385 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:56:16.232385 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:56:16.232385 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:56:16.232385 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:56:16.232385 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:56:16.232385 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:56:16.233710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 21:56:16.233710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 21:56:16.233710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 21:56:16.233710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:56:16.233710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 644/1283] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 21:56:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:56:16.238172 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b8c9d-ead1-490c-a5ff-4d076883c05f None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:16.338065 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b8c9d-ead1-490c-a5ff-4d076883c05f None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:16.374228 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc664ef4-5ba5-4efb-aa6d-bca32f4c6047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:16.374961 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc664ef4-5ba5-4efb-aa6d-bca32f4c6047 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:16.375191 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc664ef4-5ba5-4efb-aa6d-bca32f4c6047 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:16.375467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc664ef4-5ba5-4efb-aa6d-bca32f4c6047 None admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:16.376193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc664ef4-5ba5-4efb-aa6d-bca32f4c6047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:16.376539 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc664ef4-5ba5-4efb-aa6d-bca32f4c6047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:16.377904 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc664ef4-5ba5-4efb-aa6d-bca32f4c6047 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:16.397766 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 640/1284] 10.222.0.35 () {56 vars in 1109 bytes} [Thu May 19 21:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:16.403486 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6ddd9-2c21-42ef-8673-e21548739500 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:16.517326 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6ddd9-2c21-42ef-8673-e21548739500 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:16.531547 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:16.553255 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ba7b1-e684-4f7f-bd5c-ff31b2d556f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:16.554048 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ba7b1-e684-4f7f-bd5c-ff31b2d556f3 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:16.554332 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ba7b1-e684-4f7f-bd5c-ff31b2d556f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:16.554702 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ba7b1-e684-4f7f-bd5c-ff31b2d556f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:16.563272 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ba7b1-e684-4f7f-bd5c-ff31b2d556f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:16.564747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ba7b1-e684-4f7f-bd5c-ff31b2d556f3 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:16.579604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application [None req-aa0ba7b1-e684-4f7f-bd5c-ff31b2d556f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:56:16.579604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:56:16.579604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:56:16.579604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:56:16.579604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:56:16.579604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:56:16.579604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:56:16.579604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:56:16.579604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:56:16.579604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:56:16.579604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:56:16.579604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:56:16.579604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 21:56:16.579604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 21:56:16.579604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 21:56:16.580700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 21:56:16.580700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:56:16.580700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:56:16.580700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:56:16.580700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:56:16.580700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:56:16.580700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:56:16.580700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:56:16.580700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application with Lock( May 19 21:56:16.580700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:56:16.580700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._enter() May 19 21:56:16.580700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:56:16.580700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:56:16.580700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:56:16.580700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.creator() May 19 21:56:16.580700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:56:16.580700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application created_value = creator( May 19 21:56:16.581810 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 21:56:16.581810 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 21:56:16.581810 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 21:56:16.581810 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 21:56:16.581810 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 21:56:16.581810 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 21:56:16.581810 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 21:56:16.581810 dv-cinder-842237-1-smb devstack@keystone.service[80209]: ERROR keystone.server.flask.application May 19 21:56:16.581810 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 645/1285] 10.222.0.35 () {56 vars in 1111 bytes} [Thu May 19 21:56:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:56:16.587616 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc664ef4-5ba5-4efb-aa6d-bca32f4c6047 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:16.639307 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:16.699424 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc664ef4-5ba5-4efb-aa6d-bca32f4c6047 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:16.733550 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8d4b8-c088-4ac8-8278-33148aca5496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:16.734212 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8d4b8-c088-4ac8-8278-33148aca5496 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:16.734495 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8d4b8-c088-4ac8-8278-33148aca5496 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:16.734772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8d4b8-c088-4ac8-8278-33148aca5496 None admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:16.735560 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8d4b8-c088-4ac8-8278-33148aca5496 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:16.735870 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8d4b8-c088-4ac8-8278-33148aca5496 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:16.737323 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8d4b8-c088-4ac8-8278-33148aca5496 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:16.750640 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 641/1286] 10.222.0.35 () {56 vars in 1148 bytes} [Thu May 19 21:56:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:16.756698 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ba7b1-e684-4f7f-bd5c-ff31b2d556f3 None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:16.863850 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ba7b1-e684-4f7f-bd5c-ff31b2d556f3 None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:16.899430 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5fb6e-da37-4941-b6ab-17a77617fa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:16.900228 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5fb6e-da37-4941-b6ab-17a77617fa56 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:16.900547 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5fb6e-da37-4941-b6ab-17a77617fa56 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:16.900827 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5fb6e-da37-4941-b6ab-17a77617fa56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:16.901670 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5fb6e-da37-4941-b6ab-17a77617fa56 None admin] RBAC: Adding query filter params (role.id=04369f3c13174671a298fcd8175998d8, scope.project.id=89b20e18525c473e94a2b263148f1f5f, user.id=b1004beeeaed4af4a92c89ad31008b32) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:16.901993 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5fb6e-da37-4941-b6ab-17a77617fa56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:16.903486 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5fb6e-da37-4941-b6ab-17a77617fa56 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:16.910248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 646/1287] 10.222.0.35 () {56 vars in 1374 bytes} [Thu May 19 21:56:16 2022] GET /identity/v3/role_assignments?user.id=b1004beeeaed4af4a92c89ad31008b32&scope.project.id=89b20e18525c473e94a2b263148f1f5f&role.id=04369f3c13174671a298fcd8175998d8 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:19.234716 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1ef23-cf9b-4ab8-8c5e-cc0d2c5000f5 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:19.235284 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1ef23-cf9b-4ab8-8c5e-cc0d2c5000f5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:19.235284 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1ef23-cf9b-4ab8-8c5e-cc0d2c5000f5 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:19.236656 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 642/1288] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:56:19.241760 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af290a-870c-4f9a-b76d-16a25e74f541 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:19.242182 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af290a-870c-4f9a-b76d-16a25e74f541 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:19.242330 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af290a-870c-4f9a-b76d-16a25e74f541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:19.260259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-b5af290a-870c-4f9a-b76d-16a25e74f541 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:56:19.261492 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b5af290a-870c-4f9a-b76d-16a25e74f541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:19.292105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:19.331339 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 647/1289] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:56:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:56:19.354877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1ef23-cf9b-4ab8-8c5e-cc0d2c5000f5 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:19.467251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1ef23-cf9b-4ab8-8c5e-cc0d2c5000f5 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:19.478615 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:19.502595 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b45bc2-2381-49ce-b008-2eec8709621c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:19.503397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b45bc2-2381-49ce-b008-2eec8709621c None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:19.503684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b45bc2-2381-49ce-b008-2eec8709621c None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:19.503963 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b45bc2-2381-49ce-b008-2eec8709621c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:19.504675 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b45bc2-2381-49ce-b008-2eec8709621c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:19.506072 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b45bc2-2381-49ce-b008-2eec8709621c None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:19.519773 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-44b45bc2-2381-49ce-b008-2eec8709621c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 21:56:19.519773 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:56:19.519773 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:56:19.519773 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:56:19.519773 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:56:19.519773 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:56:19.519773 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:56:19.519773 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:56:19.519773 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 21:56:19.519773 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:56:19.519773 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:56:19.519773 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:56:19.519773 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:56:19.519773 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:56:19.519773 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:56:19.519773 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:56:19.519773 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:56:19.521095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:56:19.521095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:56:19.521095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:56:19.521095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:56:19.521095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:56:19.521095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:56:19.521095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:56:19.521095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:56:19.521095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:56:19.521095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:56:19.521095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:56:19.521095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:56:19.521095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:56:19.521095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:56:19.521095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:56:19.521095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:56:19.522183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:56:19.522183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:56:19.522183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:56:19.522183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:56:19.522183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:56:19.522183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:56:19.522183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:56:19.522183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:56:19.522183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:56:19.522183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:56:19.522183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:56:19.522183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:56:19.522183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 21:56:19.522183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:56:19.522183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 643/1290] 10.222.0.35 () {56 vars in 1117 bytes} [Thu May 19 21:56:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:56:19.527935 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af290a-870c-4f9a-b76d-16a25e74f541 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:19.628751 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af290a-870c-4f9a-b76d-16a25e74f541 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:19.662556 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ecb3c-64d0-4521-99b3-8a68790651b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:19.663247 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ecb3c-64d0-4521-99b3-8a68790651b1 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:19.663527 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ecb3c-64d0-4521-99b3-8a68790651b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:19.663799 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ecb3c-64d0-4521-99b3-8a68790651b1 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:19.664727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ecb3c-64d0-4521-99b3-8a68790651b1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:19.665079 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ecb3c-64d0-4521-99b3-8a68790651b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:19.666631 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ecb3c-64d0-4521-99b3-8a68790651b1 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:19.672425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 648/1291] 10.222.0.35 () {56 vars in 1116 bytes} [Thu May 19 21:56:19 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:19.678113 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b45bc2-2381-49ce-b008-2eec8709621c None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:19.797251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b45bc2-2381-49ce-b008-2eec8709621c None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:19.832473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f23fd3-db78-4779-90ce-a4dfb3a6d102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:19.833149 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f23fd3-db78-4779-90ce-a4dfb3a6d102 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:19.833438 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f23fd3-db78-4779-90ce-a4dfb3a6d102 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:19.833716 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f23fd3-db78-4779-90ce-a4dfb3a6d102 None admin] PATH_INFO: `/v3/services` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:19.834433 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f23fd3-db78-4779-90ce-a4dfb3a6d102 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:19.834742 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f23fd3-db78-4779-90ce-a4dfb3a6d102 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:19.836111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f23fd3-db78-4779-90ce-a4dfb3a6d102 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:19.840818 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 644/1292] 10.222.0.35 () {56 vars in 1116 bytes} [Thu May 19 21:56:19 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:22.118421 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd805e56-a6ad-45cd-8d72-56f9e03f6f74 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:22.119235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd805e56-a6ad-45cd-8d72-56f9e03f6f74 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:22.119235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd805e56-a6ad-45cd-8d72-56f9e03f6f74 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:22.120676 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 649/1293] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:56:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:56:22.125953 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847ade8-46e2-48f8-9abb-94c63ceaf090 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:22.126352 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847ade8-46e2-48f8-9abb-94c63ceaf090 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:22.126502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847ade8-46e2-48f8-9abb-94c63ceaf090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:22.143880 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-5847ade8-46e2-48f8-9abb-94c63ceaf090 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:56:22.145087 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5847ade8-46e2-48f8-9abb-94c63ceaf090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:22.175572 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:22.214636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 645/1294] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:56:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 21:56:22.237741 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd805e56-a6ad-45cd-8d72-56f9e03f6f74 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:22.278561 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:22.352585 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd805e56-a6ad-45cd-8d72-56f9e03f6f74 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:22.397403 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e372df-35fe-4c20-899e-8669b5b1f2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:22.397988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e372df-35fe-4c20-899e-8669b5b1f2fa None admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:22.398267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e372df-35fe-4c20-899e-8669b5b1f2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:22.398544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e372df-35fe-4c20-899e-8669b5b1f2fa None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:22.399844 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e372df-35fe-4c20-899e-8669b5b1f2fa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:22.401241 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e372df-35fe-4c20-899e-8669b5b1f2fa None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:22.414078 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 650/1295] 10.222.0.35 () {60 vars in 1141 bytes} [Thu May 19 21:56:22 2022] POST /identity/v3/services => generated 246 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:56:24.646637 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eae9c3-a109-4901-8c12-7c88eb1aea09 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:24.647165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eae9c3-a109-4901-8c12-7c88eb1aea09 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:24.647165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eae9c3-a109-4901-8c12-7c88eb1aea09 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:24.648464 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 646/1296] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:56:24.653917 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe434f-4abf-4c51-b17e-2259908cd313 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:24.654361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe434f-4abf-4c51-b17e-2259908cd313 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:24.654465 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe434f-4abf-4c51-b17e-2259908cd313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:24.681152 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c2fe434f-4abf-4c51-b17e-2259908cd313 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:56:24.682361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c2fe434f-4abf-4c51-b17e-2259908cd313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:24.757015 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 651/1297] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:56:24 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:56:24.779787 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eae9c3-a109-4901-8c12-7c88eb1aea09 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:24.883993 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eae9c3-a109-4901-8c12-7c88eb1aea09 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:24.919689 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebe173-d48b-4afc-931d-6cfc320725b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:24.920451 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebe173-d48b-4afc-931d-6cfc320725b8 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:24.920742 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebe173-d48b-4afc-931d-6cfc320725b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:24.921017 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebe173-d48b-4afc-931d-6cfc320725b8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:24.921684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebe173-d48b-4afc-931d-6cfc320725b8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:24.923074 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebe173-d48b-4afc-931d-6cfc320725b8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:24.935764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-68ebe173-d48b-4afc-931d-6cfc320725b8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 21:56:24.935764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:56:24.935764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:56:24.935764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:56:24.935764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:56:24.935764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:56:24.935764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:56:24.935764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:56:24.935764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 21:56:24.935764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:56:24.935764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:56:24.935764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:56:24.935764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:56:24.935764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:56:24.935764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:56:24.935764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:56:24.935764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:56:24.937037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:56:24.937037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:56:24.937037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:56:24.937037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:56:24.937037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:56:24.937037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:56:24.937037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:56:24.937037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:56:24.937037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:56:24.937037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:56:24.937037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:56:24.937037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:56:24.937037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:56:24.937037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:56:24.937037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:56:24.937037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:56:24.938048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:56:24.938048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:56:24.938048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:56:24.938048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:56:24.938048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:56:24.938048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:56:24.938048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:56:24.938048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:56:24.938048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:56:24.938048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:56:24.938048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:56:24.938048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:56:24.938048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 21:56:24.938048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:56:24.938048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 647/1298] 10.222.0.35 () {56 vars in 1117 bytes} [Thu May 19 21:56:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:56:24.943178 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe434f-4abf-4c51-b17e-2259908cd313 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:24.961893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:25.045540 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe434f-4abf-4c51-b17e-2259908cd313 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:25.082386 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794f0c6-9f9a-4c34-b357-f3598599d7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:25.083102 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794f0c6-9f9a-4c34-b357-f3598599d7db None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:25.083409 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794f0c6-9f9a-4c34-b357-f3598599d7db None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:25.083711 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794f0c6-9f9a-4c34-b357-f3598599d7db None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:25.084519 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794f0c6-9f9a-4c34-b357-f3598599d7db None admin] RBAC: Adding query filter params (name=placement) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:25.084832 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794f0c6-9f9a-4c34-b357-f3598599d7db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:25.086228 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794f0c6-9f9a-4c34-b357-f3598599d7db None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:25.092572 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 652/1299] 10.222.0.35 () {56 vars in 1116 bytes} [Thu May 19 21:56:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:25.098531 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebe173-d48b-4afc-931d-6cfc320725b8 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:25.130519 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:25.201230 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebe173-d48b-4afc-931d-6cfc320725b8 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:25.235712 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800574b-2131-453b-8e20-a241132ffd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:25.236518 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800574b-2131-453b-8e20-a241132ffd7f None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:25.236707 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800574b-2131-453b-8e20-a241132ffd7f None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:25.236985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800574b-2131-453b-8e20-a241132ffd7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:25.237799 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800574b-2131-453b-8e20-a241132ffd7f None admin] RBAC: Adding query filter params (interface=public, service_id=7abdfe2e576f465397bb766edfd56445, region_id=RegionOne) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:25.238114 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800574b-2131-453b-8e20-a241132ffd7f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:25.239526 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800574b-2131-453b-8e20-a241132ffd7f None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:25.245752 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 648/1300] 10.222.0.35 () {56 vars in 1251 bytes} [Thu May 19 21:56:25 2022] GET /identity/v3/endpoints?service_id=7abdfe2e576f465397bb766edfd56445&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:25.251410 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794f0c6-9f9a-4c34-b357-f3598599d7db None admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:25.334069 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:25.355741 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794f0c6-9f9a-4c34-b357-f3598599d7db None admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:25.390683 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5953416-ed40-45ae-bc39-55c8bd495721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:25.391372 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5953416-ed40-45ae-bc39-55c8bd495721 None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:25.391662 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5953416-ed40-45ae-bc39-55c8bd495721 None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:25.391945 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5953416-ed40-45ae-bc39-55c8bd495721 None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:25.392679 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5953416-ed40-45ae-bc39-55c8bd495721 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:25.394099 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5953416-ed40-45ae-bc39-55c8bd495721 None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:25.402331 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 653/1301] 10.222.0.35 () {56 vars in 1087 bytes} [Thu May 19 21:56:25 2022] GET /identity/v3/services => generated 2191 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 21:56:27.648167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f034ac8-6d6e-441f-9462-c6b1dd6d3fdc None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:27.648715 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f034ac8-6d6e-441f-9462-c6b1dd6d3fdc None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:27.648715 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f034ac8-6d6e-441f-9462-c6b1dd6d3fdc None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:27.650771 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 649/1302] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:56:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:56:27.656042 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdeb70-d09c-49ac-98de-4580e734e381 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:27.656535 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdeb70-d09c-49ac-98de-4580e734e381 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:27.656642 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdeb70-d09c-49ac-98de-4580e734e381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:27.673473 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-7ffdeb70-d09c-49ac-98de-4580e734e381 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:56:27.674798 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7ffdeb70-d09c-49ac-98de-4580e734e381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:56:27.747783 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 654/1303] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:56:27 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 21:56:27.771805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f034ac8-6d6e-441f-9462-c6b1dd6d3fdc None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:27.870213 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:27.877387 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f034ac8-6d6e-441f-9462-c6b1dd6d3fdc None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:27.913238 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73301cc-9427-4eb3-a21e-4a9eba4e4aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:27.913957 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73301cc-9427-4eb3-a21e-4a9eba4e4aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:27.914244 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73301cc-9427-4eb3-a21e-4a9eba4e4aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:27.914648 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73301cc-9427-4eb3-a21e-4a9eba4e4aa8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:27.915322 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73301cc-9427-4eb3-a21e-4a9eba4e4aa8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:27.916725 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73301cc-9427-4eb3-a21e-4a9eba4e4aa8 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:27.928536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application [None req-b73301cc-9427-4eb3-a21e-4a9eba4e4aa8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 21:56:27.928536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:56:27.928536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 21:56:27.928536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 21:56:27.928536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 21:56:27.928536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 21:56:27.928536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 21:56:27.928536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:56:27.928536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 21:56:27.928536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:56:27.928536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 21:56:27.928536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:56:27.928536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 21:56:27.928536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 21:56:27.928536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 21:56:27.928536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 21:56:27.928536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 21:56:27.929693 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 21:56:27.929693 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 21:56:27.929693 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 21:56:27.929693 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 21:56:27.929693 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 21:56:27.929693 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 21:56:27.929693 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 21:56:27.929693 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 21:56:27.929693 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 21:56:27.929693 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 21:56:27.929693 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 21:56:27.929693 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 21:56:27.929693 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 21:56:27.929693 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 21:56:27.929693 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 21:56:27.929693 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.get_or_create( May 19 21:56:27.930562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 21:56:27.930562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application with Lock( May 19 21:56:27.930562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 21:56:27.930562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self._enter() May 19 21:56:27.930562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 21:56:27.930562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 21:56:27.930562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 21:56:27.930562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application return self.creator() May 19 21:56:27.930562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 21:56:27.930562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application created_value = creator( May 19 21:56:27.930562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 21:56:27.930562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 21:56:27.930562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 21:56:27.930562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: ERROR keystone.server.flask.application May 19 21:56:27.930562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 650/1304] 10.222.0.35 () {56 vars in 1117 bytes} [Thu May 19 21:56:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 21:56:27.936510 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdeb70-d09c-49ac-98de-4580e734e381 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:28.018166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:28.041750 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdeb70-d09c-49ac-98de-4580e734e381 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:28.077346 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a543fff-48d0-4ad4-a8f2-75f35423990b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:28.078039 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a543fff-48d0-4ad4-a8f2-75f35423990b None admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:28.078329 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a543fff-48d0-4ad4-a8f2-75f35423990b None admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:28.078602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a543fff-48d0-4ad4-a8f2-75f35423990b None admin] PATH_INFO: `/v3/services` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:28.079304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a543fff-48d0-4ad4-a8f2-75f35423990b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 21:56:28.079608 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a543fff-48d0-4ad4-a8f2-75f35423990b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:28.081019 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a543fff-48d0-4ad4-a8f2-75f35423990b None admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:28.086092 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 655/1305] 10.222.0.35 () {56 vars in 1116 bytes} [Thu May 19 21:56:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 21:56:28.092303 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73301cc-9427-4eb3-a21e-4a9eba4e4aa8 None admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:56:28.191877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73301cc-9427-4eb3-a21e-4a9eba4e4aa8 None admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:56:28.225847 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502ed96-47a5-4ce4-a5e1-f758e4f32658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:56:28.226500 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502ed96-47a5-4ce4-a5e1-f758e4f32658 None admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:56:28.226779 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502ed96-47a5-4ce4-a5e1-f758e4f32658 None admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:56:28.227153 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502ed96-47a5-4ce4-a5e1-f758e4f32658 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:56:28.227989 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502ed96-47a5-4ce4-a5e1-f758e4f32658 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:56:28.229376 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502ed96-47a5-4ce4-a5e1-f758e4f32658 None admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:56:28.248269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 651/1306] 10.222.0.35 () {60 vars in 1144 bytes} [Thu May 19 21:56:28 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 21:56:38.083458 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=30 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:56:38.242581 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:57:35.167152 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978bef2-50fe-46a4-833f-cacb2026cb2e None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:35.167685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978bef2-50fe-46a4-833f-cacb2026cb2e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:35.167685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978bef2-50fe-46a4-833f-cacb2026cb2e None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:35.172875 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 656/1307] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:57:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:57:35.174541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9caa606-88e7-43c8-b646-b9990c8fce33 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:35.174982 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9caa606-88e7-43c8-b646-b9990c8fce33 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:35.175178 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9caa606-88e7-43c8-b646-b9990c8fce33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:35.377466 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c9caa606-88e7-43c8-b646-b9990c8fce33 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:57:35.378692 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c9caa606-88e7-43c8-b646-b9990c8fce33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:35.503896 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 652/1308] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:57:35.561376 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e3207-a270-4709-bba9-cd6ff7c3078a None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:35.561376 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e3207-a270-4709-bba9-cd6ff7c3078a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:35.561376 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e3207-a270-4709-bba9-cd6ff7c3078a None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:35.561376 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 657/1309] 10.222.0.35 () {54 vars in 964 bytes} [Thu May 19 21:57:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:57:35.572163 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db40d3-7078-43a9-9b71-f11edc153416 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:35.572502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db40d3-7078-43a9-9b71-f11edc153416 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:35.572806 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db40d3-7078-43a9-9b71-f11edc153416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:35.670782 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-29db40d3-7078-43a9-9b71-f11edc153416 None None] MFA Rules not processed for user `a571d6fe63334552b532aae15299ef9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:57:35.672016 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-29db40d3-7078-43a9-9b71-f11edc153416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:35.697805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:57:35.769244 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 653/1310] 10.222.0.35 () {58 vars in 1061 bytes} [Thu May 19 21:57:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:57:35.778534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e3207-a270-4709-bba9-cd6ff7c3078a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:57:35.780265 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4a6e3207-a270-4709-bba9-cd6ff7c3078a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:35.898239 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e3207-a270-4709-bba9-cd6ff7c3078a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:57:35.990139 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f099b-6489-4849-b258-586f90d620bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:57:35.990805 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f099b-6489-4849-b258-586f90d620bd service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:35.991106 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f099b-6489-4849-b258-586f90d620bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:35.991389 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f099b-6489-4849-b258-586f90d620bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:35.993092 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-408f099b-6489-4849-b258-586f90d620bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:36.054225 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:57:36.115230 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f099b-6489-4849-b258-586f90d620bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:57:36.116834 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f099b-6489-4849-b258-586f90d620bd service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:57:36.138428 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 658/1311] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:57:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:57:38.699696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740616f2-0bf5-4e8f-99fe-895801117899 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:38.700215 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740616f2-0bf5-4e8f-99fe-895801117899 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:38.700512 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740616f2-0bf5-4e8f-99fe-895801117899 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:38.702175 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 654/1312] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:57:38.707644 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710ef88-2aa3-4abb-93fd-87b61c4c8f10 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:38.708124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710ef88-2aa3-4abb-93fd-87b61c4c8f10 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:38.708207 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710ef88-2aa3-4abb-93fd-87b61c4c8f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:38.797682 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4710ef88-2aa3-4abb-93fd-87b61c4c8f10 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:57:38.799065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4710ef88-2aa3-4abb-93fd-87b61c4c8f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:38.919619 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 659/1313] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:57:38.957856 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740616f2-0bf5-4e8f-99fe-895801117899 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:57:38.959496 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-740616f2-0bf5-4e8f-99fe-895801117899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:39.090176 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740616f2-0bf5-4e8f-99fe-895801117899 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:57:39.174070 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:57:39.176908 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f25c97-461f-44a6-b09d-d4f060fd338d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:57:39.177654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f25c97-461f-44a6-b09d-d4f060fd338d service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:39.178046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f25c97-461f-44a6-b09d-d4f060fd338d service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:39.178332 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f25c97-461f-44a6-b09d-d4f060fd338d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:39.180890 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d3f25c97-461f-44a6-b09d-d4f060fd338d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:39.312126 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f25c97-461f-44a6-b09d-d4f060fd338d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:57:39.313701 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f25c97-461f-44a6-b09d-d4f060fd338d service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:57:39.335298 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 655/1314] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:57:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:57:42.018597 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea646d-47e6-439d-ba9d-96756a502062 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:42.019144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea646d-47e6-439d-ba9d-96756a502062 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:42.019144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea646d-47e6-439d-ba9d-96756a502062 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:42.020534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 660/1315] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:57:42.025956 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cab2e8-eae5-42a0-8345-7d7d1af5b310 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:42.026393 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cab2e8-eae5-42a0-8345-7d7d1af5b310 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:42.026509 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cab2e8-eae5-42a0-8345-7d7d1af5b310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:42.092227 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-20cab2e8-eae5-42a0-8345-7d7d1af5b310 None None] MFA Rules not processed for user `8adc91e3b100408bb77c02ef2a959cd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:57:42.093487 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-20cab2e8-eae5-42a0-8345-7d7d1af5b310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:42.146926 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:57:42.194155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 656/1316] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:57:42 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:57:42.236211 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea646d-47e6-439d-ba9d-96756a502062 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:57:42.237798 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1fea646d-47e6-439d-ba9d-96756a502062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:42.247897 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:57:42.361040 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea646d-47e6-439d-ba9d-96756a502062 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:57:42.442246 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866b053-611e-4fad-b9ea-2dfe87b032f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:57:42.442897 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866b053-611e-4fad-b9ea-2dfe87b032f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:42.443183 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866b053-611e-4fad-b9ea-2dfe87b032f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:42.443460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866b053-611e-4fad-b9ea-2dfe87b032f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:42.445170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d866b053-611e-4fad-b9ea-2dfe87b032f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:42.512767 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:57:42.562905 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866b053-611e-4fad-b9ea-2dfe87b032f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:57:42.564271 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866b053-611e-4fad-b9ea-2dfe87b032f6 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:57:42.589300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 661/1317] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:57:42 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:57:45.443542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fdc78-d6f8-4665-a76d-bad310c25233 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:45.444219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fdc78-d6f8-4665-a76d-bad310c25233 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:45.444219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fdc78-d6f8-4665-a76d-bad310c25233 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:45.446191 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 657/1318] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:57:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:57:45.452264 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5f979-dd37-4850-8a3c-03bd222ebce6 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:45.452888 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5f979-dd37-4850-8a3c-03bd222ebce6 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:45.453018 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5f979-dd37-4850-8a3c-03bd222ebce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:45.527470 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4dd5f979-dd37-4850-8a3c-03bd222ebce6 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:57:45.528694 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4dd5f979-dd37-4850-8a3c-03bd222ebce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:45.636387 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 662/1319] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:57:45 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:57:45.699005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff63f13-4c8e-4d3d-bc64-f141bba5192d None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:45.699297 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff63f13-4c8e-4d3d-bc64-f141bba5192d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:45.699580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff63f13-4c8e-4d3d-bc64-f141bba5192d None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:45.700997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 658/1320] 10.222.0.35 () {54 vars in 964 bytes} [Thu May 19 21:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:57:45.707105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42c504-1467-472c-9279-e0bd76c4522a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:45.707392 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42c504-1467-472c-9279-e0bd76c4522a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:45.707697 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42c504-1467-472c-9279-e0bd76c4522a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:45.730382 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:57:45.785564 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-eb42c504-1467-472c-9279-e0bd76c4522a None None] MFA Rules not processed for user `a571d6fe63334552b532aae15299ef9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:57:45.786704 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-eb42c504-1467-472c-9279-e0bd76c4522a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:45.869319 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 663/1321] 10.222.0.35 () {58 vars in 1061 bytes} [Thu May 19 21:57:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:57:45.878754 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff63f13-4c8e-4d3d-bc64-f141bba5192d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:57:45.880309 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4ff63f13-4c8e-4d3d-bc64-f141bba5192d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:45.993877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff63f13-4c8e-4d3d-bc64-f141bba5192d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:57:46.071838 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b3c74-e739-401d-a7d6-b5e72cdc426a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:57:46.072448 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b3c74-e739-401d-a7d6-b5e72cdc426a service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:46.072738 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b3c74-e739-401d-a7d6-b5e72cdc426a service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:46.073016 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b3c74-e739-401d-a7d6-b5e72cdc426a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:46.074776 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a00b3c74-e739-401d-a7d6-b5e72cdc426a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:46.082424 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:57:46.186316 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b3c74-e739-401d-a7d6-b5e72cdc426a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:57:46.187773 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b3c74-e739-401d-a7d6-b5e72cdc426a service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:57:46.205778 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 659/1322] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:57:45 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:57:49.689706 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0023a3-590a-42ae-bde0-68bbef4145a6 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:49.690241 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0023a3-590a-42ae-bde0-68bbef4145a6 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:49.690369 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0023a3-590a-42ae-bde0-68bbef4145a6 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:49.691978 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 664/1323] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:57:49.697483 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7b1b9-0659-46ba-9525-ffd24a0560f1 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:49.697955 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7b1b9-0659-46ba-9525-ffd24a0560f1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:49.698036 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7b1b9-0659-46ba-9525-ffd24a0560f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:49.771489 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-74a7b1b9-0659-46ba-9525-ffd24a0560f1 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:57:49.772756 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-74a7b1b9-0659-46ba-9525-ffd24a0560f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:49.833910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:57:49.875948 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 660/1324] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:57:49.911554 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0023a3-590a-42ae-bde0-68bbef4145a6 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:57:49.913175 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9d0023a3-590a-42ae-bde0-68bbef4145a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:50.034115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0023a3-590a-42ae-bde0-68bbef4145a6 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:57:50.048238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:57:50.114169 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6e428-79b4-46ff-b18e-0a170f94da35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:57:50.114823 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6e428-79b4-46ff-b18e-0a170f94da35 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:50.115108 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6e428-79b4-46ff-b18e-0a170f94da35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:50.115386 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6e428-79b4-46ff-b18e-0a170f94da35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:50.117072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-11c6e428-79b4-46ff-b18e-0a170f94da35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:50.240741 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6e428-79b4-46ff-b18e-0a170f94da35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:57:50.242909 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6e428-79b4-46ff-b18e-0a170f94da35 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:57:50.263297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 665/1325] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:57:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:57:52.652945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c64ed4-4704-4d99-b496-3da9761628d0 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:52.653480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c64ed4-4704-4d99-b496-3da9761628d0 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:52.653480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c64ed4-4704-4d99-b496-3da9761628d0 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:52.654814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 661/1326] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:57:52.660363 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a32d32-5e41-4b42-b676-0cadeb430cf0 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:52.660839 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a32d32-5e41-4b42-b676-0cadeb430cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:52.661091 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a32d32-5e41-4b42-b676-0cadeb430cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:52.713796 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:57:52.733090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-83a32d32-5e41-4b42-b676-0cadeb430cf0 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:57:52.734393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-83a32d32-5e41-4b42-b676-0cadeb430cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:52.835922 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 666/1327] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:57:52.872351 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c64ed4-4704-4d99-b496-3da9761628d0 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:57:52.873920 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d2c64ed4-4704-4d99-b496-3da9761628d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:52.985470 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c64ed4-4704-4d99-b496-3da9761628d0 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:57:53.062925 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325d01f-f152-4e7d-ad2a-ea2a2312514a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:57:53.063577 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325d01f-f152-4e7d-ad2a-ea2a2312514a service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:53.063856 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325d01f-f152-4e7d-ad2a-ea2a2312514a service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:53.064133 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325d01f-f152-4e7d-ad2a-ea2a2312514a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:53.065797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f325d01f-f152-4e7d-ad2a-ea2a2312514a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:53.082996 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:57:53.187791 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325d01f-f152-4e7d-ad2a-ea2a2312514a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:57:53.189268 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325d01f-f152-4e7d-ad2a-ea2a2312514a service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:57:53.211731 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 662/1328] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:57:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:57:55.570115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e038c95-154a-479f-85a8-2e2be4b405fb None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:55.570878 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e038c95-154a-479f-85a8-2e2be4b405fb None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:55.570878 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e038c95-154a-479f-85a8-2e2be4b405fb None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:55.572374 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 667/1329] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:57:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:57:55.577520 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec116e-8ed2-48ad-afc4-2755bdbaf940 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:55.577943 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec116e-8ed2-48ad-afc4-2755bdbaf940 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:55.578104 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec116e-8ed2-48ad-afc4-2755bdbaf940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:55.656316 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-2cec116e-8ed2-48ad-afc4-2755bdbaf940 None None] MFA Rules not processed for user `8adc91e3b100408bb77c02ef2a959cd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:57:55.657863 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2cec116e-8ed2-48ad-afc4-2755bdbaf940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:55.734294 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:57:55.772646 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 663/1330] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:57:55 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:57:55.812987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e038c95-154a-479f-85a8-2e2be4b405fb None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:57:55.815351 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5e038c95-154a-479f-85a8-2e2be4b405fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:55.926012 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e038c95-154a-479f-85a8-2e2be4b405fb None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:57:55.946559 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:57:56.003031 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f5d09-5104-4603-aabd-8c761a3e3e08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:57:56.003685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f5d09-5104-4603-aabd-8c761a3e3e08 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:56.003975 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f5d09-5104-4603-aabd-8c761a3e3e08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:56.004253 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f5d09-5104-4603-aabd-8c761a3e3e08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:56.005944 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e59f5d09-5104-4603-aabd-8c761a3e3e08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:56.127114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f5d09-5104-4603-aabd-8c761a3e3e08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:57:56.128620 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f5d09-5104-4603-aabd-8c761a3e3e08 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:57:56.147851 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 668/1331] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:57:55 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:57:58.673628 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e27af-26f2-49a4-bab9-7f90af5eb6e2 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:58.674163 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e27af-26f2-49a4-bab9-7f90af5eb6e2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:58.674163 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e27af-26f2-49a4-bab9-7f90af5eb6e2 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:58.675547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 664/1332] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:57:58.682872 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9e55d-3491-4333-a427-4bc796c6576d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:58.683768 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9e55d-3491-4333-a427-4bc796c6576d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:58.683768 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9e55d-3491-4333-a427-4bc796c6576d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:58.753164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:57:58.756040 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-04c9e55d-3491-4333-a427-4bc796c6576d None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:57:58.758489 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-04c9e55d-3491-4333-a427-4bc796c6576d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:58.859782 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 669/1333] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:57:58.896517 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e27af-26f2-49a4-bab9-7f90af5eb6e2 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:57:58.898378 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-546e27af-26f2-49a4-bab9-7f90af5eb6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:59.021500 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e27af-26f2-49a4-bab9-7f90af5eb6e2 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:57:59.098419 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa2d66-3aca-4b71-b4ba-3bf84f9f29bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:57:59.099086 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa2d66-3aca-4b71-b4ba-3bf84f9f29bb service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:57:59.099372 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa2d66-3aca-4b71-b4ba-3bf84f9f29bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:57:59.099644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa2d66-3aca-4b71-b4ba-3bf84f9f29bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:57:59.102151 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8caa2d66-3aca-4b71-b4ba-3bf84f9f29bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:57:59.130742 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:57:59.231512 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa2d66-3aca-4b71-b4ba-3bf84f9f29bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:57:59.233010 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa2d66-3aca-4b71-b4ba-3bf84f9f29bb service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:57:59.254744 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 665/1334] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:57:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:58:01.606433 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f26fd-8c95-4f21-8e2a-3a9e5e697e8b None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:01.607008 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f26fd-8c95-4f21-8e2a-3a9e5e697e8b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:01.607008 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f26fd-8c95-4f21-8e2a-3a9e5e697e8b None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:01.608270 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 670/1335] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:58:01.613649 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d3d7e-d8c5-4585-b7ef-fe93a482623f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:01.614077 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d3d7e-d8c5-4585-b7ef-fe93a482623f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:01.614207 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d3d7e-d8c5-4585-b7ef-fe93a482623f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:01.683345 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-cf8d3d7e-d8c5-4585-b7ef-fe93a482623f None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:58:01.684621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cf8d3d7e-d8c5-4585-b7ef-fe93a482623f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:58:01.762224 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:58:01.785155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 666/1336] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:58:01.825443 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f26fd-8c95-4f21-8e2a-3a9e5e697e8b None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:58:01.826994 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-951f26fd-8c95-4f21-8e2a-3a9e5e697e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:58:01.940121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f26fd-8c95-4f21-8e2a-3a9e5e697e8b None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:58:01.968934 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:58:02.015623 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead59222-149a-4fbe-b8c0-ff2527e272e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:58:02.016317 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead59222-149a-4fbe-b8c0-ff2527e272e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:02.016634 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead59222-149a-4fbe-b8c0-ff2527e272e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:02.016908 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead59222-149a-4fbe-b8c0-ff2527e272e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:02.018619 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ead59222-149a-4fbe-b8c0-ff2527e272e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:58:02.129932 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead59222-149a-4fbe-b8c0-ff2527e272e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:58:02.131387 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead59222-149a-4fbe-b8c0-ff2527e272e3 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:58:02.150630 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 671/1337] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:58:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:58:04.833611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ff771-3f27-4edc-baee-69a787ed6a90 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:04.834198 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ff771-3f27-4edc-baee-69a787ed6a90 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:04.834198 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ff771-3f27-4edc-baee-69a787ed6a90 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:04.835573 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 667/1338] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:58:04.841892 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c834c-c812-4b0d-9d80-a10a4faf93ce None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:04.842346 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c834c-c812-4b0d-9d80-a10a4faf93ce None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:04.842435 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c834c-c812-4b0d-9d80-a10a4faf93ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:04.909425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-7e5c834c-c812-4b0d-9d80-a10a4faf93ce None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:58:04.910653 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7e5c834c-c812-4b0d-9d80-a10a4faf93ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:58:04.919726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:58:05.022906 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 672/1339] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:58:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:58:05.059545 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ff771-3f27-4edc-baee-69a787ed6a90 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:58:05.061203 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8e0ff771-3f27-4edc-baee-69a787ed6a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:58:05.172157 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ff771-3f27-4edc-baee-69a787ed6a90 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:58:05.259088 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b279b-16ce-40cc-b7d0-163c5cd2834d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:58:05.259739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b279b-16ce-40cc-b7d0-163c5cd2834d service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:05.260018 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b279b-16ce-40cc-b7d0-163c5cd2834d service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:05.260290 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b279b-16ce-40cc-b7d0-163c5cd2834d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:05.262383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d42b279b-16ce-40cc-b7d0-163c5cd2834d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:58:05.304751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:58:05.384788 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b279b-16ce-40cc-b7d0-163c5cd2834d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:58:05.386240 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b279b-16ce-40cc-b7d0-163c5cd2834d service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:58:05.408699 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 668/1340] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:58:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:58:09.728823 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee928b-1872-4ee0-803f-fb8ae930f593 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:09.729397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee928b-1872-4ee0-803f-fb8ae930f593 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:09.729397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee928b-1872-4ee0-803f-fb8ae930f593 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:09.730962 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 673/1341] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:58:09.736910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89962d73-4911-4b7d-a541-aca9c08cf229 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:09.737455 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89962d73-4911-4b7d-a541-aca9c08cf229 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:09.737548 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89962d73-4911-4b7d-a541-aca9c08cf229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:09.810150 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-89962d73-4911-4b7d-a541-aca9c08cf229 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:58:09.811389 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-89962d73-4911-4b7d-a541-aca9c08cf229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:58:09.909131 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:58:09.924902 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 669/1342] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:58:09.964266 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee928b-1872-4ee0-803f-fb8ae930f593 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:58:09.966485 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8dee928b-1872-4ee0-803f-fb8ae930f593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:58:10.072383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee928b-1872-4ee0-803f-fb8ae930f593 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:58:10.075996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e138601-6ebf-4be9-9a38-805a2cb2a5a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:58:10.076683 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e138601-6ebf-4be9-9a38-805a2cb2a5a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:10.076973 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e138601-6ebf-4be9-9a38-805a2cb2a5a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:10.077251 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e138601-6ebf-4be9-9a38-805a2cb2a5a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:10.087169 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e138601-6ebf-4be9-9a38-805a2cb2a5a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:58:10.088646 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e138601-6ebf-4be9-9a38-805a2cb2a5a2 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:58:10.098415 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 674/1343] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:58:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:58:12.976889 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327452ca-e3c6-4201-bb0d-3c767155e596 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:12.977439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327452ca-e3c6-4201-bb0d-3c767155e596 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:12.977439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327452ca-e3c6-4201-bb0d-3c767155e596 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:12.978839 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 670/1344] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:58:12.985022 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f59592-9c0d-4b01-8b86-165d1feda288 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:12.985552 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f59592-9c0d-4b01-8b86-165d1feda288 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:12.985552 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f59592-9c0d-4b01-8b86-165d1feda288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:13.015659 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-95f59592-9c0d-4b01-8b86-165d1feda288 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:58:13.016903 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-95f59592-9c0d-4b01-8b86-165d1feda288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:58:13.050784 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:58:13.107644 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 675/1345] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:58:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:58:13.146075 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327452ca-e3c6-4201-bb0d-3c767155e596 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:58:13.148029 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-327452ca-e3c6-4201-bb0d-3c767155e596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:58:13.161336 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327452ca-e3c6-4201-bb0d-3c767155e596 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:58:13.164915 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbf0af-3376-4f32-80b7-8ea2c9b472e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:58:13.165556 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbf0af-3376-4f32-80b7-8ea2c9b472e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:13.165840 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbf0af-3376-4f32-80b7-8ea2c9b472e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:13.166117 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbf0af-3376-4f32-80b7-8ea2c9b472e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:13.175338 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbf0af-3376-4f32-80b7-8ea2c9b472e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:58:13.176797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbf0af-3376-4f32-80b7-8ea2c9b472e0 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:58:13.187133 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 671/1346] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:58:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:58:17.806729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba72462-5f8d-40f4-8a29-828cae5fa414 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:17.807226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba72462-5f8d-40f4-8a29-828cae5fa414 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:17.807464 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba72462-5f8d-40f4-8a29-828cae5fa414 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:17.808992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 676/1347] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:58:17.814513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19617e48-4df4-4068-be8c-2ed8a9e5d856 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:17.814951 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19617e48-4df4-4068-be8c-2ed8a9e5d856 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:17.815053 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19617e48-4df4-4068-be8c-2ed8a9e5d856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:17.834176 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-19617e48-4df4-4068-be8c-2ed8a9e5d856 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:58:17.836337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-19617e48-4df4-4068-be8c-2ed8a9e5d856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:58:17.844488 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 672/1348] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:58:17.882956 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba72462-5f8d-40f4-8a29-828cae5fa414 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:58:17.894393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba72462-5f8d-40f4-8a29-828cae5fa414 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:58:17.899161 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b1918-82fc-4162-b7bd-00b919249893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:58:17.899426 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b1918-82fc-4162-b7bd-00b919249893 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:17.899777 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b1918-82fc-4162-b7bd-00b919249893 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:17.900122 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b1918-82fc-4162-b7bd-00b919249893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:17.909947 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b1918-82fc-4162-b7bd-00b919249893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:58:17.911424 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b1918-82fc-4162-b7bd-00b919249893 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:58:17.921669 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 677/1349] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:58:23.496495 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5710b-06e6-4a28-9365-ccff3d2d9f14 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:23.497563 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5710b-06e6-4a28-9365-ccff3d2d9f14 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:23.498050 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5710b-06e6-4a28-9365-ccff3d2d9f14 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:23.500061 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 673/1350] 10.222.0.35 () {54 vars in 921 bytes} [Thu May 19 21:58:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:58:23.505758 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bababd-263e-453b-8e59-4fb57ab6cfd6 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:23.506843 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bababd-263e-453b-8e59-4fb57ab6cfd6 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:23.507314 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bababd-263e-453b-8e59-4fb57ab6cfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:23.654345 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-57bababd-263e-453b-8e59-4fb57ab6cfd6 None None] MFA Rules not processed for user `b1004beeeaed4af4a92c89ad31008b32`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:58:23.656429 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-57bababd-263e-453b-8e59-4fb57ab6cfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:58:23.777736 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 678/1351] 10.222.0.35 () {58 vars in 1018 bytes} [Thu May 19 21:58:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:58:27.828332 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=13 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:58:27.954877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420955f-ae75-42db-9bb2-326df387a6de None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:27.955303 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420955f-ae75-42db-9bb2-326df387a6de None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:27.955428 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420955f-ae75-42db-9bb2-326df387a6de None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:27.957126 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 674/1352] 10.222.0.35 () {54 vars in 921 bytes} [Thu May 19 21:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:58:27.962914 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df872e-1241-496e-b48f-d6596707227e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:27.963388 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df872e-1241-496e-b48f-d6596707227e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:27.963518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df872e-1241-496e-b48f-d6596707227e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:27.983184 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-34df872e-1241-496e-b48f-d6596707227e None None] MFA Rules not processed for user `b1004beeeaed4af4a92c89ad31008b32`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:58:27.984570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-34df872e-1241-496e-b48f-d6596707227e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:58:27.995527 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 679/1353] 10.222.0.35 () {58 vars in 1018 bytes} [Thu May 19 21:58:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:58:29.869796 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c452fc1-f06b-46af-9f0d-20be38d69969 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:29.870364 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c452fc1-f06b-46af-9f0d-20be38d69969 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:29.870364 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c452fc1-f06b-46af-9f0d-20be38d69969 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:29.871972 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 675/1354] 10.222.0.35 () {54 vars in 921 bytes} [Thu May 19 21:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:58:29.877089 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a854294-75a2-4bcc-9e56-4a832de69cbd None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:29.877536 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a854294-75a2-4bcc-9e56-4a832de69cbd None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:29.877645 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a854294-75a2-4bcc-9e56-4a832de69cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:29.897322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4a854294-75a2-4bcc-9e56-4a832de69cbd None None] MFA Rules not processed for user `b1004beeeaed4af4a92c89ad31008b32`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:58:29.898767 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4a854294-75a2-4bcc-9e56-4a832de69cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:58:29.916081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 680/1355] 10.222.0.35 () {58 vars in 1018 bytes} [Thu May 19 21:58:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:58:34.003812 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b194c0-de5e-4136-b19c-faf84ba6882c None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:34.004864 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b194c0-de5e-4136-b19c-faf84ba6882c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:34.005114 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b194c0-de5e-4136-b19c-faf84ba6882c None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:34.007189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 676/1356] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:58:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:58:34.019729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bb9f3-ae0e-4597-9b2e-96ad250e1e53 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:34.020696 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bb9f3-ae0e-4597-9b2e-96ad250e1e53 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:34.022099 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bb9f3-ae0e-4597-9b2e-96ad250e1e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:34.044699 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-784bb9f3-ae0e-4597-9b2e-96ad250e1e53 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:58:34.046257 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-784bb9f3-ae0e-4597-9b2e-96ad250e1e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:58:34.054702 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 681/1357] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:58:34.112113 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcdb61-dd63-467b-a922-c6cdc9829b9c None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:34.112673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcdb61-dd63-467b-a922-c6cdc9829b9c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:34.113102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcdb61-dd63-467b-a922-c6cdc9829b9c None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:34.114878 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 677/1358] 10.222.0.35 () {54 vars in 961 bytes} [Thu May 19 21:58:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:58:34.124159 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1497875-4c24-44a1-944b-7cca24b84d16 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:34.124734 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1497875-4c24-44a1-944b-7cca24b84d16 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:34.125160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1497875-4c24-44a1-944b-7cca24b84d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:34.181573 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:58:34.195530 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e1497875-4c24-44a1-944b-7cca24b84d16 None None] MFA Rules not processed for user `902ca8f1d59547a0ab187b4748311f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:58:34.197006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e1497875-4c24-44a1-944b-7cca24b84d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:58:34.289772 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 682/1359] 10.222.0.35 () {58 vars in 1058 bytes} [Thu May 19 21:58:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:58:34.298154 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcdb61-dd63-467b-a922-c6cdc9829b9c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:58:34.316877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcdb61-dd63-467b-a922-c6cdc9829b9c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:58:34.325424 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8f82b-65d5-41de-9155-1f844390a05a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:58:34.326383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8f82b-65d5-41de-9155-1f844390a05a service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:34.326959 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8f82b-65d5-41de-9155-1f844390a05a service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:34.327384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8f82b-65d5-41de-9155-1f844390a05a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:34.337811 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8f82b-65d5-41de-9155-1f844390a05a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:58:34.339792 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8f82b-65d5-41de-9155-1f844390a05a service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:58:34.359307 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 678/1360] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:58:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:58:36.876195 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc886729-fb7e-483e-bad7-48008cb8946a None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:36.876778 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc886729-fb7e-483e-bad7-48008cb8946a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:36.876778 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc886729-fb7e-483e-bad7-48008cb8946a None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:36.878379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 683/1361] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:58:36.884127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee9373-7108-4ac6-a5f9-72171423fa91 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:36.884695 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee9373-7108-4ac6-a5f9-72171423fa91 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:36.884695 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee9373-7108-4ac6-a5f9-72171423fa91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:36.903912 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-4eee9373-7108-4ac6-a5f9-72171423fa91 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:58:36.905264 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4eee9373-7108-4ac6-a5f9-72171423fa91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:58:36.914805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 679/1362] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:58:36.959248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc886729-fb7e-483e-bad7-48008cb8946a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:58:36.974262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc886729-fb7e-483e-bad7-48008cb8946a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:58:36.980398 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb303a3-87b8-4c60-b932-d6cf3cf529b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:58:36.981086 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb303a3-87b8-4c60-b932-d6cf3cf529b0 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:36.981373 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb303a3-87b8-4c60-b932-d6cf3cf529b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:36.981651 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb303a3-87b8-4c60-b932-d6cf3cf529b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:36.990612 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb303a3-87b8-4c60-b932-d6cf3cf529b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:58:36.992224 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb303a3-87b8-4c60-b932-d6cf3cf529b0 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:58:37.002542 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 684/1363] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:58:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:58:39.599833 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebe973-e40e-47cb-877c-2c89cce7cd37 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:39.600633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebe973-e40e-47cb-877c-2c89cce7cd37 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:39.600947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebe973-e40e-47cb-877c-2c89cce7cd37 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:39.602332 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 680/1364] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:58:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:58:39.610915 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a01ce7-3686-4778-bf4a-5fa2bf546016 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:39.611470 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a01ce7-3686-4778-bf4a-5fa2bf546016 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:39.611734 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a01ce7-3686-4778-bf4a-5fa2bf546016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:39.631993 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-67a01ce7-3686-4778-bf4a-5fa2bf546016 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:58:39.633256 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-67a01ce7-3686-4778-bf4a-5fa2bf546016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:58:39.641389 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 685/1365] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:58:39.695647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7227a-08ee-491a-8eb6-e32c80773a13 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:39.695936 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7227a-08ee-491a-8eb6-e32c80773a13 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:39.696218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7227a-08ee-491a-8eb6-e32c80773a13 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:39.697704 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 681/1366] 10.222.0.35 () {54 vars in 961 bytes} [Thu May 19 21:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:58:39.703624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c97f8-ea3f-4586-a8d3-0227756d2278 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:39.703973 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c97f8-ea3f-4586-a8d3-0227756d2278 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:39.704317 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c97f8-ea3f-4586-a8d3-0227756d2278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:39.726410 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-599c97f8-ea3f-4586-a8d3-0227756d2278 None None] MFA Rules not processed for user `902ca8f1d59547a0ab187b4748311f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:58:39.727659 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-599c97f8-ea3f-4586-a8d3-0227756d2278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:58:39.737181 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 686/1367] 10.222.0.35 () {58 vars in 1058 bytes} [Thu May 19 21:58:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:58:39.745967 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7227a-08ee-491a-8eb6-e32c80773a13 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:58:39.772313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7227a-08ee-491a-8eb6-e32c80773a13 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:58:39.780355 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd09bc-d1d6-467e-8973-a00df951c490 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:58:39.781149 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd09bc-d1d6-467e-8973-a00df951c490 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:39.781430 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd09bc-d1d6-467e-8973-a00df951c490 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:39.781700 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd09bc-d1d6-467e-8973-a00df951c490 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:39.791401 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd09bc-d1d6-467e-8973-a00df951c490 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:58:39.793122 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd09bc-d1d6-467e-8973-a00df951c490 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:58:39.803693 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 682/1368] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:58:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:58:42.176091 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e49f25-888e-456a-89b6-451540411943 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:42.177774 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e49f25-888e-456a-89b6-451540411943 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:42.178272 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e49f25-888e-456a-89b6-451540411943 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:42.179923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 687/1369] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:58:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:58:42.185460 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614677b-63df-4e08-98dd-f80c11550b0f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:42.186328 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614677b-63df-4e08-98dd-f80c11550b0f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:42.186811 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614677b-63df-4e08-98dd-f80c11550b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:42.205586 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-2614677b-63df-4e08-98dd-f80c11550b0f None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:58:42.207160 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2614677b-63df-4e08-98dd-f80c11550b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:58:42.216698 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 683/1370] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:58:42.263032 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e49f25-888e-456a-89b6-451540411943 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:58:42.279163 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e49f25-888e-456a-89b6-451540411943 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:58:42.285037 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ddd43a-d4ea-46ff-ae11-e661f6abb9b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:58:42.285690 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddd43a-d4ea-46ff-ae11-e661f6abb9b8 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:42.285981 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddd43a-d4ea-46ff-ae11-e661f6abb9b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:42.286256 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddd43a-d4ea-46ff-ae11-e661f6abb9b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:42.295653 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ddd43a-d4ea-46ff-ae11-e661f6abb9b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:58:42.297291 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ddd43a-d4ea-46ff-ae11-e661f6abb9b8 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:58:42.310189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 688/1371] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:58:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:58:42.710602 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a5bdb-10ba-40e0-828a-ff574897ccfb None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:42.711018 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a5bdb-10ba-40e0-828a-ff574897ccfb None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:42.711215 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a5bdb-10ba-40e0-828a-ff574897ccfb None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:42.712986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 684/1372] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:58:42.718286 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a0166-63e6-4cc4-b533-6640cfd92a15 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:42.718558 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a0166-63e6-4cc4-b533-6640cfd92a15 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:42.718861 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a0166-63e6-4cc4-b533-6640cfd92a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:42.741007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-7a5a0166-63e6-4cc4-b533-6640cfd92a15 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:58:42.742212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7a5a0166-63e6-4cc4-b533-6640cfd92a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:58:42.752453 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 689/1373] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:58:43.088672 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0728c3d-9158-41c8-977b-1cb3f8d14e06 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:43.088969 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0728c3d-9158-41c8-977b-1cb3f8d14e06 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:43.089251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0728c3d-9158-41c8-977b-1cb3f8d14e06 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:43.090617 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 685/1374] 10.222.0.35 () {54 vars in 963 bytes} [Thu May 19 21:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:58:43.095740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0d2ef-9333-4911-9be9-c4515a20c034 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:43.096040 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0d2ef-9333-4911-9be9-c4515a20c034 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:43.096328 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0d2ef-9333-4911-9be9-c4515a20c034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:43.158901 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-97a0d2ef-9333-4911-9be9-c4515a20c034 None None] MFA Rules not processed for user `85924e1dfe664f78af34565db18b0b55`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:58:43.160119 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-97a0d2ef-9333-4911-9be9-c4515a20c034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:58:43.227231 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 690/1375] 10.222.0.35 () {58 vars in 1060 bytes} [Thu May 19 21:58:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:58:43.234611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0728c3d-9158-41c8-977b-1cb3f8d14e06 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:58:43.245872 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0728c3d-9158-41c8-977b-1cb3f8d14e06 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:58:43.249646 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcd96a-c987-4638-b6f3-99ee4693605f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:58:43.250287 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcd96a-c987-4638-b6f3-99ee4693605f service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:43.250567 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcd96a-c987-4638-b6f3-99ee4693605f service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:43.250843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcd96a-c987-4638-b6f3-99ee4693605f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:43.261652 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcd96a-c987-4638-b6f3-99ee4693605f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:58:43.263105 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcd96a-c987-4638-b6f3-99ee4693605f service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:58:43.274216 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 686/1376] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:58:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:58:44.620758 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa641b-a8b7-47b4-b82c-fd402a505d5c None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:44.621539 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa641b-a8b7-47b4-b82c-fd402a505d5c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:44.621539 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa641b-a8b7-47b4-b82c-fd402a505d5c None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:44.622945 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 691/1377] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:58:44.628876 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5988c9d-f29a-41bc-8ca0-476ac129b555 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:44.629399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5988c9d-f29a-41bc-8ca0-476ac129b555 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:44.629510 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5988c9d-f29a-41bc-8ca0-476ac129b555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:44.647859 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b5988c9d-f29a-41bc-8ca0-476ac129b555 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:58:44.649091 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b5988c9d-f29a-41bc-8ca0-476ac129b555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:58:44.657179 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 687/1378] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:58:44.704551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa641b-a8b7-47b4-b82c-fd402a505d5c None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:58:44.719270 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa641b-a8b7-47b4-b82c-fd402a505d5c None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:58:44.726960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296ecb3-fbfe-4528-ba30-160b3e98cb16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:58:44.727653 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296ecb3-fbfe-4528-ba30-160b3e98cb16 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:44.727921 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296ecb3-fbfe-4528-ba30-160b3e98cb16 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:44.728198 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296ecb3-fbfe-4528-ba30-160b3e98cb16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:44.737258 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296ecb3-fbfe-4528-ba30-160b3e98cb16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:58:44.738858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296ecb3-fbfe-4528-ba30-160b3e98cb16 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:58:44.743583 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:58:44.750918 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 692/1379] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:58:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:58:47.117096 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d072da-18b1-4835-8607-9df8eda9e004 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:47.118002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d072da-18b1-4835-8607-9df8eda9e004 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:47.118281 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d072da-18b1-4835-8607-9df8eda9e004 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:47.119955 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 688/1380] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:58:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:58:47.126559 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1630c-fa52-49d8-8824-495c9efc4608 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:47.127492 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1630c-fa52-49d8-8824-495c9efc4608 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:47.127997 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1630c-fa52-49d8-8824-495c9efc4608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:47.157320 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-1bc1630c-fa52-49d8-8824-495c9efc4608 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:58:47.158905 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1bc1630c-fa52-49d8-8824-495c9efc4608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:58:47.172620 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 693/1381] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:58:47.218489 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d072da-18b1-4835-8607-9df8eda9e004 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:58:47.234336 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d072da-18b1-4835-8607-9df8eda9e004 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:58:47.240473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae6ebc-9cd6-4240-a33b-abd3cd166250 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:58:47.241134 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae6ebc-9cd6-4240-a33b-abd3cd166250 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:47.241411 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae6ebc-9cd6-4240-a33b-abd3cd166250 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:47.241879 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae6ebc-9cd6-4240-a33b-abd3cd166250 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:47.250904 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae6ebc-9cd6-4240-a33b-abd3cd166250 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:58:47.252513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae6ebc-9cd6-4240-a33b-abd3cd166250 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:58:47.262630 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 689/1382] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:58:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:58:49.595973 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac392858-41a4-472c-a9c4-e00f90067cc7 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:49.596866 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac392858-41a4-472c-a9c4-e00f90067cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:49.597143 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac392858-41a4-472c-a9c4-e00f90067cc7 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:49.598512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 694/1383] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:58:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:58:49.604768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15413a-0d83-41dc-a302-c2680a791731 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:49.605208 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15413a-0d83-41dc-a302-c2680a791731 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:49.605376 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15413a-0d83-41dc-a302-c2680a791731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:49.629460 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-bb15413a-0d83-41dc-a302-c2680a791731 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:58:49.630852 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-bb15413a-0d83-41dc-a302-c2680a791731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:58:49.639244 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 690/1384] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:58:49.685200 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac392858-41a4-472c-a9c4-e00f90067cc7 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:58:49.710266 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac392858-41a4-472c-a9c4-e00f90067cc7 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:58:49.716484 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed363c93-e92d-44cf-b91d-489f4e0c0999 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:58:49.717262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed363c93-e92d-44cf-b91d-489f4e0c0999 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:49.718566 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed363c93-e92d-44cf-b91d-489f4e0c0999 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:49.719267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed363c93-e92d-44cf-b91d-489f4e0c0999 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:49.733105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed363c93-e92d-44cf-b91d-489f4e0c0999 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:58:49.735081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed363c93-e92d-44cf-b91d-489f4e0c0999 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:58:49.748703 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 695/1385] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:58:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:58:52.031440 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57940368-2d1f-4f5c-bf8e-75b8630add32 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:52.031985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57940368-2d1f-4f5c-bf8e-75b8630add32 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:52.031985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57940368-2d1f-4f5c-bf8e-75b8630add32 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:52.033478 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 691/1386] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:58:52.039927 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dbc4e-651d-4e57-bdc7-20b1f66322eb None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:52.040479 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dbc4e-651d-4e57-bdc7-20b1f66322eb None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:52.040601 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dbc4e-651d-4e57-bdc7-20b1f66322eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:52.060900 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d16dbc4e-651d-4e57-bdc7-20b1f66322eb None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:58:52.062660 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d16dbc4e-651d-4e57-bdc7-20b1f66322eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:58:52.074396 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 696/1387] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:58:52.128229 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57940368-2d1f-4f5c-bf8e-75b8630add32 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:58:52.142969 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57940368-2d1f-4f5c-bf8e-75b8630add32 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:58:52.149045 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121ec38-c575-4b8f-b511-f49a0c78907c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:58:52.149726 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121ec38-c575-4b8f-b511-f49a0c78907c service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:52.150009 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121ec38-c575-4b8f-b511-f49a0c78907c service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:52.150285 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121ec38-c575-4b8f-b511-f49a0c78907c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:52.159098 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121ec38-c575-4b8f-b511-f49a0c78907c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:58:52.160717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121ec38-c575-4b8f-b511-f49a0c78907c service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:58:52.172491 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 692/1388] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:58:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:58:54.523998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdaf433-fb98-45dc-8e96-01266042ed33 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:54.524548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdaf433-fb98-45dc-8e96-01266042ed33 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:54.524548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdaf433-fb98-45dc-8e96-01266042ed33 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:54.525864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 697/1389] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:58:54.531367 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42982e71-f7f7-45a9-8896-a35c9bce2a17 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:54.531787 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42982e71-f7f7-45a9-8896-a35c9bce2a17 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:54.531929 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42982e71-f7f7-45a9-8896-a35c9bce2a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:54.552034 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-42982e71-f7f7-45a9-8896-a35c9bce2a17 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:58:54.553584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-42982e71-f7f7-45a9-8896-a35c9bce2a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:58:54.562048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 693/1390] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:58:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:58:54.620528 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdaf433-fb98-45dc-8e96-01266042ed33 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:58:54.636339 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdaf433-fb98-45dc-8e96-01266042ed33 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:58:54.642220 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ea13c-e2d5-4e6c-9a4d-325d790c20c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:58:54.642872 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ea13c-e2d5-4e6c-9a4d-325d790c20c7 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:54.643160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ea13c-e2d5-4e6c-9a4d-325d790c20c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:54.643440 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ea13c-e2d5-4e6c-9a4d-325d790c20c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:54.660207 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ea13c-e2d5-4e6c-9a4d-325d790c20c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:58:54.660207 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ea13c-e2d5-4e6c-9a4d-325d790c20c7 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:58:54.665086 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 698/1391] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:58:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:58:57.276342 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df801243-f986-44db-b37c-74ed44779935 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:57.276931 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df801243-f986-44db-b37c-74ed44779935 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:57.277033 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df801243-f986-44db-b37c-74ed44779935 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:57.278506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 694/1392] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:58:57.287185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f64452-92b6-4650-84a2-fcb7b4c48940 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:57.287938 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f64452-92b6-4650-84a2-fcb7b4c48940 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:57.288185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f64452-92b6-4650-84a2-fcb7b4c48940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:57.310731 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a5f64452-92b6-4650-84a2-fcb7b4c48940 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:58:57.312242 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a5f64452-92b6-4650-84a2-fcb7b4c48940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:58:57.323363 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 699/1393] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:58:57.377671 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df801243-f986-44db-b37c-74ed44779935 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:58:57.394986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df801243-f986-44db-b37c-74ed44779935 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:58:57.401576 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f272bc-f1d5-4513-a939-6e80411eaf96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:58:57.402229 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f272bc-f1d5-4513-a939-6e80411eaf96 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:57.402511 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f272bc-f1d5-4513-a939-6e80411eaf96 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:57.402787 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f272bc-f1d5-4513-a939-6e80411eaf96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:57.412985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f272bc-f1d5-4513-a939-6e80411eaf96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:58:57.414763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f272bc-f1d5-4513-a939-6e80411eaf96 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:58:57.425259 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 695/1394] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:58:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:58:59.770646 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3148a1-2b9e-4267-ada9-bed5b72de024 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:59.771368 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3148a1-2b9e-4267-ada9-bed5b72de024 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:59.771368 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3148a1-2b9e-4267-ada9-bed5b72de024 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:59.772789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 700/1395] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:58:59.778033 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10f63c-8c76-48b0-a44a-47b522211e82 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:59.778612 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10f63c-8c76-48b0-a44a-47b522211e82 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:59.778612 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10f63c-8c76-48b0-a44a-47b522211e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:59.784613 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=52 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:58:59.799105 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7a10f63c-8c76-48b0-a44a-47b522211e82 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:58:59.800367 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7a10f63c-8c76-48b0-a44a-47b522211e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:58:59.810215 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 696/1396] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:58:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:58:59.857413 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3148a1-2b9e-4267-ada9-bed5b72de024 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:58:59.874004 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3148a1-2b9e-4267-ada9-bed5b72de024 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:58:59.879598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46781c5c-a79f-4ce0-9f96-03724e8e6c23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:58:59.880270 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46781c5c-a79f-4ce0-9f96-03724e8e6c23 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:58:59.880614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46781c5c-a79f-4ce0-9f96-03724e8e6c23 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:58:59.880898 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46781c5c-a79f-4ce0-9f96-03724e8e6c23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:58:59.890104 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46781c5c-a79f-4ce0-9f96-03724e8e6c23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:58:59.891768 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46781c5c-a79f-4ce0-9f96-03724e8e6c23 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:58:59.910971 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 701/1397] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:58:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:59:02.263912 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a21363-6591-42bf-84ad-28540383bcbc None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:02.264583 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a21363-6591-42bf-84ad-28540383bcbc None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:02.264583 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a21363-6591-42bf-84ad-28540383bcbc None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:02.265932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 697/1398] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:59:02.272922 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed745c04-e978-44be-9055-460b9397039b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:02.273512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed745c04-e978-44be-9055-460b9397039b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:02.273512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed745c04-e978-44be-9055-460b9397039b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:02.293208 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-ed745c04-e978-44be-9055-460b9397039b None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:59:02.294457 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ed745c04-e978-44be-9055-460b9397039b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:59:02.303041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 702/1399] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:59:02.355011 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a21363-6591-42bf-84ad-28540383bcbc None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:59:02.370046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a21363-6591-42bf-84ad-28540383bcbc None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:59:02.375941 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea40975-4c63-4235-a8e5-a67b934f81a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:59:02.376644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea40975-4c63-4235-a8e5-a67b934f81a5 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:02.376932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea40975-4c63-4235-a8e5-a67b934f81a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:02.377208 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea40975-4c63-4235-a8e5-a67b934f81a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:02.386616 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea40975-4c63-4235-a8e5-a67b934f81a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:59:02.388889 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea40975-4c63-4235-a8e5-a67b934f81a5 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:59:02.408632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 698/1400] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:59:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:59:02.482259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09362b-e00a-47c9-841d-c0051413123a None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:02.482535 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09362b-e00a-47c9-841d-c0051413123a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:02.483778 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09362b-e00a-47c9-841d-c0051413123a None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:02.484483 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 703/1401] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 21:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:59:02.491628 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc504e-8283-43bb-8545-3c152a445c4a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:02.491628 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc504e-8283-43bb-8545-3c152a445c4a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:02.491628 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc504e-8283-43bb-8545-3c152a445c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:02.512330 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-adfc504e-8283-43bb-8545-3c152a445c4a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:59:02.513662 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-adfc504e-8283-43bb-8545-3c152a445c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:59:02.522104 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 699/1402] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 21:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:59:02.590095 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fa588-f287-42d9-a137-92b49ba4fe4b None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:02.590387 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fa588-f287-42d9-a137-92b49ba4fe4b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:02.590671 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fa588-f287-42d9-a137-92b49ba4fe4b None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:02.592076 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 704/1403] 10.222.0.35 () {54 vars in 962 bytes} [Thu May 19 21:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:59:02.598180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4761c9-cc5a-4cb7-ad73-be483b3ae59d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:02.598520 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4761c9-cc5a-4cb7-ad73-be483b3ae59d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:02.599134 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4761c9-cc5a-4cb7-ad73-be483b3ae59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:02.661795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-4f4761c9-cc5a-4cb7-ad73-be483b3ae59d None None] MFA Rules not processed for user `bf64f4ec145742d78eee6c4a447515dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:59:02.667578 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4f4761c9-cc5a-4cb7-ad73-be483b3ae59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:59:02.731976 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 700/1404] 10.222.0.35 () {58 vars in 1059 bytes} [Thu May 19 21:59:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:59:02.740036 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fa588-f287-42d9-a137-92b49ba4fe4b None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:59:02.751006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fa588-f287-42d9-a137-92b49ba4fe4b None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:59:02.754552 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d78e8-67cb-4549-8d35-065eaaff6ecb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf64f4ec145742d78eee6c4a447515dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:59:02.755846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d78e8-67cb-4549-8d35-065eaaff6ecb service glance] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:02.756249 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d78e8-67cb-4549-8d35-065eaaff6ecb service glance] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:02.756593 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d78e8-67cb-4549-8d35-065eaaff6ecb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:02.772659 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d78e8-67cb-4549-8d35-065eaaff6ecb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:59:02.774316 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d78e8-67cb-4549-8d35-065eaaff6ecb service glance] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:59:02.784447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 705/1405] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:59:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:59:03.341173 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55574ff-f59e-4a1c-81a8-42562fc39291 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:03.341806 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55574ff-f59e-4a1c-81a8-42562fc39291 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:03.341806 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55574ff-f59e-4a1c-81a8-42562fc39291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:03.393419 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b55574ff-f59e-4a1c-81a8-42562fc39291 None None] MFA Rules not processed for user `6d4c4b75552b4c739079f328a6efba40`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:59:03.395771 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b55574ff-f59e-4a1c-81a8-42562fc39291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:59:03.463699 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 701/1406] 10.222.0.35 () {58 vars in 1009 bytes} [Thu May 19 21:59:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:59:03.511228 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7d498-cba8-4b0b-9fec-e83427dcca29 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:03.511786 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7d498-cba8-4b0b-9fec-e83427dcca29 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:03.511951 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7d498-cba8-4b0b-9fec-e83427dcca29 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:03.513380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 706/1407] 10.222.0.35 () {54 vars in 942 bytes} [Thu May 19 21:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:59:03.519818 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef436d-37e3-45b1-b4d7-4a9149eaea19 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:03.520143 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef436d-37e3-45b1-b4d7-4a9149eaea19 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:03.520610 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef436d-37e3-45b1-b4d7-4a9149eaea19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:03.557041 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:59:03.572513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-bbef436d-37e3-45b1-b4d7-4a9149eaea19 None None] MFA Rules not processed for user `86a4208619f84f16b735871ee114e660`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:59:03.573658 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-bbef436d-37e3-45b1-b4d7-4a9149eaea19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:59:03.647965 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 702/1408] 10.222.0.35 () {58 vars in 1039 bytes} [Thu May 19 21:59:03 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:59:03.661400 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7d498-cba8-4b0b-9fec-e83427dcca29 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:59:03.675552 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7d498-cba8-4b0b-9fec-e83427dcca29 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:59:03.681129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76733df-ae9b-4bea-81ce-67e7cdbfa3d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a4208619f84f16b735871ee114e660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:59:03.681781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76733df-ae9b-4bea-81ce-67e7cdbfa3d8 service swift] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:03.682132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76733df-ae9b-4bea-81ce-67e7cdbfa3d8 service swift] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:03.682349 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76733df-ae9b-4bea-81ce-67e7cdbfa3d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:03.690935 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76733df-ae9b-4bea-81ce-67e7cdbfa3d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:59:03.692741 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76733df-ae9b-4bea-81ce-67e7cdbfa3d8 service swift] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:59:03.700908 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 707/1409] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 21:59:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 21:59:13.647007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=33 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:59:13.697621 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=43 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:59:28.072677 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3caf9b3-b6fc-42fc-9949-79dc85f3d02f None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:28.073328 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3caf9b3-b6fc-42fc-9949-79dc85f3d02f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:28.073328 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3caf9b3-b6fc-42fc-9949-79dc85f3d02f None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:28.075056 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 703/1410] 10.222.0.35 () {54 vars in 918 bytes} [Thu May 19 21:59:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:59:28.080570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980bf31-4caa-47d3-a475-6be4096ad59c None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:28.081167 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980bf31-4caa-47d3-a475-6be4096ad59c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:28.081167 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980bf31-4caa-47d3-a475-6be4096ad59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:28.099607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c980bf31-4caa-47d3-a475-6be4096ad59c None None] MFA Rules not processed for user `b1004beeeaed4af4a92c89ad31008b32`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:59:28.100865 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c980bf31-4caa-47d3-a475-6be4096ad59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:59:28.109306 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 708/1411] 10.222.0.35 () {58 vars in 1015 bytes} [Thu May 19 21:59:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:59:28.124363 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3227967-9727-474f-8887-a0f9f4e0279e None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:28.124675 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3227967-9727-474f-8887-a0f9f4e0279e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:28.124956 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3227967-9727-474f-8887-a0f9f4e0279e None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:28.126316 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 704/1412] 10.222.0.35 () {54 vars in 918 bytes} [Thu May 19 21:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:59:28.132646 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa20649-4327-430e-b366-a4b5d95e3e6e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:28.133017 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa20649-4327-430e-b366-a4b5d95e3e6e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:28.133367 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa20649-4327-430e-b366-a4b5d95e3e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:28.151615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-7fa20649-4327-430e-b366-a4b5d95e3e6e None None] MFA Rules not processed for user `902ca8f1d59547a0ab187b4748311f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:59:28.152883 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7fa20649-4327-430e-b366-a4b5d95e3e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:59:28.162508 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 709/1413] 10.222.0.35 () {58 vars in 1015 bytes} [Thu May 19 21:59:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:59:30.929589 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb030c-0a72-47fb-a7c9-c2b2fb4dbcdd None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:30.930151 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb030c-0a72-47fb-a7c9-c2b2fb4dbcdd None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:30.930151 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb030c-0a72-47fb-a7c9-c2b2fb4dbcdd None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:30.931503 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 21:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:59:30.936712 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9eba1-01df-4116-912f-7bbe51245fb2 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:30.937141 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9eba1-01df-4116-912f-7bbe51245fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:30.937247 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9eba1-01df-4116-912f-7bbe51245fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:30.956513 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-39e9eba1-01df-4116-912f-7bbe51245fb2 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:59:30.957910 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-39e9eba1-01df-4116-912f-7bbe51245fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:59:30.965746 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 21:59:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:59:31.010244 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb030c-0a72-47fb-a7c9-c2b2fb4dbcdd None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:59:31.027626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb030c-0a72-47fb-a7c9-c2b2fb4dbcdd None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:59:31.032949 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf40e7-919c-417a-b3ea-1cbeab8eae28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:59:31.033615 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf40e7-919c-417a-b3ea-1cbeab8eae28 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:31.033900 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf40e7-919c-417a-b3ea-1cbeab8eae28 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:31.034179 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf40e7-919c-417a-b3ea-1cbeab8eae28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:31.042688 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf40e7-919c-417a-b3ea-1cbeab8eae28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:59:31.044332 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf40e7-919c-417a-b3ea-1cbeab8eae28 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:59:31.056123 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 706/1416] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:59:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:59:32.071569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5c2c4-7123-4d5c-b696-9dd576a216cc None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:32.072161 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5c2c4-7123-4d5c-b696-9dd576a216cc None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:32.072161 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5c2c4-7123-4d5c-b696-9dd576a216cc None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:32.073562 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 21:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:59:32.078642 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479ef37-c906-44c0-bd44-8930d7f30a8f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:32.079074 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479ef37-c906-44c0-bd44-8930d7f30a8f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:32.079192 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479ef37-c906-44c0-bd44-8930d7f30a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:32.098955 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-5479ef37-c906-44c0-bd44-8930d7f30a8f None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:59:32.100158 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5479ef37-c906-44c0-bd44-8930d7f30a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:59:32.107871 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 21:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:59:32.276674 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5c2c4-7123-4d5c-b696-9dd576a216cc None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:59:32.291523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5c2c4-7123-4d5c-b696-9dd576a216cc None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:59:32.297309 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4515d-bb7d-4133-8f19-a4efa4c3d80a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:59:32.297971 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4515d-bb7d-4133-8f19-a4efa4c3d80a service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:32.298254 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4515d-bb7d-4133-8f19-a4efa4c3d80a service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:32.298724 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4515d-bb7d-4133-8f19-a4efa4c3d80a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:32.308448 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4515d-bb7d-4133-8f19-a4efa4c3d80a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:59:32.310063 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4515d-bb7d-4133-8f19-a4efa4c3d80a service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:59:32.319550 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 712/1419] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:59:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 21:59:33.325704 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770262a-ccd8-49d0-b78d-5b12a524c0eb None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:33.326274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770262a-ccd8-49d0-b78d-5b12a524c0eb None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:33.326274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770262a-ccd8-49d0-b78d-5b12a524c0eb None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:33.327738 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 21:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:59:33.332716 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920ec45-745d-49b7-be98-5e1a95153e1a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:33.333154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920ec45-745d-49b7-be98-5e1a95153e1a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:33.333260 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920ec45-745d-49b7-be98-5e1a95153e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:33.352516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6920ec45-745d-49b7-be98-5e1a95153e1a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:59:33.353727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6920ec45-745d-49b7-be98-5e1a95153e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:59:33.361419 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 21:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:59:33.514962 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770262a-ccd8-49d0-b78d-5b12a524c0eb None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:59:33.529644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770262a-ccd8-49d0-b78d-5b12a524c0eb None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:59:33.535653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9f88e-4be2-4f31-a931-a9dfbef73129 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:59:33.536492 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9f88e-4be2-4f31-a931-a9dfbef73129 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:33.536830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9f88e-4be2-4f31-a931-a9dfbef73129 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:33.537056 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9f88e-4be2-4f31-a931-a9dfbef73129 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:33.545742 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9f88e-4be2-4f31-a931-a9dfbef73129 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:59:33.547379 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9f88e-4be2-4f31-a931-a9dfbef73129 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:59:33.558583 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 709/1422] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:59:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:59:34.547598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33696d-6b6e-42a9-ac6c-3bb77c693298 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:34.548311 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33696d-6b6e-42a9-ac6c-3bb77c693298 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:34.548311 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33696d-6b6e-42a9-ac6c-3bb77c693298 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:34.550135 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 21:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:59:34.554838 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317bd69-3d67-4cd2-be80-17b4737b21fd None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:34.555273 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317bd69-3d67-4cd2-be80-17b4737b21fd None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:34.555400 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317bd69-3d67-4cd2-be80-17b4737b21fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:34.573941 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-2317bd69-3d67-4cd2-be80-17b4737b21fd None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:59:34.575193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2317bd69-3d67-4cd2-be80-17b4737b21fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:59:34.583997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 21:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:59:34.734013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33696d-6b6e-42a9-ac6c-3bb77c693298 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:59:34.750018 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33696d-6b6e-42a9-ac6c-3bb77c693298 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:59:34.756320 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7415d83-f1d7-4535-abf4-d9c63530482f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:59:34.757002 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7415d83-f1d7-4535-abf4-d9c63530482f service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:34.757287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7415d83-f1d7-4535-abf4-d9c63530482f service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:34.757584 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7415d83-f1d7-4535-abf4-d9c63530482f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:34.766265 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7415d83-f1d7-4535-abf4-d9c63530482f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:59:34.767858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7415d83-f1d7-4535-abf4-d9c63530482f service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:59:34.777713 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 715/1425] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:59:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:59:35.725832 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf1ea4-4bb4-41a8-8218-b989bb723a2e None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:35.726393 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf1ea4-4bb4-41a8-8218-b989bb723a2e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:35.726393 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf1ea4-4bb4-41a8-8218-b989bb723a2e None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:35.727793 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 21:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:59:35.733254 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aeb691-ad4a-4370-b55f-9a977fd3d150 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:35.733807 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aeb691-ad4a-4370-b55f-9a977fd3d150 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:35.733923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aeb691-ad4a-4370-b55f-9a977fd3d150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:35.753334 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-24aeb691-ad4a-4370-b55f-9a977fd3d150 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:59:35.755099 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-24aeb691-ad4a-4370-b55f-9a977fd3d150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:59:35.763048 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 21:59:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:59:35.914968 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf1ea4-4bb4-41a8-8218-b989bb723a2e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:59:35.930207 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf1ea4-4bb4-41a8-8218-b989bb723a2e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:59:35.935741 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2ec40-e008-481a-82de-70be01ee339b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:59:35.936447 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2ec40-e008-481a-82de-70be01ee339b service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:35.936734 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2ec40-e008-481a-82de-70be01ee339b service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:35.937009 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2ec40-e008-481a-82de-70be01ee339b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:35.946497 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2ec40-e008-481a-82de-70be01ee339b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:59:35.948089 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2ec40-e008-481a-82de-70be01ee339b service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:59:35.957640 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 712/1428] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:59:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:59:36.843041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1b356-828b-4507-a518-625394603878 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:36.843633 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1b356-828b-4507-a518-625394603878 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:36.843633 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1b356-828b-4507-a518-625394603878 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:36.845022 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 21:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:59:36.849865 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef304e-4702-4c58-924d-41f842ac2824 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:36.850302 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef304e-4702-4c58-924d-41f842ac2824 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:36.850399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef304e-4702-4c58-924d-41f842ac2824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:36.868437 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-22ef304e-4702-4c58-924d-41f842ac2824 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:59:36.869647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-22ef304e-4702-4c58-924d-41f842ac2824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:59:36.878011 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 21:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:59:37.030666 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1b356-828b-4507-a518-625394603878 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:59:37.045305 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1b356-828b-4507-a518-625394603878 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:59:37.051691 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885740d-3dc9-4098-8838-608f1ff6c134 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:59:37.052341 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885740d-3dc9-4098-8838-608f1ff6c134 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:37.052668 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885740d-3dc9-4098-8838-608f1ff6c134 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:37.052947 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885740d-3dc9-4098-8838-608f1ff6c134 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:37.061136 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885740d-3dc9-4098-8838-608f1ff6c134 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:59:37.062726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885740d-3dc9-4098-8838-608f1ff6c134 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:59:37.072912 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 718/1431] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:59:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:59:37.964774 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67856c-cf3f-48ef-ad37-bc8fc7a3dd92 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:37.965321 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67856c-cf3f-48ef-ad37-bc8fc7a3dd92 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:37.965321 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67856c-cf3f-48ef-ad37-bc8fc7a3dd92 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:37.966748 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 21:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:59:37.972178 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a022b46-ab61-427f-b706-441231aa8b64 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:37.972842 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a022b46-ab61-427f-b706-441231aa8b64 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:37.972842 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a022b46-ab61-427f-b706-441231aa8b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:37.991055 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-7a022b46-ab61-427f-b706-441231aa8b64 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:59:37.992262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7a022b46-ab61-427f-b706-441231aa8b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:59:38.000358 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 21:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:59:38.151713 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67856c-cf3f-48ef-ad37-bc8fc7a3dd92 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:59:38.166564 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67856c-cf3f-48ef-ad37-bc8fc7a3dd92 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:59:38.172061 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e37ad9-b110-4dbb-98de-a87e55def01c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:59:38.172739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e37ad9-b110-4dbb-98de-a87e55def01c service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:38.173027 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e37ad9-b110-4dbb-98de-a87e55def01c service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:38.173305 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e37ad9-b110-4dbb-98de-a87e55def01c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:38.183546 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e37ad9-b110-4dbb-98de-a87e55def01c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:59:38.185203 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e37ad9-b110-4dbb-98de-a87e55def01c service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:59:38.195472 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 715/1434] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:59:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:59:39.088982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb9cd0-594a-4636-b5c5-0fbcb72e6f99 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:39.089565 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb9cd0-594a-4636-b5c5-0fbcb72e6f99 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:39.089565 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb9cd0-594a-4636-b5c5-0fbcb72e6f99 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:39.090928 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 21:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:59:39.095691 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae74781-f4dc-4413-b887-406e6e78a29e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:39.096099 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae74781-f4dc-4413-b887-406e6e78a29e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:39.096245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae74781-f4dc-4413-b887-406e6e78a29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:39.116653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-eae74781-f4dc-4413-b887-406e6e78a29e None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:59:39.117888 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-eae74781-f4dc-4413-b887-406e6e78a29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:59:39.126796 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 21:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:59:39.294499 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb9cd0-594a-4636-b5c5-0fbcb72e6f99 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:59:39.312883 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb9cd0-594a-4636-b5c5-0fbcb72e6f99 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:59:39.318641 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc106edb-1992-4cbc-bb25-b024646ec6d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:59:39.319350 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc106edb-1992-4cbc-bb25-b024646ec6d4 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:39.319635 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc106edb-1992-4cbc-bb25-b024646ec6d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:39.319911 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc106edb-1992-4cbc-bb25-b024646ec6d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:39.329342 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc106edb-1992-4cbc-bb25-b024646ec6d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:59:39.330986 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc106edb-1992-4cbc-bb25-b024646ec6d4 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:59:39.341578 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 721/1437] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:59:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:59:40.239041 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b37bb-2ad5-4f0b-8633-c33b98fa7adf None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:40.239582 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b37bb-2ad5-4f0b-8633-c33b98fa7adf None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:40.239715 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b37bb-2ad5-4f0b-8633-c33b98fa7adf None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:40.241137 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 21:59:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:59:40.245906 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92584556-483f-4db0-a5b5-908e71871420 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:40.246559 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92584556-483f-4db0-a5b5-908e71871420 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:40.246708 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92584556-483f-4db0-a5b5-908e71871420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:40.266734 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-92584556-483f-4db0-a5b5-908e71871420 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:59:40.267960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-92584556-483f-4db0-a5b5-908e71871420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:59:40.276124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 21:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:59:40.427431 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b37bb-2ad5-4f0b-8633-c33b98fa7adf None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:59:40.441928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b37bb-2ad5-4f0b-8633-c33b98fa7adf None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:59:40.447298 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a83da-ccb5-408a-ad72-d22abb712272 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:59:40.447928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a83da-ccb5-408a-ad72-d22abb712272 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:40.448207 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a83da-ccb5-408a-ad72-d22abb712272 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:40.448513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a83da-ccb5-408a-ad72-d22abb712272 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:40.457377 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a83da-ccb5-408a-ad72-d22abb712272 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:59:40.458930 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a83da-ccb5-408a-ad72-d22abb712272 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:59:40.469331 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 718/1440] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:59:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:59:42.624612 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eda57a-0445-40e0-b377-223b37cef624 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:42.625149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eda57a-0445-40e0-b377-223b37cef624 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:42.625149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eda57a-0445-40e0-b377-223b37cef624 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:42.626503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 21:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:59:42.632081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbba6b-ce38-4be5-b897-9d30dd7301ad None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:42.632523 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbba6b-ce38-4be5-b897-9d30dd7301ad None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:42.632661 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbba6b-ce38-4be5-b897-9d30dd7301ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:42.650701 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1bdbba6b-ce38-4be5-b897-9d30dd7301ad None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:59:42.651977 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1bdbba6b-ce38-4be5-b897-9d30dd7301ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:59:42.660675 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 21:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:59:42.701964 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eda57a-0445-40e0-b377-223b37cef624 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:59:42.719557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eda57a-0445-40e0-b377-223b37cef624 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:59:42.723995 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8c006-ace2-4f91-ba3b-2d56d6e09051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:59:42.724677 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8c006-ace2-4f91-ba3b-2d56d6e09051 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:42.724964 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8c006-ace2-4f91-ba3b-2d56d6e09051 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:42.725241 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8c006-ace2-4f91-ba3b-2d56d6e09051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:42.734506 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8c006-ace2-4f91-ba3b-2d56d6e09051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:59:42.735937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8c006-ace2-4f91-ba3b-2d56d6e09051 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:59:42.746761 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 724/1443] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:59:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:59:45.175977 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa58b6-85fa-4e0d-b243-a56db1f12fc4 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:45.176567 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa58b6-85fa-4e0d-b243-a56db1f12fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:45.176567 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa58b6-85fa-4e0d-b243-a56db1f12fc4 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:45.177908 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 21:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:59:45.183159 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e4592-3563-4ae7-919a-acd06a41b662 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:45.183585 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e4592-3563-4ae7-919a-acd06a41b662 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:45.183718 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e4592-3563-4ae7-919a-acd06a41b662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:45.201487 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-f04e4592-3563-4ae7-919a-acd06a41b662 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:59:45.203396 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f04e4592-3563-4ae7-919a-acd06a41b662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:59:45.212948 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 21:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:59:45.251389 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa58b6-85fa-4e0d-b243-a56db1f12fc4 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:59:45.262765 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa58b6-85fa-4e0d-b243-a56db1f12fc4 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:59:45.266386 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b37ae-cadd-4024-98e4-aa129ef669a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:59:45.267039 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b37ae-cadd-4024-98e4-aa129ef669a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:45.267325 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b37ae-cadd-4024-98e4-aa129ef669a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:45.267606 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b37ae-cadd-4024-98e4-aa129ef669a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:45.277881 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b37ae-cadd-4024-98e4-aa129ef669a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:59:45.279315 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b37ae-cadd-4024-98e4-aa129ef669a4 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:59:45.289794 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 721/1446] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:59:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:59:47.887171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81a6df-ff9c-4e53-ae19-9c2f3f1e92e6 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:47.887776 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81a6df-ff9c-4e53-ae19-9c2f3f1e92e6 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:47.887776 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81a6df-ff9c-4e53-ae19-9c2f3f1e92e6 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:47.889312 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 21:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:59:47.895164 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82464e36-584f-4c80-b044-74beffb4e421 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:47.895605 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82464e36-584f-4c80-b044-74beffb4e421 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:47.895707 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82464e36-584f-4c80-b044-74beffb4e421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:47.915781 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-82464e36-584f-4c80-b044-74beffb4e421 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:59:47.917019 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-82464e36-584f-4c80-b044-74beffb4e421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:59:47.924913 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 21:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:59:47.964620 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81a6df-ff9c-4e53-ae19-9c2f3f1e92e6 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:59:47.975900 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81a6df-ff9c-4e53-ae19-9c2f3f1e92e6 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:59:47.979441 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a8dfd-bf2f-40c4-a9b7-f03a512f98e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:59:47.980117 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a8dfd-bf2f-40c4-a9b7-f03a512f98e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:47.980451 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a8dfd-bf2f-40c4-a9b7-f03a512f98e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:47.980743 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a8dfd-bf2f-40c4-a9b7-f03a512f98e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:47.990070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a8dfd-bf2f-40c4-a9b7-f03a512f98e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:59:47.991508 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a8dfd-bf2f-40c4-a9b7-f03a512f98e1 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:59:48.001258 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 727/1449] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:59:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:59:50.464106 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23055ef8-aca3-4562-8f94-3351a62f9b36 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:50.464745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23055ef8-aca3-4562-8f94-3351a62f9b36 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:50.464745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23055ef8-aca3-4562-8f94-3351a62f9b36 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:50.466094 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 21:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:59:50.472001 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289177d6-243d-4b13-acb0-4dd880b6a03d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:50.472480 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289177d6-243d-4b13-acb0-4dd880b6a03d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:50.472917 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289177d6-243d-4b13-acb0-4dd880b6a03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:50.490999 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-289177d6-243d-4b13-acb0-4dd880b6a03d None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:59:50.492185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-289177d6-243d-4b13-acb0-4dd880b6a03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:59:50.500419 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 21:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:59:50.539676 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23055ef8-aca3-4562-8f94-3351a62f9b36 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:59:50.550742 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23055ef8-aca3-4562-8f94-3351a62f9b36 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:59:50.554494 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e55b4-9aa6-4f16-b177-8da8e733985c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:59:50.555130 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e55b4-9aa6-4f16-b177-8da8e733985c service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:50.555407 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e55b4-9aa6-4f16-b177-8da8e733985c service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:50.555678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e55b4-9aa6-4f16-b177-8da8e733985c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:50.564919 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e55b4-9aa6-4f16-b177-8da8e733985c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:59:50.566606 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e55b4-9aa6-4f16-b177-8da8e733985c service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:59:50.577349 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 724/1452] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:59:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:59:52.997271 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a15c3-31ee-48f2-8a86-c642a26e210f None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:52.997895 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a15c3-31ee-48f2-8a86-c642a26e210f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:52.997895 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a15c3-31ee-48f2-8a86-c642a26e210f None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:52.999275 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 21:59:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:59:53.005580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca23152-1757-4865-a6f2-a95256771c67 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:53.006072 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca23152-1757-4865-a6f2-a95256771c67 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:53.006186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca23152-1757-4865-a6f2-a95256771c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:53.026088 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6ca23152-1757-4865-a6f2-a95256771c67 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:59:53.027295 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6ca23152-1757-4865-a6f2-a95256771c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:59:53.035864 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 21:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:59:53.074420 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a15c3-31ee-48f2-8a86-c642a26e210f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:59:53.085829 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a15c3-31ee-48f2-8a86-c642a26e210f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:59:53.089426 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686b18f-30ec-4366-bf25-4924007f7ace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:59:53.090070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686b18f-30ec-4366-bf25-4924007f7ace service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:53.090362 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686b18f-30ec-4366-bf25-4924007f7ace service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:53.090637 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686b18f-30ec-4366-bf25-4924007f7ace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:53.100136 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686b18f-30ec-4366-bf25-4924007f7ace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:59:53.101610 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686b18f-30ec-4366-bf25-4924007f7ace service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:59:53.114094 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 730/1455] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:59:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:59:55.514627 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ab917-d237-4bc9-8e2b-00f647dff803 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:55.515268 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ab917-d237-4bc9-8e2b-00f647dff803 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:55.516417 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ab917-d237-4bc9-8e2b-00f647dff803 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:55.517187 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 21:59:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 21:59:55.523304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab0082-2535-4b9c-84d4-aca41c6d1845 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:55.523998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab0082-2535-4b9c-84d4-aca41c6d1845 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:55.523998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab0082-2535-4b9c-84d4-aca41c6d1845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:55.530056 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=70 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:59:55.543625 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a7ab0082-2535-4b9c-84d4-aca41c6d1845 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:59:55.544854 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a7ab0082-2535-4b9c-84d4-aca41c6d1845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:59:55.553430 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 21:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 21:59:55.591385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ab917-d237-4bc9-8e2b-00f647dff803 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:59:55.598258 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=64 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:59:55.604127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ab917-d237-4bc9-8e2b-00f647dff803 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:59:55.607870 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9453e-2c1b-4521-9453-e4ea0f679cef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:59:55.608604 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9453e-2c1b-4521-9453-e4ea0f679cef service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:55.608840 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9453e-2c1b-4521-9453-e4ea0f679cef service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:55.609116 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9453e-2c1b-4521-9453-e4ea0f679cef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:55.628219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9453e-2c1b-4521-9453-e4ea0f679cef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:59:55.630153 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9453e-2c1b-4521-9453-e4ea0f679cef service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:59:55.641002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 727/1458] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:59:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 21:59:58.092533 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864a78b-7c62-40b8-be21-396585257039 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:58.093130 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864a78b-7c62-40b8-be21-396585257039 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:58.093130 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864a78b-7c62-40b8-be21-396585257039 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:58.094481 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 21:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 21:59:58.099980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d0128-0cdc-4770-8c00-4f4b94112bf5 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:58.100473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d0128-0cdc-4770-8c00-4f4b94112bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:58.100572 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d0128-0cdc-4770-8c00-4f4b94112bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:58.123013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-073d0128-0cdc-4770-8c00-4f4b94112bf5 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 21:59:58.124258 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-073d0128-0cdc-4770-8c00-4f4b94112bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 21:59:58.133297 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 21:59:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 21:59:58.170679 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864a78b-7c62-40b8-be21-396585257039 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 21:59:58.182781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864a78b-7c62-40b8-be21-396585257039 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 21:59:58.186435 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f959065-8989-4677-80b5-cb69879693f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 21:59:58.187092 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f959065-8989-4677-80b5-cb69879693f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 21:59:58.187374 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f959065-8989-4677-80b5-cb69879693f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 21:59:58.187644 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f959065-8989-4677-80b5-cb69879693f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 21:59:58.198457 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f959065-8989-4677-80b5-cb69879693f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 21:59:58.199907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f959065-8989-4677-80b5-cb69879693f1 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 21:59:58.209854 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 733/1461] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 21:59:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:00:00.536239 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce80d4a-c15f-48e1-a09c-8d6a97557dc4 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:00.536842 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce80d4a-c15f-48e1-a09c-8d6a97557dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:00.536842 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce80d4a-c15f-48e1-a09c-8d6a97557dc4 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:00.538226 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 22:00:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:00:00.543599 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262901f5-8260-49f9-800b-fe122fc9f01c None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:00.544055 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262901f5-8260-49f9-800b-fe122fc9f01c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:00.544160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262901f5-8260-49f9-800b-fe122fc9f01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:00.570711 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-262901f5-8260-49f9-800b-fe122fc9f01c None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:00:00.572278 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-262901f5-8260-49f9-800b-fe122fc9f01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:00:00.580367 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 22:00:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:00:00.618365 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce80d4a-c15f-48e1-a09c-8d6a97557dc4 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:00:00.630354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce80d4a-c15f-48e1-a09c-8d6a97557dc4 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:00:00.633878 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74243f6a-73b1-4152-a6de-e1d516b1c57e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:00:00.634519 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74243f6a-73b1-4152-a6de-e1d516b1c57e service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:00.634804 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74243f6a-73b1-4152-a6de-e1d516b1c57e service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:00.635082 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74243f6a-73b1-4152-a6de-e1d516b1c57e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:00.644734 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74243f6a-73b1-4152-a6de-e1d516b1c57e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:00:00.646162 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74243f6a-73b1-4152-a6de-e1d516b1c57e service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:00:00.655550 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 730/1464] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:00:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:00:02.951882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690adef-7558-456e-a335-dcef14367342 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:02.952489 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690adef-7558-456e-a335-dcef14367342 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:02.952489 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690adef-7558-456e-a335-dcef14367342 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:02.953871 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 22:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:00:02.960111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db495068-f6e9-406e-a1d5-b26b33299539 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:02.960732 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db495068-f6e9-406e-a1d5-b26b33299539 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:02.960732 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db495068-f6e9-406e-a1d5-b26b33299539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:02.979389 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-db495068-f6e9-406e-a1d5-b26b33299539 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:00:02.980678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-db495068-f6e9-406e-a1d5-b26b33299539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:00:02.989736 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 22:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:00:03.027251 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690adef-7558-456e-a335-dcef14367342 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:00:03.038825 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690adef-7558-456e-a335-dcef14367342 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:00:03.042524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c6b6e-0907-4217-a9e9-ccce091d5b5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:00:03.043161 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c6b6e-0907-4217-a9e9-ccce091d5b5e service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:03.043452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c6b6e-0907-4217-a9e9-ccce091d5b5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:03.043732 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c6b6e-0907-4217-a9e9-ccce091d5b5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:03.053368 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c6b6e-0907-4217-a9e9-ccce091d5b5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:00:03.054808 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c6b6e-0907-4217-a9e9-ccce091d5b5e service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:00:03.073743 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 736/1467] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:00:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:00:05.395014 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60537bdd-fd5d-4dae-88ae-ed419eff6d03 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:05.395544 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60537bdd-fd5d-4dae-88ae-ed419eff6d03 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:05.395665 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60537bdd-fd5d-4dae-88ae-ed419eff6d03 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:05.396980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 22:00:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:00:05.402371 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9d470-362f-4024-ab33-8f80570315ef None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:05.402863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9d470-362f-4024-ab33-8f80570315ef None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:05.402983 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9d470-362f-4024-ab33-8f80570315ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:05.421023 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-68f9d470-362f-4024-ab33-8f80570315ef None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:00:05.422266 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-68f9d470-362f-4024-ab33-8f80570315ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:00:05.431673 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 22:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:00:05.469234 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60537bdd-fd5d-4dae-88ae-ed419eff6d03 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:00:05.480678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60537bdd-fd5d-4dae-88ae-ed419eff6d03 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:00:05.484219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a1de9-df24-4bd0-95c7-9988ae81511f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:00:05.484891 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a1de9-df24-4bd0-95c7-9988ae81511f service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:05.485176 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a1de9-df24-4bd0-95c7-9988ae81511f service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:05.485451 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a1de9-df24-4bd0-95c7-9988ae81511f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:05.494955 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a1de9-df24-4bd0-95c7-9988ae81511f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:00:05.496674 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a1de9-df24-4bd0-95c7-9988ae81511f service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:00:05.506730 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 733/1470] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:00:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:00:15.415599 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=20 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:00:15.501938 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=23 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:00:39.348109 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea72a3-d9db-4d4a-b607-4ad376013212 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:39.348109 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea72a3-d9db-4d4a-b607-4ad376013212 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:39.349050 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea72a3-d9db-4d4a-b607-4ad376013212 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:39.354613 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 738/1471] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 22:00:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:00:39.356256 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3a951-9308-4807-8719-6f4240d5c75b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:39.356763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3a951-9308-4807-8719-6f4240d5c75b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:39.356865 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3a951-9308-4807-8719-6f4240d5c75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:39.375454 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-49e3a951-9308-4807-8719-6f4240d5c75b None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:00:39.376708 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-49e3a951-9308-4807-8719-6f4240d5c75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:00:39.385446 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 734/1472] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 22:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:00:39.434208 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e05a3-998d-4f54-8176-fbbfc9045226 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:39.434498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e05a3-998d-4f54-8176-fbbfc9045226 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:39.434775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e05a3-998d-4f54-8176-fbbfc9045226 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:39.436137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 739/1473] 10.222.0.35 () {54 vars in 962 bytes} [Thu May 19 22:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:00:39.441072 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57289196-9082-4d2f-baeb-75cd415310c6 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:39.441348 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57289196-9082-4d2f-baeb-75cd415310c6 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:39.441786 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57289196-9082-4d2f-baeb-75cd415310c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:39.467408 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-57289196-9082-4d2f-baeb-75cd415310c6 None None] MFA Rules not processed for user `bf64f4ec145742d78eee6c4a447515dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:00:39.469262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-57289196-9082-4d2f-baeb-75cd415310c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:00:39.480817 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 735/1474] 10.222.0.35 () {58 vars in 1059 bytes} [Thu May 19 22:00:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:00:39.488691 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e05a3-998d-4f54-8176-fbbfc9045226 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:00:39.500283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e05a3-998d-4f54-8176-fbbfc9045226 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:00:39.505154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca94372-3f6c-4ae5-b164-b1bc4e908970 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf64f4ec145742d78eee6c4a447515dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:00:39.506246 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca94372-3f6c-4ae5-b164-b1bc4e908970 service glance] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:39.506500 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca94372-3f6c-4ae5-b164-b1bc4e908970 service glance] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:39.506785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca94372-3f6c-4ae5-b164-b1bc4e908970 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:39.517098 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca94372-3f6c-4ae5-b164-b1bc4e908970 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:00:39.519213 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca94372-3f6c-4ae5-b164-b1bc4e908970 service glance] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:00:39.530426 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 740/1475] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:00:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:00:41.927012 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b26459-275c-4981-8b55-b9308be70039 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:41.927597 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b26459-275c-4981-8b55-b9308be70039 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:41.927597 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b26459-275c-4981-8b55-b9308be70039 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:41.929104 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 736/1476] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 22:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:00:41.934421 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddd09d-cddc-43b1-a976-61fdc794af5a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:41.934827 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddd09d-cddc-43b1-a976-61fdc794af5a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:41.934977 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddd09d-cddc-43b1-a976-61fdc794af5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:41.961313 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-9dddd09d-cddc-43b1-a976-61fdc794af5a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:00:41.962547 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9dddd09d-cddc-43b1-a976-61fdc794af5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:00:41.971090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 741/1477] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 22:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:00:41.995224 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b26459-275c-4981-8b55-b9308be70039 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:00:42.011817 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b26459-275c-4981-8b55-b9308be70039 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:00:42.017250 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ee0ae-b5be-4d21-baeb-a7008a8f4afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:00:42.018176 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ee0ae-b5be-4d21-baeb-a7008a8f4afb admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:42.018728 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ee0ae-b5be-4d21-baeb-a7008a8f4afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:42.019014 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ee0ae-b5be-4d21-baeb-a7008a8f4afb admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:42.019763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ee0ae-b5be-4d21-baeb-a7008a8f4afb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:00:42.021611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: WARNING py.warnings [None req-0a2ee0ae-b5be-4d21-baeb-a7008a8f4afb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 22:00:42.021611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: warnings.warn(msg) May 19 22:00:42.021611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: May 19 22:00:42.022784 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ee0ae-b5be-4d21-baeb-a7008a8f4afb admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:00:42.042960 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 737/1478] 10.222.0.35 () {56 vars in 1108 bytes} [Thu May 19 22:00:41 2022] GET /identity/v3/projects => generated 2553 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:00:44.394377 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2be5ed-a366-4f0b-9f8a-bf229f23b7b5 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:44.394862 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2be5ed-a366-4f0b-9f8a-bf229f23b7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:44.394970 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2be5ed-a366-4f0b-9f8a-bf229f23b7b5 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:44.396368 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 742/1479] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 22:00:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:00:44.402115 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201fbf3-f790-4bca-a358-1d5490870830 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:44.402683 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201fbf3-f790-4bca-a358-1d5490870830 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:44.402683 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201fbf3-f790-4bca-a358-1d5490870830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:44.421294 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c201fbf3-f790-4bca-a358-1d5490870830 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:00:44.422502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c201fbf3-f790-4bca-a358-1d5490870830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:00:44.431262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 738/1480] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 22:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:00:44.475216 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2be5ed-a366-4f0b-9f8a-bf229f23b7b5 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:00:44.490279 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2be5ed-a366-4f0b-9f8a-bf229f23b7b5 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:00:44.495658 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378dc69-bec5-46a4-94a9-917614667fdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:00:44.496588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378dc69-bec5-46a4-94a9-917614667fdd service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:44.496875 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378dc69-bec5-46a4-94a9-917614667fdd service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:44.497144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378dc69-bec5-46a4-94a9-917614667fdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:44.508044 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378dc69-bec5-46a4-94a9-917614667fdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:00:44.509753 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378dc69-bec5-46a4-94a9-917614667fdd service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:00:44.520518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 743/1481] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:00:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:00:46.955378 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2c554-0ece-43de-886f-a943301f2bda None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:46.955919 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2c554-0ece-43de-886f-a943301f2bda None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:46.955919 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2c554-0ece-43de-886f-a943301f2bda None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:46.957357 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 739/1482] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 22:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:00:46.963077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677b654-a926-4e33-97bf-e5511069868b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:46.963644 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677b654-a926-4e33-97bf-e5511069868b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:46.963644 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677b654-a926-4e33-97bf-e5511069868b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:46.981510 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6677b654-a926-4e33-97bf-e5511069868b None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:00:46.982687 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6677b654-a926-4e33-97bf-e5511069868b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:00:46.995649 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 744/1483] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 22:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:00:47.034536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2c554-0ece-43de-886f-a943301f2bda None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:00:47.045307 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2c554-0ece-43de-886f-a943301f2bda None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:00:47.049566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23730f3e-4528-4c3a-b181-84886572bb6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:00:47.050214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23730f3e-4528-4c3a-b181-84886572bb6b service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:47.050496 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23730f3e-4528-4c3a-b181-84886572bb6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:47.050772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23730f3e-4528-4c3a-b181-84886572bb6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:47.059891 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23730f3e-4528-4c3a-b181-84886572bb6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:00:47.061356 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23730f3e-4528-4c3a-b181-84886572bb6b service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:00:47.072447 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 740/1484] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:00:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:00:49.441494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08461670-5a55-4a1c-a2f9-a33ad93eb8bc None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:49.442085 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08461670-5a55-4a1c-a2f9-a33ad93eb8bc None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:49.442190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08461670-5a55-4a1c-a2f9-a33ad93eb8bc None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:49.444330 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 745/1485] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 22:00:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:00:49.449843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8f690-c5d8-4e29-9e26-d829587f34a3 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:49.450406 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8f690-c5d8-4e29-9e26-d829587f34a3 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:49.450406 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8f690-c5d8-4e29-9e26-d829587f34a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:49.469601 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-45a8f690-c5d8-4e29-9e26-d829587f34a3 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:00:49.470982 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-45a8f690-c5d8-4e29-9e26-d829587f34a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:00:49.478868 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 741/1486] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 22:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:00:49.518111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08461670-5a55-4a1c-a2f9-a33ad93eb8bc None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:00:49.529085 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08461670-5a55-4a1c-a2f9-a33ad93eb8bc None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:00:49.532598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecae742-b985-4efd-ad59-58de6396254b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:00:49.533258 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecae742-b985-4efd-ad59-58de6396254b service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:49.533533 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecae742-b985-4efd-ad59-58de6396254b service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:49.533892 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecae742-b985-4efd-ad59-58de6396254b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:49.542938 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecae742-b985-4efd-ad59-58de6396254b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:00:49.544382 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecae742-b985-4efd-ad59-58de6396254b service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:00:49.554009 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 746/1487] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:00:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:00:52.000778 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acd8d5-f7ea-43ce-8371-481447de0ff8 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:52.001355 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acd8d5-f7ea-43ce-8371-481447de0ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:52.001355 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acd8d5-f7ea-43ce-8371-481447de0ff8 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:52.003390 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 742/1488] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 22:00:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:00:52.008747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91e698-10d0-4606-a19d-0ed92ca3900f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:52.009181 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91e698-10d0-4606-a19d-0ed92ca3900f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:52.009293 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91e698-10d0-4606-a19d-0ed92ca3900f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:52.027724 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-bd91e698-10d0-4606-a19d-0ed92ca3900f None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:00:52.028966 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-bd91e698-10d0-4606-a19d-0ed92ca3900f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:00:52.036695 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 747/1489] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 22:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:00:52.078274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54acd8d5-f7ea-43ce-8371-481447de0ff8 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:00:52.089474 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54acd8d5-f7ea-43ce-8371-481447de0ff8 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:00:52.092950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a21a9-97c0-49a5-b36f-d3ab312efa23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:00:52.093582 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a21a9-97c0-49a5-b36f-d3ab312efa23 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:52.093861 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a21a9-97c0-49a5-b36f-d3ab312efa23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:52.094133 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a21a9-97c0-49a5-b36f-d3ab312efa23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:52.103358 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a21a9-97c0-49a5-b36f-d3ab312efa23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:00:52.104817 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a21a9-97c0-49a5-b36f-d3ab312efa23 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:00:52.114785 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 743/1490] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:00:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:00:54.588807 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1654f-2d18-4987-9066-f14010a409a2 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:54.589341 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1654f-2d18-4987-9066-f14010a409a2 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:54.589436 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1654f-2d18-4987-9066-f14010a409a2 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:54.590778 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 748/1491] 10.222.0.35 () {54 vars in 926 bytes} [Thu May 19 22:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:00:54.597135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4c535-a0d6-441b-b5d3-243838955b07 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:54.597569 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4c535-a0d6-441b-b5d3-243838955b07 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:54.597689 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4c535-a0d6-441b-b5d3-243838955b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:54.616339 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-dcd4c535-a0d6-441b-b5d3-243838955b07 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:00:54.617633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-dcd4c535-a0d6-441b-b5d3-243838955b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:00:54.626378 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 744/1492] 10.222.0.35 () {58 vars in 1023 bytes} [Thu May 19 22:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:00:54.665691 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1654f-2d18-4987-9066-f14010a409a2 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:00:54.678141 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1654f-2d18-4987-9066-f14010a409a2 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:00:54.681694 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a0f09-6267-41e8-bf59-5c55ecfd4da6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:00:54.682342 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a0f09-6267-41e8-bf59-5c55ecfd4da6 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:00:54.682624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a0f09-6267-41e8-bf59-5c55ecfd4da6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:00:54.682900 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a0f09-6267-41e8-bf59-5c55ecfd4da6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:00:54.692568 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a0f09-6267-41e8-bf59-5c55ecfd4da6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:00:54.694000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a0f09-6267-41e8-bf59-5c55ecfd4da6 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:00:54.703461 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 749/1493] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:00:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:01:04.610017 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=33 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:01:04.699215 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=33 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:02:37.148319 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39580e86-35bc-4911-be8b-e076d732fae7 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:02:37.148952 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39580e86-35bc-4911-be8b-e076d732fae7 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:02:37.148952 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39580e86-35bc-4911-be8b-e076d732fae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:02:37.167490 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-39580e86-35bc-4911-be8b-e076d732fae7 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:02:37.168724 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-39580e86-35bc-4911-be8b-e076d732fae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:02:37.177128 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 745/1494] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:02:37.186555 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ba324-5ec2-4fac-a120-3814aab6f0c8 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:02:37.187261 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ba324-5ec2-4fac-a120-3814aab6f0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:02:37.187261 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ba324-5ec2-4fac-a120-3814aab6f0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:02:37.205652 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-608ba324-5ec2-4fac-a120-3814aab6f0c8 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:02:37.206852 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-608ba324-5ec2-4fac-a120-3814aab6f0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:02:37.214765 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 750/1495] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:02:37.220127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39580e86-35bc-4911-be8b-e076d732fae7 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:02:37.230421 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39580e86-35bc-4911-be8b-e076d732fae7 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:02:37.235416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f2313-5397-429b-abe6-1bd0337b760f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:02:37.236081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f2313-5397-429b-abe6-1bd0337b760f admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:02:37.236365 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f2313-5397-429b-abe6-1bd0337b760f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:02:37.236671 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f2313-5397-429b-abe6-1bd0337b760f admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:02:37.237415 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f2313-5397-429b-abe6-1bd0337b760f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:02:37.237726 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f2313-5397-429b-abe6-1bd0337b760f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:02:37.238749 dv-cinder-842237-1-smb devstack@keystone.service[80210]: WARNING py.warnings [None req-095f2313-5397-429b-abe6-1bd0337b760f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 22:02:37.238749 dv-cinder-842237-1-smb devstack@keystone.service[80210]: warnings.warn(msg) May 19 22:02:37.238749 dv-cinder-842237-1-smb devstack@keystone.service[80210]: May 19 22:02:37.239657 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f2313-5397-429b-abe6-1bd0337b760f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:02:37.252459 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 746/1496] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:02:37.261590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ba324-5ec2-4fac-a120-3814aab6f0c8 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:02:37.271804 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ba324-5ec2-4fac-a120-3814aab6f0c8 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:02:37.277936 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99a4e6-a070-4575-bf6c-bfb856ec566a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:02:37.277936 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99a4e6-a070-4575-bf6c-bfb856ec566a admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:02:37.278241 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99a4e6-a070-4575-bf6c-bfb856ec566a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:02:37.278501 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99a4e6-a070-4575-bf6c-bfb856ec566a admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:02:37.279252 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99a4e6-a070-4575-bf6c-bfb856ec566a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:02:37.281823 dv-cinder-842237-1-smb devstack@keystone.service[80209]: WARNING py.warnings [None req-7c99a4e6-a070-4575-bf6c-bfb856ec566a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 22:02:37.281823 dv-cinder-842237-1-smb devstack@keystone.service[80209]: warnings.warn(msg) May 19 22:02:37.281823 dv-cinder-842237-1-smb devstack@keystone.service[80209]: May 19 22:02:37.283067 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99a4e6-a070-4575-bf6c-bfb856ec566a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:02:37.319535 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 751/1497] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:02:37 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:02:37.323789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f2313-5397-429b-abe6-1bd0337b760f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:02:37.335328 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f2313-5397-429b-abe6-1bd0337b760f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:02:37.397987 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fdd8e-42d3-4116-9fd6-385e0d18b666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:02:37.398726 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fdd8e-42d3-4116-9fd6-385e0d18b666 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:02:37.398955 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fdd8e-42d3-4116-9fd6-385e0d18b666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:02:37.399235 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fdd8e-42d3-4116-9fd6-385e0d18b666 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:02:37.399940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215fdd8e-42d3-4116-9fd6-385e0d18b666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:02:37.400989 dv-cinder-842237-1-smb devstack@keystone.service[80210]: WARNING py.warnings [None req-215fdd8e-42d3-4116-9fd6-385e0d18b666 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 22:02:37.400989 dv-cinder-842237-1-smb devstack@keystone.service[80210]: warnings.warn(msg) May 19 22:02:37.400989 dv-cinder-842237-1-smb devstack@keystone.service[80210]: May 19 22:02:37.402213 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215fdd8e-42d3-4116-9fd6-385e0d18b666 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:02:37.422074 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 747/1498] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:02:37 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:02:37.426195 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99a4e6-a070-4575-bf6c-bfb856ec566a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:02:37.437565 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99a4e6-a070-4575-bf6c-bfb856ec566a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:02:37.442623 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d2551-7555-4c39-815e-88522aa0ac2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:02:37.443304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d2551-7555-4c39-815e-88522aa0ac2b admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:02:37.443745 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d2551-7555-4c39-815e-88522aa0ac2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:02:37.444067 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d2551-7555-4c39-815e-88522aa0ac2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:02:37.444803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d2551-7555-4c39-815e-88522aa0ac2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:02:37.445843 dv-cinder-842237-1-smb devstack@keystone.service[80209]: WARNING py.warnings [None req-035d2551-7555-4c39-815e-88522aa0ac2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 22:02:37.445843 dv-cinder-842237-1-smb devstack@keystone.service[80209]: warnings.warn(msg) May 19 22:02:37.445843 dv-cinder-842237-1-smb devstack@keystone.service[80209]: May 19 22:02:37.446733 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d2551-7555-4c39-815e-88522aa0ac2b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:02:37.460684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 752/1499] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:02:37.464885 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fdd8e-42d3-4116-9fd6-385e0d18b666 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:02:37.475543 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fdd8e-42d3-4116-9fd6-385e0d18b666 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:02:37.480147 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a332a60-f816-4605-9b72-672e628f6bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:02:37.480840 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a332a60-f816-4605-9b72-672e628f6bde admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:02:37.481122 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a332a60-f816-4605-9b72-672e628f6bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:02:37.481394 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a332a60-f816-4605-9b72-672e628f6bde admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:02:37.482119 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a332a60-f816-4605-9b72-672e628f6bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:02:37.483168 dv-cinder-842237-1-smb devstack@keystone.service[80210]: WARNING py.warnings [None req-5a332a60-f816-4605-9b72-672e628f6bde admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 22:02:37.483168 dv-cinder-842237-1-smb devstack@keystone.service[80210]: warnings.warn(msg) May 19 22:02:37.483168 dv-cinder-842237-1-smb devstack@keystone.service[80210]: May 19 22:02:37.484300 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a332a60-f816-4605-9b72-672e628f6bde admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:02:37.500974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 748/1500] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:02:37.505271 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d2551-7555-4c39-815e-88522aa0ac2b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:02:37.515863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d2551-7555-4c39-815e-88522aa0ac2b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:02:37.520571 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf6de0-e6f5-41b0-a971-9e22decf6ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:02:37.521429 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf6de0-e6f5-41b0-a971-9e22decf6ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:02:37.521714 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf6de0-e6f5-41b0-a971-9e22decf6ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:02:37.521992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf6de0-e6f5-41b0-a971-9e22decf6ddf admin admin] PATH_INFO: `/v3/projects/17c60f32715c4602bd5520a5106ca909/users/e7add634691344a89e0fa76b6ccc44fb/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:02:37.537540 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf6de0-e6f5-41b0-a971-9e22decf6ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=17c60f32715c4602bd5520a5106ca909, user_id=e7add634691344a89e0fa76b6ccc44fb, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:02:37.538600 dv-cinder-842237-1-smb devstack@keystone.service[80209]: WARNING py.warnings [None req-a1bf6de0-e6f5-41b0-a971-9e22decf6ddf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 22:02:37.538600 dv-cinder-842237-1-smb devstack@keystone.service[80209]: warnings.warn(msg) May 19 22:02:37.538600 dv-cinder-842237-1-smb devstack@keystone.service[80209]: May 19 22:02:37.540604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf6de0-e6f5-41b0-a971-9e22decf6ddf admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:02:37.554417 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 753/1501] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:02:37 2022] PUT /identity/v3/projects/17c60f32715c4602bd5520a5106ca909/users/e7add634691344a89e0fa76b6ccc44fb/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:02:37.566355 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfa555-74ee-4e57-8d47-10fe17d967f2 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:02:37.566642 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfa555-74ee-4e57-8d47-10fe17d967f2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:02:37.566921 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfa555-74ee-4e57-8d47-10fe17d967f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:02:37.597022 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c5cfa555-74ee-4e57-8d47-10fe17d967f2 None None] MFA Rules not processed for user `e7add634691344a89e0fa76b6ccc44fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:02:37.598292 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c5cfa555-74ee-4e57-8d47-10fe17d967f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:02:37.680779 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 749/1502] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:02:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:02:37.695368 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d8319-504f-44f9-b29e-df0207bbbf49 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:02:37.695663 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d8319-504f-44f9-b29e-df0207bbbf49 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:02:37.695945 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d8319-504f-44f9-b29e-df0207bbbf49 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:02:37.697461 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 754/1503] 10.222.0.35 () {54 vars in 963 bytes} [Thu May 19 22:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:02:37.702923 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a80568-66be-4056-933c-91e95b024ebb None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:02:37.703242 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a80568-66be-4056-933c-91e95b024ebb None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:02:37.703526 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a80568-66be-4056-933c-91e95b024ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:02:37.726243 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-58a80568-66be-4056-933c-91e95b024ebb None None] MFA Rules not processed for user `85924e1dfe664f78af34565db18b0b55`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:02:37.727455 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-58a80568-66be-4056-933c-91e95b024ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:02:37.773814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:02:37.782365 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 750/1504] 10.222.0.35 () {58 vars in 1060 bytes} [Thu May 19 22:02:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:02:37.790190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d8319-504f-44f9-b29e-df0207bbbf49 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:02:37.802057 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d8319-504f-44f9-b29e-df0207bbbf49 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:02:37.805604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5023f5-b045-48b5-a80a-cbf39afea7e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:02:37.806253 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5023f5-b045-48b5-a80a-cbf39afea7e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:02:37.806533 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5023f5-b045-48b5-a80a-cbf39afea7e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:02:37.806803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5023f5-b045-48b5-a80a-cbf39afea7e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:02:37.816608 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5023f5-b045-48b5-a80a-cbf39afea7e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:02:37.818081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5023f5-b045-48b5-a80a-cbf39afea7e7 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:02:37.827050 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 755/1505] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:02:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:02:37.870225 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff7d17-5bac-4a28-b74b-f1f051825ddb None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:02:37.870512 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff7d17-5bac-4a28-b74b-f1f051825ddb None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:02:37.870783 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff7d17-5bac-4a28-b74b-f1f051825ddb None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:02:37.872054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 751/1506] 10.222.0.35 () {52 vars in 829 bytes} [Thu May 19 22:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:02:37.876520 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5023f5-b045-48b5-a80a-cbf39afea7e7 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:02:37.940261 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5023f5-b045-48b5-a80a-cbf39afea7e7 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:02:37.944962 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5a2a1-e49d-4c42-aa2f-933409d47b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:02:37.945840 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5a2a1-e49d-4c42-aa2f-933409d47b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:02:37.946126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5a2a1-e49d-4c42-aa2f-933409d47b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:02:37.946406 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5a2a1-e49d-4c42-aa2f-933409d47b33 admin admin] PATH_INFO: `/v3/users/e7add634691344a89e0fa76b6ccc44fb` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:02:37.947613 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5a2a1-e49d-4c42-aa2f-933409d47b33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7add634691344a89e0fa76b6ccc44fb)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:02:37.948688 dv-cinder-842237-1-smb devstack@keystone.service[80209]: WARNING py.warnings [None req-8ad5a2a1-e49d-4c42-aa2f-933409d47b33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 22:02:37.948688 dv-cinder-842237-1-smb devstack@keystone.service[80209]: warnings.warn(msg) May 19 22:02:37.948688 dv-cinder-842237-1-smb devstack@keystone.service[80209]: May 19 22:02:37.949911 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5a2a1-e49d-4c42-aa2f-933409d47b33 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:02:38.019712 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8ad5a2a1-e49d-4c42-aa2f-933409d47b33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7add634691344a89e0fa76b6ccc44fb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:02:38.036239 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8ad5a2a1-e49d-4c42-aa2f-933409d47b33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7add634691344a89e0fa76b6ccc44fb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:02:38.037270 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8ad5a2a1-e49d-4c42-aa2f-933409d47b33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7add634691344a89e0fa76b6ccc44fb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:02:38.064277 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8ad5a2a1-e49d-4c42-aa2f-933409d47b33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7add634691344a89e0fa76b6ccc44fb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:02:38.068644 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:02:38.074828 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8ad5a2a1-e49d-4c42-aa2f-933409d47b33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7add634691344a89e0fa76b6ccc44fb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:02:38.082289 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 756/1507] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:02:37 2022] DELETE /identity/v3/users/e7add634691344a89e0fa76b6ccc44fb => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:02:38.086854 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1356f1-295a-4180-b0dc-21c749447023 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:02:38.087163 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1356f1-295a-4180-b0dc-21c749447023 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:02:38.087441 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1356f1-295a-4180-b0dc-21c749447023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:02:38.105041 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-cc1356f1-295a-4180-b0dc-21c749447023 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:02:38.106397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cc1356f1-295a-4180-b0dc-21c749447023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:02:38.168793 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 752/1508] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:02:38.179031 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5a2a1-e49d-4c42-aa2f-933409d47b33 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:02:38.180511 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8ad5a2a1-e49d-4c42-aa2f-933409d47b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:02:38.239363 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5a2a1-e49d-4c42-aa2f-933409d47b33 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:02:38.242943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b24173-bd5b-4e17-9459-68b6086688a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:02:38.243596 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b24173-bd5b-4e17-9459-68b6086688a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:02:38.243883 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b24173-bd5b-4e17-9459-68b6086688a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:02:38.244162 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b24173-bd5b-4e17-9459-68b6086688a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:02:38.253569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b24173-bd5b-4e17-9459-68b6086688a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:02:38.255019 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b24173-bd5b-4e17-9459-68b6086688a7 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:02:38.268281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 757/1509] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:02:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:02:38.616467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1356f1-295a-4180-b0dc-21c749447023 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:02:38.617971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cc1356f1-295a-4180-b0dc-21c749447023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:02:38.630468 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1356f1-295a-4180-b0dc-21c749447023 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:02:38.636270 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f786144-3b47-4ce3-a803-dfa8694fd06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:02:38.637366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f786144-3b47-4ce3-a803-dfa8694fd06c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:02:38.637648 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f786144-3b47-4ce3-a803-dfa8694fd06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:02:38.637921 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f786144-3b47-4ce3-a803-dfa8694fd06c admin admin] PATH_INFO: `/v3/projects/17c60f32715c4602bd5520a5106ca909` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:02:38.639523 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f786144-3b47-4ce3-a803-dfa8694fd06c admin admin] RBAC: Authorizing `identity:delete_project(project_id=17c60f32715c4602bd5520a5106ca909)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:02:38.641469 dv-cinder-842237-1-smb devstack@keystone.service[80210]: WARNING py.warnings [None req-7f786144-3b47-4ce3-a803-dfa8694fd06c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 22:02:38.641469 dv-cinder-842237-1-smb devstack@keystone.service[80210]: warnings.warn(msg) May 19 22:02:38.641469 dv-cinder-842237-1-smb devstack@keystone.service[80210]: May 19 22:02:38.642892 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f786144-3b47-4ce3-a803-dfa8694fd06c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:02:38.708729 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7f786144-3b47-4ce3-a803-dfa8694fd06c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17c60f32715c4602bd5520a5106ca909', 'request_id': 'req-7f786144-3b47-4ce3-a803-dfa8694fd06c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:02:38.723261 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7f786144-3b47-4ce3-a803-dfa8694fd06c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17c60f32715c4602bd5520a5106ca909', 'request_id': 'req-7f786144-3b47-4ce3-a803-dfa8694fd06c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:02:38.734167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7f786144-3b47-4ce3-a803-dfa8694fd06c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17c60f32715c4602bd5520a5106ca909', 'request_id': 'req-7f786144-3b47-4ce3-a803-dfa8694fd06c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:02:38.749023 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7f786144-3b47-4ce3-a803-dfa8694fd06c admin admin] The token cache is being invalidate because project 17c60f32715c4602bd5520a5106ca909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:02:38.749314 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7f786144-3b47-4ce3-a803-dfa8694fd06c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:02:38.750163 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7f786144-3b47-4ce3-a803-dfa8694fd06c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:02:38.751743 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 753/1510] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:02:38 2022] DELETE /identity/v3/projects/17c60f32715c4602bd5520a5106ca909 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:02:48.260461 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:02:48.745530 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:04:25.192260 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4c1e0-907b-489a-9fda-a36401794f78 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:04:25.192892 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4c1e0-907b-489a-9fda-a36401794f78 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:04:25.192892 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4c1e0-907b-489a-9fda-a36401794f78 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:04:25.194258 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 22:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:04:25.199528 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871253d-50a9-4ab8-8ee9-b2695b387019 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:04:25.200101 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871253d-50a9-4ab8-8ee9-b2695b387019 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:04:25.200101 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871253d-50a9-4ab8-8ee9-b2695b387019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:04:25.218856 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6871253d-50a9-4ab8-8ee9-b2695b387019 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:04:25.220084 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6871253d-50a9-4ab8-8ee9-b2695b387019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:04:25.281706 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 22:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:04:25.454816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4c1e0-907b-489a-9fda-a36401794f78 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:04:25.456552 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-92a4c1e0-907b-489a-9fda-a36401794f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:04:25.549144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4c1e0-907b-489a-9fda-a36401794f78 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:04:25.554583 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f717060-d923-44f5-8208-14a8907629cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:04:25.555235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f717060-d923-44f5-8208-14a8907629cb service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:04:25.555516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f717060-d923-44f5-8208-14a8907629cb service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:04:25.555788 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f717060-d923-44f5-8208-14a8907629cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:04:25.565177 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f717060-d923-44f5-8208-14a8907629cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:04:25.566817 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f717060-d923-44f5-8208-14a8907629cb service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:04:25.577288 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 759/1513] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:04:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:04:26.273016 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a37e4f-4afc-4b87-8e27-273c6e8b0a7d None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:04:26.273596 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a37e4f-4afc-4b87-8e27-273c6e8b0a7d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:04:26.273702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a37e4f-4afc-4b87-8e27-273c6e8b0a7d None None] PATH_INFO: `/v3` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:04:26.274974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 755/1514] 10.222.0.77 () {54 vars in 925 bytes} [Thu May 19 22:04:26 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:04:26.282542 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ede7f3-7fc5-4270-b632-1946038346c4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:04:26.283000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ede7f3-7fc5-4270-b632-1946038346c4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:04:26.283246 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ede7f3-7fc5-4270-b632-1946038346c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:04:26.302911 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-f2ede7f3-7fc5-4270-b632-1946038346c4 None None] MFA Rules not processed for user `b1004beeeaed4af4a92c89ad31008b32`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:04:26.304229 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f2ede7f3-7fc5-4270-b632-1946038346c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:04:26.377097 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 760/1515] 10.222.0.77 () {58 vars in 1015 bytes} [Thu May 19 22:04:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:04:26.516067 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dabab7-6206-42d3-abf9-f9dee6463944 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:04:26.516392 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dabab7-6206-42d3-abf9-f9dee6463944 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:04:26.516704 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dabab7-6206-42d3-abf9-f9dee6463944 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:04:26.518126 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 756/1516] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 22:04:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:04:26.522999 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efef1e-e750-4ec8-a110-483886e1266a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:04:26.523315 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efef1e-e750-4ec8-a110-483886e1266a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:04:26.523544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efef1e-e750-4ec8-a110-483886e1266a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:04:26.544094 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-15efef1e-e750-4ec8-a110-483886e1266a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:04:26.545332 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-15efef1e-e750-4ec8-a110-483886e1266a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:04:26.553487 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 761/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 22:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:04:26.721511 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dabab7-6206-42d3-abf9-f9dee6463944 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:04:26.735829 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dabab7-6206-42d3-abf9-f9dee6463944 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:04:26.741540 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740670b-ee2a-401e-81d4-179bc342299c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:04:26.742181 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740670b-ee2a-401e-81d4-179bc342299c service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:04:26.742463 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740670b-ee2a-401e-81d4-179bc342299c service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:04:26.742739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740670b-ee2a-401e-81d4-179bc342299c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:04:26.751692 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740670b-ee2a-401e-81d4-179bc342299c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:04:26.753316 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740670b-ee2a-401e-81d4-179bc342299c service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:04:26.763041 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 757/1518] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:04:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:04:35.515540 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fc975-48e4-456f-81c8-082b4e7048e4 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:04:35.516059 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fc975-48e4-456f-81c8-082b4e7048e4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:04:35.516171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fc975-48e4-456f-81c8-082b4e7048e4 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:04:35.517495 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 762/1519] 10.222.0.35 () {54 vars in 960 bytes} [Thu May 19 22:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:04:35.522708 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddab0e-d78c-4c49-b9e1-46848135ac53 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:04:35.523241 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddab0e-d78c-4c49-b9e1-46848135ac53 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:04:35.523241 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddab0e-d78c-4c49-b9e1-46848135ac53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:04:35.543328 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8fddab0e-d78c-4c49-b9e1-46848135ac53 None None] MFA Rules not processed for user `b1004beeeaed4af4a92c89ad31008b32`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:04:35.544579 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8fddab0e-d78c-4c49-b9e1-46848135ac53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:04:35.553801 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 758/1520] 10.222.0.35 () {58 vars in 1057 bytes} [Thu May 19 22:04:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:04:35.561642 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fc975-48e4-456f-81c8-082b4e7048e4 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:04:35.576041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fc975-48e4-456f-81c8-082b4e7048e4 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:04:35.581148 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4adeb7a-e0f0-419b-900c-971fdbd89c98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1004beeeaed4af4a92c89ad31008b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:04:35.581805 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adeb7a-e0f0-419b-900c-971fdbd89c98 service placement] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:04:35.582261 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adeb7a-e0f0-419b-900c-971fdbd89c98 service placement] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:04:35.582409 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adeb7a-e0f0-419b-900c-971fdbd89c98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:04:35.591244 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4adeb7a-e0f0-419b-900c-971fdbd89c98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:04:35.592867 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4adeb7a-e0f0-419b-900c-971fdbd89c98 service placement] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:04:35.602903 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 763/1521] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:04:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:04:38.117542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb831eb-f217-452c-942b-d8f7b7bf6c76 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:04:38.118129 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb831eb-f217-452c-942b-d8f7b7bf6c76 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:04:38.118129 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb831eb-f217-452c-942b-d8f7b7bf6c76 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:04:38.119555 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 22:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:04:38.124721 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6026f-5a43-4261-a7f4-1ed4b20c1057 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:04:38.125737 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6026f-5a43-4261-a7f4-1ed4b20c1057 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:04:38.125835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6026f-5a43-4261-a7f4-1ed4b20c1057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:04:38.144693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-24a6026f-5a43-4261-a7f4-1ed4b20c1057 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:04:38.145931 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-24a6026f-5a43-4261-a7f4-1ed4b20c1057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:04:38.155378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 22:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:04:38.324988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb831eb-f217-452c-942b-d8f7b7bf6c76 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:04:38.340131 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb831eb-f217-452c-942b-d8f7b7bf6c76 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:04:38.345524 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d5555-eea5-4fb1-a72c-87ad927c9bc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:04:38.346167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d5555-eea5-4fb1-a72c-87ad927c9bc6 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:04:38.346453 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d5555-eea5-4fb1-a72c-87ad927c9bc6 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:04:38.346731 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d5555-eea5-4fb1-a72c-87ad927c9bc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:04:38.355665 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d5555-eea5-4fb1-a72c-87ad927c9bc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:04:38.357348 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d5555-eea5-4fb1-a72c-87ad927c9bc6 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:04:38.368979 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 760/1524] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:04:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:04:39.317268 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ece3f8-495a-4f90-84a4-847abd0a565c None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:04:39.317843 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ece3f8-495a-4f90-84a4-847abd0a565c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:04:39.317843 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ece3f8-495a-4f90-84a4-847abd0a565c None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:04:39.319214 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 22:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:04:39.324194 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11833e98-bc20-475d-a36f-655f857f7c03 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:04:39.324664 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11833e98-bc20-475d-a36f-655f857f7c03 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:04:39.324792 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11833e98-bc20-475d-a36f-655f857f7c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:04:39.344717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-11833e98-bc20-475d-a36f-655f857f7c03 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:04:39.346326 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-11833e98-bc20-475d-a36f-655f857f7c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:04:39.355018 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 22:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:04:39.510056 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ece3f8-495a-4f90-84a4-847abd0a565c None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:04:39.525366 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ece3f8-495a-4f90-84a4-847abd0a565c None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:04:39.530689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a14e8-4ec8-46f4-921c-0782e8cc6c42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:04:39.531366 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a14e8-4ec8-46f4-921c-0782e8cc6c42 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:04:39.531651 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a14e8-4ec8-46f4-921c-0782e8cc6c42 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:04:39.532118 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a14e8-4ec8-46f4-921c-0782e8cc6c42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:04:39.540864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a14e8-4ec8-46f4-921c-0782e8cc6c42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:04:39.542763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a14e8-4ec8-46f4-921c-0782e8cc6c42 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:04:39.553231 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 766/1527] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:04:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:04:43.826519 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4de42e-0cda-4a1b-868a-ac68ee302341 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:04:43.827094 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4de42e-0cda-4a1b-868a-ac68ee302341 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:04:43.827094 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4de42e-0cda-4a1b-868a-ac68ee302341 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:04:43.828469 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 22:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:04:43.834348 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85291fbd-3802-475f-a531-7e412ca4731b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:04:43.834933 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85291fbd-3802-475f-a531-7e412ca4731b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:04:43.834933 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85291fbd-3802-475f-a531-7e412ca4731b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:04:43.853658 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-85291fbd-3802-475f-a531-7e412ca4731b None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:04:43.854894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-85291fbd-3802-475f-a531-7e412ca4731b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:04:43.862581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 22:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:04:43.898755 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4de42e-0cda-4a1b-868a-ac68ee302341 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:04:43.900535 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0c4de42e-0cda-4a1b-868a-ac68ee302341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:04:43.963682 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4de42e-0cda-4a1b-868a-ac68ee302341 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:04:43.967253 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a454f1-0e5c-4760-9523-c4e544daf054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:04:43.967897 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a454f1-0e5c-4760-9523-c4e544daf054 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:04:43.968184 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a454f1-0e5c-4760-9523-c4e544daf054 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:04:43.968491 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a454f1-0e5c-4760-9523-c4e544daf054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:04:43.978364 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a454f1-0e5c-4760-9523-c4e544daf054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:04:43.979837 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a454f1-0e5c-4760-9523-c4e544daf054 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:04:43.993147 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 763/1530] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:04:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:04:46.296250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395e32d-77da-49d6-be90-304b6a890778 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:04:46.296856 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395e32d-77da-49d6-be90-304b6a890778 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:04:46.296856 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395e32d-77da-49d6-be90-304b6a890778 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:04:46.298944 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 22:04:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:04:46.304457 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4879d-f6c3-4073-b7c8-379810026466 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:04:46.304921 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4879d-f6c3-4073-b7c8-379810026466 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:04:46.305026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4879d-f6c3-4073-b7c8-379810026466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:04:46.327894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-aeb4879d-f6c3-4073-b7c8-379810026466 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:04:46.329389 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-aeb4879d-f6c3-4073-b7c8-379810026466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:04:46.337279 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 22:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:04:46.374874 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395e32d-77da-49d6-be90-304b6a890778 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:04:46.386021 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395e32d-77da-49d6-be90-304b6a890778 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:04:46.389553 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a0e0a-15c9-4771-a2d6-eabf73c03a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:04:46.390185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a0e0a-15c9-4771-a2d6-eabf73c03a7d service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:04:46.390465 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a0e0a-15c9-4771-a2d6-eabf73c03a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:04:46.390736 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a0e0a-15c9-4771-a2d6-eabf73c03a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:04:46.400033 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a0e0a-15c9-4771-a2d6-eabf73c03a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:04:46.401787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a0e0a-15c9-4771-a2d6-eabf73c03a7d service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:04:46.412747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 769/1533] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:04:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:04:50.207839 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c54bb-4670-4957-9c28-0eb33fadc884 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:04:50.208467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c54bb-4670-4957-9c28-0eb33fadc884 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:04:50.208467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c54bb-4670-4957-9c28-0eb33fadc884 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:04:50.209770 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 22:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:04:50.214903 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52058bf8-bf1a-40a3-bc89-21da3ba8217a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:04:50.215302 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52058bf8-bf1a-40a3-bc89-21da3ba8217a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:04:50.215465 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52058bf8-bf1a-40a3-bc89-21da3ba8217a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:04:50.222634 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=91 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:04:50.237520 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-52058bf8-bf1a-40a3-bc89-21da3ba8217a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:04:50.238720 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-52058bf8-bf1a-40a3-bc89-21da3ba8217a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:04:50.246366 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 22:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:04:50.526192 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c54bb-4670-4957-9c28-0eb33fadc884 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:04:50.527900 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f84c54bb-4670-4957-9c28-0eb33fadc884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:04:50.534013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=75 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:04:50.587871 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c54bb-4670-4957-9c28-0eb33fadc884 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:04:50.591605 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af90e3-b067-40c2-984e-9cf8b16bff7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:04:50.592266 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af90e3-b067-40c2-984e-9cf8b16bff7a service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:04:50.592586 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af90e3-b067-40c2-984e-9cf8b16bff7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:04:50.592870 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af90e3-b067-40c2-984e-9cf8b16bff7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:04:50.602906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af90e3-b067-40c2-984e-9cf8b16bff7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:04:50.604283 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af90e3-b067-40c2-984e-9cf8b16bff7a service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:04:50.614365 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 766/1536] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:04:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:04:52.992731 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3dac64-ed2b-4514-8d4b-3ae75cba2fed None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:04:52.993316 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3dac64-ed2b-4514-8d4b-3ae75cba2fed None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:04:52.993316 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3dac64-ed2b-4514-8d4b-3ae75cba2fed None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:04:52.994665 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 22:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:04:53.000189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa38d65-b1d9-4b6a-a4f6-b45ce27a29dc None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:04:53.000688 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa38d65-b1d9-4b6a-a4f6-b45ce27a29dc None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:04:53.000848 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa38d65-b1d9-4b6a-a4f6-b45ce27a29dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:04:53.018963 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-dfa38d65-b1d9-4b6a-a4f6-b45ce27a29dc None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:04:53.020170 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-dfa38d65-b1d9-4b6a-a4f6-b45ce27a29dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:04:53.028184 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 22:04:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:04:53.322055 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3dac64-ed2b-4514-8d4b-3ae75cba2fed None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:04:53.323750 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7b3dac64-ed2b-4514-8d4b-3ae75cba2fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:04:53.337692 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3dac64-ed2b-4514-8d4b-3ae75cba2fed None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:04:53.342652 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949e14d-98fb-4925-bcd5-47740b2a667b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:04:53.343820 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949e14d-98fb-4925-bcd5-47740b2a667b service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:04:53.344322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949e14d-98fb-4925-bcd5-47740b2a667b service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:04:53.345332 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949e14d-98fb-4925-bcd5-47740b2a667b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:04:53.355466 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949e14d-98fb-4925-bcd5-47740b2a667b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:04:53.356972 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949e14d-98fb-4925-bcd5-47740b2a667b service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:04:53.367432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 772/1539] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:04:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:05:03.013591 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=28 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:05:03.362675 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=8 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:33.238597 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a42a37-54a4-4b69-9291-c601a6667286 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:33.239718 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a42a37-54a4-4b69-9291-c601a6667286 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:33.240169 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a42a37-54a4-4b69-9291-c601a6667286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:33.273056 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-77a42a37-54a4-4b69-9291-c601a6667286 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:33.275035 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-77a42a37-54a4-4b69-9291-c601a6667286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:33.276186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3eed6-7bdf-4f61-834d-14406bf764c7 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:33.277141 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3eed6-7bdf-4f61-834d-14406bf764c7 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:33.277812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3eed6-7bdf-4f61-834d-14406bf764c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:33.296809 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 768/1540] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:33.311100 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc433c-2d75-40e4-b3c5-0d0f1e885461 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:33.311374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc433c-2d75-40e4-b3c5-0d0f1e885461 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:33.311662 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc433c-2d75-40e4-b3c5-0d0f1e885461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:33.316856 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-fdf3eed6-7bdf-4f61-834d-14406bf764c7 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:33.318481 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-fdf3eed6-7bdf-4f61-834d-14406bf764c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:33.333490 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 773/1541] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:33.343879 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a309251-164b-48e1-9d74-689f2a85efac None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:33.344608 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a309251-164b-48e1-9d74-689f2a85efac None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:33.345553 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a309251-164b-48e1-9d74-689f2a85efac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:33.350042 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0cdc433c-2d75-40e4-b3c5-0d0f1e885461 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:33.351284 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0cdc433c-2d75-40e4-b3c5-0d0f1e885461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:33.370681 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 769/1542] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:33.376327 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8756b6-52cb-4d5a-a01c-ac1ff88f69eb None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:33.376327 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8756b6-52cb-4d5a-a01c-ac1ff88f69eb None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:33.376327 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8756b6-52cb-4d5a-a01c-ac1ff88f69eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:33.377276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6a309251-164b-48e1-9d74-689f2a85efac None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:33.377276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6a309251-164b-48e1-9d74-689f2a85efac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:33.396088 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 774/1543] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:06:33.397436 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739ad0e-d4c7-4666-8bbd-a39607b7dbce None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:33.397727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739ad0e-d4c7-4666-8bbd-a39607b7dbce None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:33.398001 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739ad0e-d4c7-4666-8bbd-a39607b7dbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:33.417008 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3e8756b6-52cb-4d5a-a01c-ac1ff88f69eb None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:33.418277 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3e8756b6-52cb-4d5a-a01c-ac1ff88f69eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:33.436421 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c739ad0e-d4c7-4666-8bbd-a39607b7dbce None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:33.437620 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c739ad0e-d4c7-4666-8bbd-a39607b7dbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:33.451891 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 770/1544] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:33.452901 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8756b6-52cb-4d5a-a01c-ac1ff88f69eb None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:33.472911 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 775/1545] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:33.473796 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739ad0e-d4c7-4666-8bbd-a39607b7dbce None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:33.476677 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8756b6-52cb-4d5a-a01c-ac1ff88f69eb None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:33.497369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d1513-0ac9-459c-ac09-4ccf3e052eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:33.497959 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d1513-0ac9-459c-ac09-4ccf3e052eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:33.498249 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d1513-0ac9-459c-ac09-4ccf3e052eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:33.498522 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d1513-0ac9-459c-ac09-4ccf3e052eb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:33.499274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d1513-0ac9-459c-ac09-4ccf3e052eb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:06:33.499577 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d1513-0ac9-459c-ac09-4ccf3e052eb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:33.502034 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d1513-0ac9-459c-ac09-4ccf3e052eb2 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:33.506558 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739ad0e-d4c7-4666-8bbd-a39607b7dbce None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:33.521890 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 771/1546] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:06:33.522638 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c824ed5-fe19-4a08-850b-203a1f8ed6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:33.523333 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c824ed5-fe19-4a08-850b-203a1f8ed6bd admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:33.523595 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59737b57-893b-4c98-8493-5d853c8d115d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:33.523718 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c824ed5-fe19-4a08-850b-203a1f8ed6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:33.523902 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c824ed5-fe19-4a08-850b-203a1f8ed6bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:33.524010 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59737b57-893b-4c98-8493-5d853c8d115d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:33.524170 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59737b57-893b-4c98-8493-5d853c8d115d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:33.524655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c824ed5-fe19-4a08-850b-203a1f8ed6bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:06:33.524966 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c824ed5-fe19-4a08-850b-203a1f8ed6bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:33.526443 dv-cinder-842237-1-smb devstack@keystone.service[80209]: WARNING py.warnings [None req-8c824ed5-fe19-4a08-850b-203a1f8ed6bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 22:06:33.526443 dv-cinder-842237-1-smb devstack@keystone.service[80209]: warnings.warn(msg) May 19 22:06:33.526443 dv-cinder-842237-1-smb devstack@keystone.service[80209]: May 19 22:06:33.527899 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c824ed5-fe19-4a08-850b-203a1f8ed6bd admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:33.545943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 776/1547] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:06:33.547110 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17433274-7bcf-4336-b975-17867f19a196 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:33.547404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17433274-7bcf-4336-b975-17867f19a196 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:33.547769 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17433274-7bcf-4336-b975-17867f19a196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:33.551749 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-59737b57-893b-4c98-8493-5d853c8d115d None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:33.553102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-59737b57-893b-4c98-8493-5d853c8d115d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:33.570523 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 772/1548] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:33.571868 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc53ccb-e7ab-44a1-addd-95c933f63e2a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:33.572162 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc53ccb-e7ab-44a1-addd-95c933f63e2a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:33.573149 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc53ccb-e7ab-44a1-addd-95c933f63e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:33.578900 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-17433274-7bcf-4336-b975-17867f19a196 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:33.580804 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-17433274-7bcf-4336-b975-17867f19a196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:33.591291 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 777/1549] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:33.592143 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17433274-7bcf-4336-b975-17867f19a196 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:33.596171 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7fc53ccb-e7ab-44a1-addd-95c933f63e2a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:33.597644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7fc53ccb-e7ab-44a1-addd-95c933f63e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:33.612450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17433274-7bcf-4336-b975-17867f19a196 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:33.617279 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ad814-f367-4e5a-9eb5-dc052ec6984a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:33.617948 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ad814-f367-4e5a-9eb5-dc052ec6984a admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:33.618223 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ad814-f367-4e5a-9eb5-dc052ec6984a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:33.618494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ad814-f367-4e5a-9eb5-dc052ec6984a admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:33.619230 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ad814-f367-4e5a-9eb5-dc052ec6984a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:33.620573 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 773/1550] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:33.621806 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ad814-f367-4e5a-9eb5-dc052ec6984a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:33.622480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fd177-58dc-467c-9c8c-2a89da0b681f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:33.623118 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fd177-58dc-467c-9c8c-2a89da0b681f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:33.623826 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fd177-58dc-467c-9c8c-2a89da0b681f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:33.649912 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-bb3fd177-58dc-467c-9c8c-2a89da0b681f None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:33.651639 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-bb3fd177-58dc-467c-9c8c-2a89da0b681f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:33.656997 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 778/1551] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:06:33 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:33.658578 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ad814-f367-4e5a-9eb5-dc052ec6984a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:33.732676 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 774/1552] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:33.734318 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc07a0-a36c-4490-be11-6de66b0b34f6 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:33.734620 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc07a0-a36c-4490-be11-6de66b0b34f6 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:33.734896 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc07a0-a36c-4490-be11-6de66b0b34f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:33.737826 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ad814-f367-4e5a-9eb5-dc052ec6984a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:33.742798 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360aefa-9b71-4b69-b013-4c566defc41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:33.743467 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360aefa-9b71-4b69-b013-4c566defc41f admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:33.743753 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360aefa-9b71-4b69-b013-4c566defc41f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:33.744025 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360aefa-9b71-4b69-b013-4c566defc41f admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:33.744759 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360aefa-9b71-4b69-b013-4c566defc41f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:33.747130 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360aefa-9b71-4b69-b013-4c566defc41f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:33.754636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-bafc07a0-a36c-4490-be11-6de66b0b34f6 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:33.755774 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-bafc07a0-a36c-4490-be11-6de66b0b34f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:33.764430 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 775/1553] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:33.769405 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc07a0-a36c-4490-be11-6de66b0b34f6 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:33.779161 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 779/1554] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:06:33 2022] POST /identity/v3/projects => generated 405 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:33.779897 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360aefa-9b71-4b69-b013-4c566defc41f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:33.784763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc07a0-a36c-4490-be11-6de66b0b34f6 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:33.844877 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360aefa-9b71-4b69-b013-4c566defc41f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:33.846226 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039b0da-4c9d-49c7-b6da-b5e4f7d7fd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:33.846893 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039b0da-4c9d-49c7-b6da-b5e4f7d7fd37 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:33.847179 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039b0da-4c9d-49c7-b6da-b5e4f7d7fd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:33.847459 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039b0da-4c9d-49c7-b6da-b5e4f7d7fd37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:33.848194 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039b0da-4c9d-49c7-b6da-b5e4f7d7fd37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:06:33.848538 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039b0da-4c9d-49c7-b6da-b5e4f7d7fd37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:33.849638 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386804be-dd78-4b73-901f-6c4c5e299afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:33.850299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386804be-dd78-4b73-901f-6c4c5e299afa admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:33.850409 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039b0da-4c9d-49c7-b6da-b5e4f7d7fd37 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:33.850583 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386804be-dd78-4b73-901f-6c4c5e299afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:33.850858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386804be-dd78-4b73-901f-6c4c5e299afa admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:33.851581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386804be-dd78-4b73-901f-6c4c5e299afa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:06:33.851886 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386804be-dd78-4b73-901f-6c4c5e299afa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:33.853543 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386804be-dd78-4b73-901f-6c4c5e299afa admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:33.863627 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 776/1555] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:06:33.864835 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1415a-2a68-4cff-9e19-68112a2b58f8 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:33.865125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1415a-2a68-4cff-9e19-68112a2b58f8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:33.865414 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1415a-2a68-4cff-9e19-68112a2b58f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:33.873409 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 780/1556] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:06:33.874239 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386804be-dd78-4b73-901f-6c4c5e299afa admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:33.885663 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386804be-dd78-4b73-901f-6c4c5e299afa admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:33.890262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50243d-b5dc-48f6-9952-9fd90bc8b753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:33.890973 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50243d-b5dc-48f6-9952-9fd90bc8b753 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:33.891093 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3ee1415a-2a68-4cff-9e19-68112a2b58f8 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:33.891376 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50243d-b5dc-48f6-9952-9fd90bc8b753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:33.891666 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50243d-b5dc-48f6-9952-9fd90bc8b753 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:33.892253 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3ee1415a-2a68-4cff-9e19-68112a2b58f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:33.892712 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50243d-b5dc-48f6-9952-9fd90bc8b753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:33.893782 dv-cinder-842237-1-smb devstack@keystone.service[80209]: WARNING py.warnings [None req-7c50243d-b5dc-48f6-9952-9fd90bc8b753 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 22:06:33.893782 dv-cinder-842237-1-smb devstack@keystone.service[80209]: warnings.warn(msg) May 19 22:06:33.893782 dv-cinder-842237-1-smb devstack@keystone.service[80209]: May 19 22:06:33.895001 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50243d-b5dc-48f6-9952-9fd90bc8b753 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:33.900449 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 777/1557] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:33.901569 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e13d9b-4191-48a9-beeb-ebe18dc46a9f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:33.902012 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e13d9b-4191-48a9-beeb-ebe18dc46a9f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:33.902128 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e13d9b-4191-48a9-beeb-ebe18dc46a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:33.914558 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:33.921149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 781/1558] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:06:33 2022] POST /identity/v3/users => generated 288 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:33.924101 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5d14d-005e-4b40-a90d-32633b06334e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:33.924938 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-e6e13d9b-4191-48a9-beeb-ebe18dc46a9f None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:33.925075 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5d14d-005e-4b40-a90d-32633b06334e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:33.925326 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5d14d-005e-4b40-a90d-32633b06334e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:33.926164 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e6e13d9b-4191-48a9-beeb-ebe18dc46a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:33.934450 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 778/1559] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:33.935596 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baba46-afab-46b2-9912-725d6fa7bd3a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:33.935878 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baba46-afab-46b2-9912-725d6fa7bd3a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:33.936156 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baba46-afab-46b2-9912-725d6fa7bd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:33.949181 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-0eb5d14d-005e-4b40-a90d-32633b06334e None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:33.950395 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0eb5d14d-005e-4b40-a90d-32633b06334e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:33.955318 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-61baba46-afab-46b2-9912-725d6fa7bd3a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:33.956556 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-61baba46-afab-46b2-9912-725d6fa7bd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:33.958889 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 782/1560] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:33.959841 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb5d14d-005e-4b40-a90d-32633b06334e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:33.965183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 779/1561] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:33.969519 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61baba46-afab-46b2-9912-725d6fa7bd3a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:33.970421 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb5d14d-005e-4b40-a90d-32633b06334e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:33.975363 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fda95-b476-4525-8f55-fb32c507ee4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:33.976047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fda95-b476-4525-8f55-fb32c507ee4d admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:33.976332 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fda95-b476-4525-8f55-fb32c507ee4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:33.976639 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fda95-b476-4525-8f55-fb32c507ee4d admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:33.977228 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61baba46-afab-46b2-9912-725d6fa7bd3a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:33.977336 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fda95-b476-4525-8f55-fb32c507ee4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:33.979261 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fda95-b476-4525-8f55-fb32c507ee4d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:33.983109 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a785c3-b7c9-4792-983f-21dd6d08ce79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:33.983776 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a785c3-b7c9-4792-983f-21dd6d08ce79 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:33.984060 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a785c3-b7c9-4792-983f-21dd6d08ce79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:33.984341 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a785c3-b7c9-4792-983f-21dd6d08ce79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:33.985072 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a785c3-b7c9-4792-983f-21dd6d08ce79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:33.986745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: WARNING py.warnings [None req-10a785c3-b7c9-4792-983f-21dd6d08ce79 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 22:06:33.986745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: warnings.warn(msg) May 19 22:06:33.986745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: May 19 22:06:33.987826 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a785c3-b7c9-4792-983f-21dd6d08ce79 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:34.008064 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 783/1562] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:06:33 2022] POST /identity/v3/users => generated 303 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:34.008064 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fda95-b476-4525-8f55-fb32c507ee4d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:34.010867 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:34.015927 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fda95-b476-4525-8f55-fb32c507ee4d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:34.019422 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 780/1563] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:06:33 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:34.020291 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a785c3-b7c9-4792-983f-21dd6d08ce79 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:34.024480 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ffff8-b7b6-4008-9cd1-36691f202eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:34.025247 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ffff8-b7b6-4008-9cd1-36691f202eed admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:34.025535 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ffff8-b7b6-4008-9cd1-36691f202eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:34.025817 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ffff8-b7b6-4008-9cd1-36691f202eed admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:34.026522 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ffff8-b7b6-4008-9cd1-36691f202eed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:34.028488 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ffff8-b7b6-4008-9cd1-36691f202eed admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:34.059332 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 784/1564] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:06:34 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:34.060526 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ffff8-b7b6-4008-9cd1-36691f202eed admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:34.096991 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a785c3-b7c9-4792-983f-21dd6d08ce79 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:34.146477 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ffff8-b7b6-4008-9cd1-36691f202eed admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:34.151594 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870007f-773a-4f88-8138-b80a3ffc7a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:34.152348 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870007f-773a-4f88-8138-b80a3ffc7a86 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:34.152662 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870007f-773a-4f88-8138-b80a3ffc7a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:34.152939 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870007f-773a-4f88-8138-b80a3ffc7a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:34.153692 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870007f-773a-4f88-8138-b80a3ffc7a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:34.155315 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870007f-773a-4f88-8138-b80a3ffc7a86 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:34.166010 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 785/1565] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:06:34.167308 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486049e3-1abf-4c59-a397-73ae11210fed None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:34.167565 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486049e3-1abf-4c59-a397-73ae11210fed None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:34.167842 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486049e3-1abf-4c59-a397-73ae11210fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:34.168760 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126dbc7a-a021-48fb-98a6-b0ea9dd87f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:34.169411 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dbc7a-a021-48fb-98a6-b0ea9dd87f34 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:34.169625 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dbc7a-a021-48fb-98a6-b0ea9dd87f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:34.169908 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dbc7a-a021-48fb-98a6-b0ea9dd87f34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:34.170637 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126dbc7a-a021-48fb-98a6-b0ea9dd87f34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:06:34.170946 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126dbc7a-a021-48fb-98a6-b0ea9dd87f34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:34.181035 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126dbc7a-a021-48fb-98a6-b0ea9dd87f34 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:34.187758 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-486049e3-1abf-4c59-a397-73ae11210fed None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:34.189631 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-486049e3-1abf-4c59-a397-73ae11210fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:34.194602 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 781/1566] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:06:34.195435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126dbc7a-a021-48fb-98a6-b0ea9dd87f34 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:34.200336 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 786/1567] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:34.201496 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486049e3-1abf-4c59-a397-73ae11210fed None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:34.209366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126dbc7a-a021-48fb-98a6-b0ea9dd87f34 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:34.212260 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486049e3-1abf-4c59-a397-73ae11210fed None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:34.214030 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bda81-1e38-4511-b8b0-02e01c48822e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:34.214687 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bda81-1e38-4511-b8b0-02e01c48822e admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:34.214972 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bda81-1e38-4511-b8b0-02e01c48822e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:34.215247 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bda81-1e38-4511-b8b0-02e01c48822e admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:34.215972 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124bda81-1e38-4511-b8b0-02e01c48822e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:06:34.216278 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124bda81-1e38-4511-b8b0-02e01c48822e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:34.216958 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344e040-4fc7-49e2-8988-8c7107863d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:34.217689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344e040-4fc7-49e2-8988-8c7107863d73 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:34.217908 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124bda81-1e38-4511-b8b0-02e01c48822e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:34.218015 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344e040-4fc7-49e2-8988-8c7107863d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:34.218239 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344e040-4fc7-49e2-8988-8c7107863d73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:34.218963 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344e040-4fc7-49e2-8988-8c7107863d73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:06:34.219273 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344e040-4fc7-49e2-8988-8c7107863d73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:34.221063 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344e040-4fc7-49e2-8988-8c7107863d73 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:34.231723 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 782/1568] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:06:34.232639 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bda81-1e38-4511-b8b0-02e01c48822e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:34.233726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 787/1569] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:06:34.234449 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344e040-4fc7-49e2-8988-8c7107863d73 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:34.243451 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bda81-1e38-4511-b8b0-02e01c48822e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:34.248478 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a2ad2-5c23-47e2-a52c-1b523d9b62d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:34.249148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a2ad2-5c23-47e2-a52c-1b523d9b62d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:34.249406 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344e040-4fc7-49e2-8988-8c7107863d73 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:34.249517 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a2ad2-5c23-47e2-a52c-1b523d9b62d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:34.249696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a2ad2-5c23-47e2-a52c-1b523d9b62d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:34.250429 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a2ad2-5c23-47e2-a52c-1b523d9b62d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:34.252826 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a2ad2-5c23-47e2-a52c-1b523d9b62d6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:34.255174 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f568b58-ec28-4f9a-9357-819a44d607e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:34.255841 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f568b58-ec28-4f9a-9357-819a44d607e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:34.256125 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f568b58-ec28-4f9a-9357-819a44d607e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:34.256421 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f568b58-ec28-4f9a-9357-819a44d607e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:34.257123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f568b58-ec28-4f9a-9357-819a44d607e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:34.259101 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f568b58-ec28-4f9a-9357-819a44d607e1 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:34.263337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 783/1570] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:06:34.264204 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a2ad2-5c23-47e2-a52c-1b523d9b62d6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:34.275837 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a2ad2-5c23-47e2-a52c-1b523d9b62d6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:34.280857 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66f8d9-67b4-4d9e-a6b7-f238f4951461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:34.281577 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66f8d9-67b4-4d9e-a6b7-f238f4951461 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:34.281849 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66f8d9-67b4-4d9e-a6b7-f238f4951461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:34.282128 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66f8d9-67b4-4d9e-a6b7-f238f4951461 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:34.282934 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66f8d9-67b4-4d9e-a6b7-f238f4951461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:34.284931 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66f8d9-67b4-4d9e-a6b7-f238f4951461 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:34.288959 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 788/1571] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:06:34 2022] POST /identity/v3/users => generated 295 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:34.289802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f568b58-ec28-4f9a-9357-819a44d607e1 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:34.301010 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f568b58-ec28-4f9a-9357-819a44d607e1 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:34.310983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 784/1572] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:06:34 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:34.310983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66f8d9-67b4-4d9e-a6b7-f238f4951461 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:34.312985 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a954a89-aa94-4e25-bac3-b532942c66c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:34.314240 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a954a89-aa94-4e25-bac3-b532942c66c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:34.314532 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a954a89-aa94-4e25-bac3-b532942c66c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:34.314940 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a954a89-aa94-4e25-bac3-b532942c66c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:34.315813 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a954a89-aa94-4e25-bac3-b532942c66c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:34.317500 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a954a89-aa94-4e25-bac3-b532942c66c2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:34.319550 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66f8d9-67b4-4d9e-a6b7-f238f4951461 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:34.324242 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49beb988-de96-4d98-89a2-37429cd5bda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:34.324938 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49beb988-de96-4d98-89a2-37429cd5bda2 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:34.325221 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49beb988-de96-4d98-89a2-37429cd5bda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:34.325498 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49beb988-de96-4d98-89a2-37429cd5bda2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:34.326184 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49beb988-de96-4d98-89a2-37429cd5bda2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:34.328218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49beb988-de96-4d98-89a2-37429cd5bda2 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:34.329142 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 789/1573] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:06:34.330123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a954a89-aa94-4e25-bac3-b532942c66c2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:34.341572 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a954a89-aa94-4e25-bac3-b532942c66c2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:34.347132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbb999-15b5-48d7-8b37-555a7d390f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:34.347806 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbb999-15b5-48d7-8b37-555a7d390f13 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:34.348092 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbb999-15b5-48d7-8b37-555a7d390f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:34.348373 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbb999-15b5-48d7-8b37-555a7d390f13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:34.349263 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbb999-15b5-48d7-8b37-555a7d390f13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:06:34.349492 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbb999-15b5-48d7-8b37-555a7d390f13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:34.351336 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbb999-15b5-48d7-8b37-555a7d390f13 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:34.362164 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 785/1574] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:06:34 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:34.363012 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49beb988-de96-4d98-89a2-37429cd5bda2 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:34.365148 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 790/1575] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:06:34.369420 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbb999-15b5-48d7-8b37-555a7d390f13 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:34.387264 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbb999-15b5-48d7-8b37-555a7d390f13 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:34.410550 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:34.435358 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:34.436317 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49beb988-de96-4d98-89a2-37429cd5bda2 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:34.445112 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540fd4b-2517-432b-9eec-ec17abc86309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:34.445848 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540fd4b-2517-432b-9eec-ec17abc86309 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:34.446167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540fd4b-2517-432b-9eec-ec17abc86309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:34.446540 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540fd4b-2517-432b-9eec-ec17abc86309 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:34.447252 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540fd4b-2517-432b-9eec-ec17abc86309 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:34.449245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540fd4b-2517-432b-9eec-ec17abc86309 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:34.451605 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcc092-df03-4cf8-a8d3-060dc0c58bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:34.452279 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcc092-df03-4cf8-a8d3-060dc0c58bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:34.452608 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcc092-df03-4cf8-a8d3-060dc0c58bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:34.452887 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcc092-df03-4cf8-a8d3-060dc0c58bf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:34.453586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bcc092-df03-4cf8-a8d3-060dc0c58bf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:34.456259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bcc092-df03-4cf8-a8d3-060dc0c58bf7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:34.482617 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 786/1576] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:06:34 2022] POST /identity/v3/projects => generated 391 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:34.482617 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540fd4b-2517-432b-9eec-ec17abc86309 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:34.484770 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 791/1577] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:06:34 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:34.485708 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcc092-df03-4cf8-a8d3-060dc0c58bf7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:34.559700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcc092-df03-4cf8-a8d3-060dc0c58bf7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:34.565410 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d1708-5ac6-4806-a66d-6082b3215182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:34.565572 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540fd4b-2517-432b-9eec-ec17abc86309 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:34.566096 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d1708-5ac6-4806-a66d-6082b3215182 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:34.566453 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d1708-5ac6-4806-a66d-6082b3215182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:34.566777 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d1708-5ac6-4806-a66d-6082b3215182 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:34.567384 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d1708-5ac6-4806-a66d-6082b3215182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:34.569042 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d1708-5ac6-4806-a66d-6082b3215182 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:34.570959 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d90068-5ce5-4a4c-a9e4-793e45f4473c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:34.571633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d90068-5ce5-4a4c-a9e4-793e45f4473c admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:34.571911 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d90068-5ce5-4a4c-a9e4-793e45f4473c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:34.572181 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d90068-5ce5-4a4c-a9e4-793e45f4473c admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:34.572942 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d90068-5ce5-4a4c-a9e4-793e45f4473c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:34.574543 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d90068-5ce5-4a4c-a9e4-793e45f4473c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:34.580011 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 792/1578] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:06:34.580887 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d1708-5ac6-4806-a66d-6082b3215182 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:34.587456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 787/1579] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:06:34.588599 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d90068-5ce5-4a4c-a9e4-793e45f4473c admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:34.595267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d1708-5ac6-4806-a66d-6082b3215182 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:34.599822 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d90068-5ce5-4a4c-a9e4-793e45f4473c admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:34.600345 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d57c1-b638-4104-a406-c2225589a214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:34.601080 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d57c1-b638-4104-a406-c2225589a214 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:34.601372 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d57c1-b638-4104-a406-c2225589a214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:34.601654 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d57c1-b638-4104-a406-c2225589a214 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:34.602391 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d57c1-b638-4104-a406-c2225589a214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:34.604015 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d57c1-b638-4104-a406-c2225589a214 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:34.604558 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fcb05-76d2-4e9b-af39-22dcbc059da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:34.605698 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fcb05-76d2-4e9b-af39-22dcbc059da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:34.605990 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fcb05-76d2-4e9b-af39-22dcbc059da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:34.606681 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fcb05-76d2-4e9b-af39-22dcbc059da4 admin admin] PATH_INFO: `/v3/projects/6d85f6335e524a77b97227875fb1f7bd/users/f2da574d2af04217967bfd90be946b29/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:34.615618 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 793/1580] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:06:34.616174 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d57c1-b638-4104-a406-c2225589a214 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:34.625579 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fcb05-76d2-4e9b-af39-22dcbc059da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d85f6335e524a77b97227875fb1f7bd, user_id=f2da574d2af04217967bfd90be946b29, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:34.627151 dv-cinder-842237-1-smb devstack@keystone.service[80210]: WARNING py.warnings [None req-d13fcb05-76d2-4e9b-af39-22dcbc059da4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 22:06:34.627151 dv-cinder-842237-1-smb devstack@keystone.service[80210]: warnings.warn(msg) May 19 22:06:34.627151 dv-cinder-842237-1-smb devstack@keystone.service[80210]: May 19 22:06:34.629141 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fcb05-76d2-4e9b-af39-22dcbc059da4 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:34.630019 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d57c1-b638-4104-a406-c2225589a214 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:34.634954 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898f614-79ef-4f50-8586-81d5852e0ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:34.635724 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898f614-79ef-4f50-8586-81d5852e0ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:34.636011 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898f614-79ef-4f50-8586-81d5852e0ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:34.636310 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898f614-79ef-4f50-8586-81d5852e0ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:34.637076 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898f614-79ef-4f50-8586-81d5852e0ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:34.639035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898f614-79ef-4f50-8586-81d5852e0ea4 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:34.645113 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 788/1581] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:06:34 2022] PUT /identity/v3/projects/6d85f6335e524a77b97227875fb1f7bd/users/f2da574d2af04217967bfd90be946b29/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:06:34.646290 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fcb05-76d2-4e9b-af39-22dcbc059da4 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:34.664429 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 794/1582] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:06:34 2022] POST /identity/v3/users => generated 283 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:34.668619 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898f614-79ef-4f50-8586-81d5852e0ea4 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:34.679410 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898f614-79ef-4f50-8586-81d5852e0ea4 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:34.714771 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fcb05-76d2-4e9b-af39-22dcbc059da4 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:34.719422 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694275e9-8614-4b68-968b-46767b6cc4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:34.720751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694275e9-8614-4b68-968b-46767b6cc4ca admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:34.721040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694275e9-8614-4b68-968b-46767b6cc4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:34.721320 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694275e9-8614-4b68-968b-46767b6cc4ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:34.722023 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694275e9-8614-4b68-968b-46767b6cc4ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:34.723948 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694275e9-8614-4b68-968b-46767b6cc4ca admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:34.741202 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49018d-7619-44bf-aec4-eaab0a379f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:34.741990 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49018d-7619-44bf-aec4-eaab0a379f15 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:34.742277 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49018d-7619-44bf-aec4-eaab0a379f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:34.742612 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49018d-7619-44bf-aec4-eaab0a379f15 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:34.743389 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49018d-7619-44bf-aec4-eaab0a379f15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:34.745793 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49018d-7619-44bf-aec4-eaab0a379f15 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:34.753847 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 789/1583] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:06:34 2022] POST /identity/v3/projects => generated 361 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:34.755114 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694275e9-8614-4b68-968b-46767b6cc4ca admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:34.769253 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 795/1584] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:06:34 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:34.770080 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49018d-7619-44bf-aec4-eaab0a379f15 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:34.779989 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49018d-7619-44bf-aec4-eaab0a379f15 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:34.781598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:34.811348 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:34.835933 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694275e9-8614-4b68-968b-46767b6cc4ca admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:34.839429 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a00ab2-625f-4184-ac9f-e146d3b9ed0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:34.840124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a00ab2-625f-4184-ac9f-e146d3b9ed0b admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:34.840372 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a00ab2-625f-4184-ac9f-e146d3b9ed0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:34.840676 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099679e2-bec3-44c9-9997-bbf25207e238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:34.840812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a00ab2-625f-4184-ac9f-e146d3b9ed0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:34.841348 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099679e2-bec3-44c9-9997-bbf25207e238 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:34.841446 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a00ab2-625f-4184-ac9f-e146d3b9ed0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:34.841631 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099679e2-bec3-44c9-9997-bbf25207e238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:34.841909 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099679e2-bec3-44c9-9997-bbf25207e238 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:34.842601 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099679e2-bec3-44c9-9997-bbf25207e238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:34.842989 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a00ab2-625f-4184-ac9f-e146d3b9ed0b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:34.844549 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099679e2-bec3-44c9-9997-bbf25207e238 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:34.853998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 796/1585] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:06:34.854828 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a00ab2-625f-4184-ac9f-e146d3b9ed0b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:34.866516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a00ab2-625f-4184-ac9f-e146d3b9ed0b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:34.871086 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9897ed-376a-4d57-a81e-4a7e2ee0a1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:34.871886 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 790/1586] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:06:34 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:34.872016 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9897ed-376a-4d57-a81e-4a7e2ee0a1f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:34.872233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9897ed-376a-4d57-a81e-4a7e2ee0a1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:34.872531 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9897ed-376a-4d57-a81e-4a7e2ee0a1f1 admin admin] PATH_INFO: `/v3/projects/00e6a8214f7c474eb66250c458500762/users/534c79c90c1044f3b24a05e0ae2a20c7/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:34.872928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099679e2-bec3-44c9-9997-bbf25207e238 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:34.885627 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099679e2-bec3-44c9-9997-bbf25207e238 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:34.889381 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9897ed-376a-4d57-a81e-4a7e2ee0a1f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00e6a8214f7c474eb66250c458500762, user_id=534c79c90c1044f3b24a05e0ae2a20c7, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:34.890569 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c1915-63fe-484a-9ee9-473ff4f794e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:34.891226 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c1915-63fe-484a-9ee9-473ff4f794e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:34.891511 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c1915-63fe-484a-9ee9-473ff4f794e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:34.891859 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c1915-63fe-484a-9ee9-473ff4f794e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:34.892089 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9897ed-376a-4d57-a81e-4a7e2ee0a1f1 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:34.892620 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c1915-63fe-484a-9ee9-473ff4f794e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:34.894371 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c1915-63fe-484a-9ee9-473ff4f794e4 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:34.905988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 791/1587] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:06:34.907979 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa545776-7d3c-4fd6-9f66-15e9dea5a637 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:34.912641 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa545776-7d3c-4fd6-9f66-15e9dea5a637 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:34.912819 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 797/1588] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:06:34 2022] PUT /identity/v3/projects/00e6a8214f7c474eb66250c458500762/users/534c79c90c1044f3b24a05e0ae2a20c7/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:06:34.912955 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa545776-7d3c-4fd6-9f66-15e9dea5a637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:34.913051 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9897ed-376a-4d57-a81e-4a7e2ee0a1f1 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:34.929952 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-aa545776-7d3c-4fd6-9f66-15e9dea5a637 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:34.931192 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-aa545776-7d3c-4fd6-9f66-15e9dea5a637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:34.986640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9897ed-376a-4d57-a81e-4a7e2ee0a1f1 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:34.991307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74d73c-d396-44cf-9670-f6119a69ca24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:34.991984 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74d73c-d396-44cf-9670-f6119a69ca24 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:34.992433 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74d73c-d396-44cf-9670-f6119a69ca24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:34.993205 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74d73c-d396-44cf-9670-f6119a69ca24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:34.993748 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 792/1589] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:34.993944 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74d73c-d396-44cf-9670-f6119a69ca24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:34.994571 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa545776-7d3c-4fd6-9f66-15e9dea5a637 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:34.995648 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74d73c-d396-44cf-9670-f6119a69ca24 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:35.005312 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa545776-7d3c-4fd6-9f66-15e9dea5a637 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:35.007344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 798/1590] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:06:35.008329 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74d73c-d396-44cf-9670-f6119a69ca24 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:35.011336 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e815f0-fea1-4f0a-938b-0ece68fbe86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:35.012035 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e815f0-fea1-4f0a-938b-0ece68fbe86d admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:35.012319 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e815f0-fea1-4f0a-938b-0ece68fbe86d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:35.012640 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e815f0-fea1-4f0a-938b-0ece68fbe86d admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:35.013344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e815f0-fea1-4f0a-938b-0ece68fbe86d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:35.015311 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e815f0-fea1-4f0a-938b-0ece68fbe86d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:35.018687 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74d73c-d396-44cf-9670-f6119a69ca24 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:35.023178 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f67c2c-3029-4d85-a9fc-b634f34a6eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:35.023841 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f67c2c-3029-4d85-a9fc-b634f34a6eaa admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:35.024122 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f67c2c-3029-4d85-a9fc-b634f34a6eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:35.024395 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f67c2c-3029-4d85-a9fc-b634f34a6eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:35.025144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f67c2c-3029-4d85-a9fc-b634f34a6eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:35.027133 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f67c2c-3029-4d85-a9fc-b634f34a6eaa admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:35.038119 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 793/1591] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:06:34 2022] POST /identity/v3/users => generated 281 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:35.041738 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 799/1592] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:06:35.041870 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e815f0-fea1-4f0a-938b-0ece68fbe86d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:35.041985 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f67c2c-3029-4d85-a9fc-b634f34a6eaa admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:35.052677 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f67c2c-3029-4d85-a9fc-b634f34a6eaa admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:35.053617 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e815f0-fea1-4f0a-938b-0ece68fbe86d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:35.058404 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94beffb9-f250-457b-afa3-73ec02087636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:35.059391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94beffb9-f250-457b-afa3-73ec02087636 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:35.059675 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94beffb9-f250-457b-afa3-73ec02087636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:35.059949 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94beffb9-f250-457b-afa3-73ec02087636 admin admin] PATH_INFO: `/v3/projects/3c2c716a7fad467f91f34b3ffd9d6a7c/users/d20d381f9231454cb27a575538d652ad/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:35.066571 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81e84b-7943-4287-8509-2364ca73e579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:35.067261 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81e84b-7943-4287-8509-2364ca73e579 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:35.067556 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81e84b-7943-4287-8509-2364ca73e579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:35.067835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81e84b-7943-4287-8509-2364ca73e579 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:35.068601 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81e84b-7943-4287-8509-2364ca73e579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:35.070445 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81e84b-7943-4287-8509-2364ca73e579 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:35.075857 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94beffb9-f250-457b-afa3-73ec02087636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c2c716a7fad467f91f34b3ffd9d6a7c, user_id=d20d381f9231454cb27a575538d652ad, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:35.078528 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94beffb9-f250-457b-afa3-73ec02087636 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:35.081336 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 800/1593] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:06:35.082127 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81e84b-7943-4287-8509-2364ca73e579 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:35.093070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81e84b-7943-4287-8509-2364ca73e579 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:35.097056 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 794/1594] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:06:35 2022] PUT /identity/v3/projects/3c2c716a7fad467f91f34b3ffd9d6a7c/users/d20d381f9231454cb27a575538d652ad/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:06:35.098404 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaacb74-5242-4a79-b790-b2bffe0c644b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:35.098693 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaacb74-5242-4a79-b790-b2bffe0c644b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:35.098966 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaacb74-5242-4a79-b790-b2bffe0c644b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:35.117270 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-daaacb74-5242-4a79-b790-b2bffe0c644b None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:35.118517 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-daaacb74-5242-4a79-b790-b2bffe0c644b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:35.161471 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fa8e7-6e36-4db8-96b2-6a3d3988de86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:35.162384 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fa8e7-6e36-4db8-96b2-6a3d3988de86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:35.162662 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fa8e7-6e36-4db8-96b2-6a3d3988de86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:35.162928 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fa8e7-6e36-4db8-96b2-6a3d3988de86 admin admin] PATH_INFO: `/v3/projects/a9e34091570646b4a49115ef60aa3687/users/8bd7f018e42d45a5bea3c9ffaa567496/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:35.179243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fa8e7-6e36-4db8-96b2-6a3d3988de86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e34091570646b4a49115ef60aa3687, user_id=8bd7f018e42d45a5bea3c9ffaa567496, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:35.181938 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fa8e7-6e36-4db8-96b2-6a3d3988de86 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:35.182189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:35.193298 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:35.193955 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 795/1595] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:35.195222 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaacb74-5242-4a79-b790-b2bffe0c644b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:35.198866 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 801/1596] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:06:35 2022] PUT /identity/v3/projects/a9e34091570646b4a49115ef60aa3687/users/8bd7f018e42d45a5bea3c9ffaa567496/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:06:35.203337 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fa8e7-6e36-4db8-96b2-6a3d3988de86 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:35.259058 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaacb74-5242-4a79-b790-b2bffe0c644b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:35.280386 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fa8e7-6e36-4db8-96b2-6a3d3988de86 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:35.288439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1a46d-a811-4506-901b-645a3184d1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:35.289469 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1a46d-a811-4506-901b-645a3184d1cd admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:35.290031 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1a46d-a811-4506-901b-645a3184d1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:35.290373 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1a46d-a811-4506-901b-645a3184d1cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:35.291701 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1a46d-a811-4506-901b-645a3184d1cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:35.293836 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1a46d-a811-4506-901b-645a3184d1cd admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:35.308114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 802/1597] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:06:35.308114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1a46d-a811-4506-901b-645a3184d1cd admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:35.316769 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1a46d-a811-4506-901b-645a3184d1cd admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:35.320431 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d090eb3-e055-4a08-b972-c08406ee5881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:35.321121 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d090eb3-e055-4a08-b972-c08406ee5881 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:35.321442 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d090eb3-e055-4a08-b972-c08406ee5881 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:35.321598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31a1f4-652c-4c6f-90d9-70287a18dc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:35.321947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d090eb3-e055-4a08-b972-c08406ee5881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:35.322416 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31a1f4-652c-4c6f-90d9-70287a18dc20 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:35.322611 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31a1f4-652c-4c6f-90d9-70287a18dc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:35.323116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31a1f4-652c-4c6f-90d9-70287a18dc20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:35.323702 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31a1f4-652c-4c6f-90d9-70287a18dc20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:35.325390 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31a1f4-652c-4c6f-90d9-70287a18dc20 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:35.340046 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 803/1598] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:06:35.340246 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d090eb3-e055-4a08-b972-c08406ee5881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:35.340374 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31a1f4-652c-4c6f-90d9-70287a18dc20 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:35.340526 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d090eb3-e055-4a08-b972-c08406ee5881 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:35.350717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 796/1599] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:06:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:06:35.351009 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31a1f4-652c-4c6f-90d9-70287a18dc20 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:35.351604 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d090eb3-e055-4a08-b972-c08406ee5881 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:35.355813 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebebd5-826e-415d-ac78-6c8c60a590eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:35.356567 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebebd5-826e-415d-ac78-6c8c60a590eb admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:35.356794 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebebd5-826e-415d-ac78-6c8c60a590eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:35.357079 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebebd5-826e-415d-ac78-6c8c60a590eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:35.357811 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebebd5-826e-415d-ac78-6c8c60a590eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:35.359460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebebd5-826e-415d-ac78-6c8c60a590eb admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:35.365111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d090eb3-e055-4a08-b972-c08406ee5881 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:35.370491 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bc3ef-2ec4-4998-91c6-4e6f29249e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:35.371196 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bc3ef-2ec4-4998-91c6-4e6f29249e10 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:35.371864 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bc3ef-2ec4-4998-91c6-4e6f29249e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:35.372189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bc3ef-2ec4-4998-91c6-4e6f29249e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:35.372985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bc3ef-2ec4-4998-91c6-4e6f29249e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:35.374650 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bc3ef-2ec4-4998-91c6-4e6f29249e10 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:35.380859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 804/1600] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:06:35.382232 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e5118-7ae3-4939-b157-58f9b6bce327 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:35.382527 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e5118-7ae3-4939-b157-58f9b6bce327 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:35.382814 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e5118-7ae3-4939-b157-58f9b6bce327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:35.391297 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 797/1601] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:06:35.391297 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792c9ca-8fad-4b7c-a46b-106e30f509a0 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:35.391297 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792c9ca-8fad-4b7c-a46b-106e30f509a0 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:35.391297 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792c9ca-8fad-4b7c-a46b-106e30f509a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:35.401790 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6b0e5118-7ae3-4939-b157-58f9b6bce327 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:35.403328 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6b0e5118-7ae3-4939-b157-58f9b6bce327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:35.409661 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b792c9ca-8fad-4b7c-a46b-106e30f509a0 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:35.410858 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b792c9ca-8fad-4b7c-a46b-106e30f509a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:35.413448 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 805/1602] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:35.414548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e5118-7ae3-4939-b157-58f9b6bce327 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:35.422576 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 798/1603] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:35.423455 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792c9ca-8fad-4b7c-a46b-106e30f509a0 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:35.426852 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e5118-7ae3-4939-b157-58f9b6bce327 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:35.431916 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9a928-95b1-4ec3-ae57-633212145a8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:35.433096 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9a928-95b1-4ec3-ae57-633212145a8d service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:35.433604 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792c9ca-8fad-4b7c-a46b-106e30f509a0 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:35.433756 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9a928-95b1-4ec3-ae57-633212145a8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:35.434284 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9a928-95b1-4ec3-ae57-633212145a8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:35.439648 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c298797-a939-46e9-b5c8-f43e10c92cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:35.440590 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c298797-a939-46e9-b5c8-f43e10c92cb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:35.440876 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c298797-a939-46e9-b5c8-f43e10c92cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:35.441145 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c298797-a939-46e9-b5c8-f43e10c92cb5 admin admin] PATH_INFO: `/v3/projects/81c85a559398411aa82e31206a8bc24a/users/c08198bb776a4291b65c65301a9a0fc7/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:35.448049 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9a928-95b1-4ec3-ae57-633212145a8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:35.449577 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9a928-95b1-4ec3-ae57-633212145a8d service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:35.461155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c298797-a939-46e9-b5c8-f43e10c92cb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81c85a559398411aa82e31206a8bc24a, user_id=c08198bb776a4291b65c65301a9a0fc7, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:35.461378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 806/1604] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:06:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:06:35.462059 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9a928-95b1-4ec3-ae57-633212145a8d service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:35.465131 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c298797-a939-46e9-b5c8-f43e10c92cb5 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:35.473565 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9a928-95b1-4ec3-ae57-633212145a8d service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:35.481143 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b795c47-9b0c-4037-8d30-1df4dc8cefcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:35.482154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b795c47-9b0c-4037-8d30-1df4dc8cefcd admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:35.482591 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b795c47-9b0c-4037-8d30-1df4dc8cefcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:35.483064 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b795c47-9b0c-4037-8d30-1df4dc8cefcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:35.483923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b795c47-9b0c-4037-8d30-1df4dc8cefcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:35.486135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 799/1605] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:06:35 2022] PUT /identity/v3/projects/81c85a559398411aa82e31206a8bc24a/users/c08198bb776a4291b65c65301a9a0fc7/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:06:35.487022 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b795c47-9b0c-4037-8d30-1df4dc8cefcd admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:35.488304 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c298797-a939-46e9-b5c8-f43e10c92cb5 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:35.508724 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 807/1606] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:06:35.510022 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b795c47-9b0c-4037-8d30-1df4dc8cefcd admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:35.524582 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b795c47-9b0c-4037-8d30-1df4dc8cefcd admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:35.590281 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c298797-a939-46e9-b5c8-f43e10c92cb5 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:35.600891 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76576a21-a8d4-47b6-8117-0eb9f2472250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:35.601804 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76576a21-a8d4-47b6-8117-0eb9f2472250 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:35.601990 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494bc2b-5e05-4e0a-ad41-3e7d47433772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:35.602143 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76576a21-a8d4-47b6-8117-0eb9f2472250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:35.602347 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76576a21-a8d4-47b6-8117-0eb9f2472250 admin admin] PATH_INFO: `/v3/projects/99307f83b09f476088dc1d7e3111b842/users/c9e6e9d4d6cb499cbd4c886534176b66/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:35.602848 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494bc2b-5e05-4e0a-ad41-3e7d47433772 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:35.603190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494bc2b-5e05-4e0a-ad41-3e7d47433772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:35.603406 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494bc2b-5e05-4e0a-ad41-3e7d47433772 admin admin] PATH_INFO: `/v3/projects/ebdd3e70c48847a9bb872628f072784e/users/b03c9719f6f24ad493d32fbc3e8bc962/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:35.620600 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494bc2b-5e05-4e0a-ad41-3e7d47433772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebdd3e70c48847a9bb872628f072784e, user_id=b03c9719f6f24ad493d32fbc3e8bc962, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:35.623087 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76576a21-a8d4-47b6-8117-0eb9f2472250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99307f83b09f476088dc1d7e3111b842, user_id=c9e6e9d4d6cb499cbd4c886534176b66, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:35.623344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494bc2b-5e05-4e0a-ad41-3e7d47433772 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:35.625945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76576a21-a8d4-47b6-8117-0eb9f2472250 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:35.639870 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:35.650252 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 800/1607] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:06:35 2022] PUT /identity/v3/projects/99307f83b09f476088dc1d7e3111b842/users/c9e6e9d4d6cb499cbd4c886534176b66/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:06:35.650477 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 808/1608] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:06:35 2022] PUT /identity/v3/projects/ebdd3e70c48847a9bb872628f072784e/users/b03c9719f6f24ad493d32fbc3e8bc962/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:06:35.650477 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494bc2b-5e05-4e0a-ad41-3e7d47433772 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:35.654040 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0494bc2b-5e05-4e0a-ad41-3e7d47433772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:35.658626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76576a21-a8d4-47b6-8117-0eb9f2472250 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:35.660876 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-76576a21-a8d4-47b6-8117-0eb9f2472250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:35.696952 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:35.738067 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494bc2b-5e05-4e0a-ad41-3e7d47433772 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:35.741890 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76576a21-a8d4-47b6-8117-0eb9f2472250 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:35.744333 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30e9cf-32e3-48f6-b803-74650e688bb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:35.745061 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30e9cf-32e3-48f6-b803-74650e688bb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:35.746133 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30e9cf-32e3-48f6-b803-74650e688bb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:35.746133 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30e9cf-32e3-48f6-b803-74650e688bb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:35.747892 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf0c72-25e5-4c4f-acfe-89042032805e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:35.748622 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf0c72-25e5-4c4f-acfe-89042032805e service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:35.748906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf0c72-25e5-4c4f-acfe-89042032805e service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:35.749192 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf0c72-25e5-4c4f-acfe-89042032805e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:35.841003 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30e9cf-32e3-48f6-b803-74650e688bb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:35.842178 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30e9cf-32e3-48f6-b803-74650e688bb2 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:35.847748 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf0c72-25e5-4c4f-acfe-89042032805e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:35.849294 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf0c72-25e5-4c4f-acfe-89042032805e service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:35.861809 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 801/1609] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:06:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:06:35.862318 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 809/1610] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:06:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:06:35.863436 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30e9cf-32e3-48f6-b803-74650e688bb2 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:35.863577 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0280bb-bd53-4415-b88d-1b68fef7c974 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:35.863861 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0280bb-bd53-4415-b88d-1b68fef7c974 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:35.864193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0280bb-bd53-4415-b88d-1b68fef7c974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:35.883018 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30e9cf-32e3-48f6-b803-74650e688bb2 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:35.890872 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6ee2d-a467-4e83-844f-597bc4a1c670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:35.892794 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6ee2d-a467-4e83-844f-597bc4a1c670 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:35.893174 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6ee2d-a467-4e83-844f-597bc4a1c670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:35.894132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6ee2d-a467-4e83-844f-597bc4a1c670 admin admin] PATH_INFO: `/v3/projects/755f180bb9124c2b9e937c46bdd9a7d0/users/58496871ebee432da7225564905946c8/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:35.897297 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-ca0280bb-bd53-4415-b88d-1b68fef7c974 None None] MFA Rules not processed for user `c08198bb776a4291b65c65301a9a0fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:35.899140 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ca0280bb-bd53-4415-b88d-1b68fef7c974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:35.917618 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6ee2d-a467-4e83-844f-597bc4a1c670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=755f180bb9124c2b9e937c46bdd9a7d0, user_id=58496871ebee432da7225564905946c8, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:35.922190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6ee2d-a467-4e83-844f-597bc4a1c670 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:35.957508 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 810/1611] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:06:35 2022] PUT /identity/v3/projects/755f180bb9124c2b9e937c46bdd9a7d0/users/58496871ebee432da7225564905946c8/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:06:35.959597 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e61dba-57f3-4122-9bb4-05df75d2c2f0 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:35.959944 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e61dba-57f3-4122-9bb4-05df75d2c2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:35.960210 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e61dba-57f3-4122-9bb4-05df75d2c2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:36.009447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-61e61dba-57f3-4122-9bb4-05df75d2c2f0 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:36.018488 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 802/1612] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:35 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:36.019178 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-61e61dba-57f3-4122-9bb4-05df75d2c2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:36.019276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d8f37-dc2b-4f3a-947b-749514a82850 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:36.019276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d8f37-dc2b-4f3a-947b-749514a82850 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:36.019276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d8f37-dc2b-4f3a-947b-749514a82850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:36.053942 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-706d8f37-dc2b-4f3a-947b-749514a82850 None None] MFA Rules not processed for user `b03c9719f6f24ad493d32fbc3e8bc962`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:36.055138 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-706d8f37-dc2b-4f3a-947b-749514a82850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:36.091291 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:36.139911 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 811/1613] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:36.141602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7a164-0f35-4495-a9e6-11e35a0fc140 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:36.142567 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7a164-0f35-4495-a9e6-11e35a0fc140 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:36.142949 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7a164-0f35-4495-a9e6-11e35a0fc140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:36.169749 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 803/1614] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:36.171562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d8f37-dc2b-4f3a-947b-749514a82850 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:36.183834 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-91e7a164-0f35-4495-a9e6-11e35a0fc140 None None] MFA Rules not processed for user `58496871ebee432da7225564905946c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:36.185284 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-91e7a164-0f35-4495-a9e6-11e35a0fc140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:36.262303 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d8f37-dc2b-4f3a-947b-749514a82850 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:36.267067 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:36.270171 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e94a1f-2d22-449b-8fa2-1409510ec34e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:36.271037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e94a1f-2d22-449b-8fa2-1409510ec34e service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:36.271309 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e94a1f-2d22-449b-8fa2-1409510ec34e service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:36.272120 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e94a1f-2d22-449b-8fa2-1409510ec34e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:36.320114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 812/1615] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:36.321148 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7a164-0f35-4495-a9e6-11e35a0fc140 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:36.392495 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e94a1f-2d22-449b-8fa2-1409510ec34e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:36.393969 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e94a1f-2d22-449b-8fa2-1409510ec34e service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:36.401908 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7a164-0f35-4495-a9e6-11e35a0fc140 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:36.405988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 804/1616] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:06:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:06:36.407710 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113bf25-6075-4d62-b423-ef997f66f300 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:36.408078 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113bf25-6075-4d62-b423-ef997f66f300 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:36.408367 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113bf25-6075-4d62-b423-ef997f66f300 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:36.410347 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 805/1617] 10.222.0.35 () {54 vars in 961 bytes} [Thu May 19 22:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:06:36.411216 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113bf25-6075-4d62-b423-ef997f66f300 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:36.425764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113bf25-6075-4d62-b423-ef997f66f300 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:36.428967 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79517a92-897a-48a2-a0a7-a9b660886d87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:36.429328 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79517a92-897a-48a2-a0a7-a9b660886d87 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:36.429678 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79517a92-897a-48a2-a0a7-a9b660886d87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:36.429960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79517a92-897a-48a2-a0a7-a9b660886d87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:36.430617 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec7fe6-72e0-42c7-be1d-59dfc3db909f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:36.431443 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec7fe6-72e0-42c7-be1d-59dfc3db909f admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:36.431732 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec7fe6-72e0-42c7-be1d-59dfc3db909f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:36.432013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec7fe6-72e0-42c7-be1d-59dfc3db909f admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:36.432866 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec7fe6-72e0-42c7-be1d-59dfc3db909f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:36.435473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec7fe6-72e0-42c7-be1d-59dfc3db909f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:36.451562 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79517a92-897a-48a2-a0a7-a9b660886d87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:36.453404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79517a92-897a-48a2-a0a7-a9b660886d87 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:36.475432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 813/1618] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:06:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:06:36.476777 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16533f-8ecd-494b-a678-51311f88c631 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:36.477070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16533f-8ecd-494b-a678-51311f88c631 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:36.477397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16533f-8ecd-494b-a678-51311f88c631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:36.483209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 806/1619] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:06:36 2022] POST /identity/v3/projects => generated 365 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:36.485813 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec7fe6-72e0-42c7-be1d-59dfc3db909f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:36.510613 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-cb16533f-8ecd-494b-a678-51311f88c631 None None] MFA Rules not processed for user `902ca8f1d59547a0ab187b4748311f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:36.512336 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cb16533f-8ecd-494b-a678-51311f88c631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:36.595617 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec7fe6-72e0-42c7-be1d-59dfc3db909f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:36.606861 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee686b-8e8b-4fa2-9155-af8dbe758b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:36.607566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee686b-8e8b-4fa2-9155-af8dbe758b06 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:36.607857 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee686b-8e8b-4fa2-9155-af8dbe758b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:36.608139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee686b-8e8b-4fa2-9155-af8dbe758b06 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:36.608889 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee686b-8e8b-4fa2-9155-af8dbe758b06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:36.616225 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee686b-8e8b-4fa2-9155-af8dbe758b06 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:36.623031 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 814/1620] 10.222.0.35 () {58 vars in 1058 bytes} [Thu May 19 22:06:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:36.630385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:36.635975 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16533f-8ecd-494b-a678-51311f88c631 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:36.651962 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16533f-8ecd-494b-a678-51311f88c631 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:36.659670 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 807/1621] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:06:36 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:36.661752 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee686b-8e8b-4fa2-9155-af8dbe758b06 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:36.663277 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10609b-c352-486d-b29e-af00ea6e7fab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:36.664252 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10609b-c352-486d-b29e-af00ea6e7fab service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:36.664668 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10609b-c352-486d-b29e-af00ea6e7fab service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:36.665221 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10609b-c352-486d-b29e-af00ea6e7fab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:36.682705 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee686b-8e8b-4fa2-9155-af8dbe758b06 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:36.694115 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e713e-0569-44e6-a455-84802c7b750b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:36.694833 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e713e-0569-44e6-a455-84802c7b750b admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:36.695163 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e713e-0569-44e6-a455-84802c7b750b admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:36.695988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e713e-0569-44e6-a455-84802c7b750b admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:36.697268 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e713e-0569-44e6-a455-84802c7b750b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:36.702032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e713e-0569-44e6-a455-84802c7b750b admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:36.727472 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 808/1622] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:06:36.728581 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e713e-0569-44e6-a455-84802c7b750b admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:36.757870 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e713e-0569-44e6-a455-84802c7b750b admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:36.771958 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f990f-73e1-4df0-9c07-88e1d671065d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:36.772425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f990f-73e1-4df0-9c07-88e1d671065d admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:36.772714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f990f-73e1-4df0-9c07-88e1d671065d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:36.772996 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f990f-73e1-4df0-9c07-88e1d671065d admin admin] PATH_INFO: `/v3/projects/aabd57f1d3e6449ea1ff0b53682f8aee/users/5027b02f0d0e4113987488bb94bb3a97/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:36.809805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f990f-73e1-4df0-9c07-88e1d671065d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aabd57f1d3e6449ea1ff0b53682f8aee, user_id=5027b02f0d0e4113987488bb94bb3a97, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:36.814244 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10609b-c352-486d-b29e-af00ea6e7fab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:36.816798 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10609b-c352-486d-b29e-af00ea6e7fab service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:36.819776 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f990f-73e1-4df0-9c07-88e1d671065d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:36.844541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 809/1623] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:06:36 2022] PUT /identity/v3/projects/aabd57f1d3e6449ea1ff0b53682f8aee/users/5027b02f0d0e4113987488bb94bb3a97/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:06:36.844721 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 815/1624] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:06:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:06:36.846833 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f990f-73e1-4df0-9c07-88e1d671065d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:37.021738 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f990f-73e1-4df0-9c07-88e1d671065d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:37.043305 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46a764-d382-4167-ae7c-50e305ed3f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:37.044893 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46a764-d382-4167-ae7c-50e305ed3f71 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:37.045496 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46a764-d382-4167-ae7c-50e305ed3f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:37.045849 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46a764-d382-4167-ae7c-50e305ed3f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:37.049849 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46a764-d382-4167-ae7c-50e305ed3f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:37.054198 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46a764-d382-4167-ae7c-50e305ed3f71 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:37.099524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10609b-c352-486d-b29e-af00ea6e7fab service nova] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:37.100167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 810/1625] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:06:37.117550 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10609b-c352-486d-b29e-af00ea6e7fab service nova] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:37.130376 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd82cd-9e88-4b21-91cb-3305dc5b3a4f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:37.130717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd82cd-9e88-4b21-91cb-3305dc5b3a4f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:37.130958 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd82cd-9e88-4b21-91cb-3305dc5b3a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:37.137892 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fa4bb-ff94-4ba8-a80c-948089bf9971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:37.139050 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fa4bb-ff94-4ba8-a80c-948089bf9971 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:37.139487 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fa4bb-ff94-4ba8-a80c-948089bf9971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:37.140068 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fa4bb-ff94-4ba8-a80c-948089bf9971 admin admin] PATH_INFO: `/v3/projects/aabd57f1d3e6449ea1ff0b53682f8aee/users/5027b02f0d0e4113987488bb94bb3a97/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:37.148633 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3fa4bb-ff94-4ba8-a80c-948089bf9971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aabd57f1d3e6449ea1ff0b53682f8aee, user_id=5027b02f0d0e4113987488bb94bb3a97, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:37.151478 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3fa4bb-ff94-4ba8-a80c-948089bf9971 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:37.182629 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 816/1626] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:06:37 2022] PUT /identity/v3/projects/aabd57f1d3e6449ea1ff0b53682f8aee/users/5027b02f0d0e4113987488bb94bb3a97/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:06:37.199195 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae53fd-897d-4eac-b3ba-320ef9523441 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:37.199773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae53fd-897d-4eac-b3ba-320ef9523441 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:37.200149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae53fd-897d-4eac-b3ba-320ef9523441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:37.206742 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:37.233448 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-27dd82cd-9e88-4b21-91cb-3305dc5b3a4f None None] MFA Rules not processed for user `f2da574d2af04217967bfd90be946b29`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:37.241002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-27dd82cd-9e88-4b21-91cb-3305dc5b3a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:37.261756 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-77ae53fd-897d-4eac-b3ba-320ef9523441 None None] MFA Rules not processed for user `5027b02f0d0e4113987488bb94bb3a97`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:37.262992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-77ae53fd-897d-4eac-b3ba-320ef9523441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:37.392854 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 811/1627] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:37.394452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4a8bf-d8ec-44d7-9828-fceb43b34918 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:37.394747 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4a8bf-d8ec-44d7-9828-fceb43b34918 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:37.395025 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4a8bf-d8ec-44d7-9828-fceb43b34918 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:37.396473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 812/1628] 10.222.0.35 () {54 vars in 912 bytes} [Thu May 19 22:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:06:37.402814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445328d6-7f88-4356-a513-bb611e7b4661 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:37.403168 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445328d6-7f88-4356-a513-bb611e7b4661 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:37.404698 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445328d6-7f88-4356-a513-bb611e7b4661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:37.437836 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-445328d6-7f88-4356-a513-bb611e7b4661 None None] MFA Rules not processed for user `f2da574d2af04217967bfd90be946b29`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:37.439287 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-445328d6-7f88-4356-a513-bb611e7b4661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:37.446267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 817/1629] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:37 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:37.447558 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19afc4a-85f5-4b00-a627-2b302786cc0b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:37.447909 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19afc4a-85f5-4b00-a627-2b302786cc0b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:37.448196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19afc4a-85f5-4b00-a627-2b302786cc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:37.464064 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 813/1630] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:37.478125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445328d6-7f88-4356-a513-bb611e7b4661 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:37.490644 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a19afc4a-85f5-4b00-a627-2b302786cc0b None None] MFA Rules not processed for user `902ca8f1d59547a0ab187b4748311f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:37.495464 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a19afc4a-85f5-4b00-a627-2b302786cc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:37.568387 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:37.616573 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445328d6-7f88-4356-a513-bb611e7b4661 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:37.628056 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65ca49-781e-4253-ab73-0e649ccf3a26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:37.630125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65ca49-781e-4253-ab73-0e649ccf3a26 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:37.631440 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65ca49-781e-4253-ab73-0e649ccf3a26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:37.631991 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65ca49-781e-4253-ab73-0e649ccf3a26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:37.653106 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65ca49-781e-4253-ab73-0e649ccf3a26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:37.657094 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65ca49-781e-4253-ab73-0e649ccf3a26 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:37.665877 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 818/1631] 10.222.0.35 () {58 vars in 1009 bytes} [Thu May 19 22:06:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:37.670433 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcded436-defb-4991-826e-8c90cf3524e8 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:37.671080 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcded436-defb-4991-826e-8c90cf3524e8 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:37.671736 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcded436-defb-4991-826e-8c90cf3524e8 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:37.681955 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 819/1632] 10.222.0.35 () {54 vars in 961 bytes} [Thu May 19 22:06:37 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:06:37.684007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fa50c-76a4-467d-aa4c-e0b485ae834d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:37.684748 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fa50c-76a4-467d-aa4c-e0b485ae834d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:37.686955 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fa50c-76a4-467d-aa4c-e0b485ae834d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:37.706924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 814/1633] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:06:37 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:06:37.746308 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cfae4-8d2f-40ee-a261-5f2e42aba1bc None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:37.746961 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cfae4-8d2f-40ee-a261-5f2e42aba1bc None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:37.747481 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cfae4-8d2f-40ee-a261-5f2e42aba1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:37.762773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-641fa50c-76a4-467d-aa4c-e0b485ae834d None None] MFA Rules not processed for user `902ca8f1d59547a0ab187b4748311f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:37.768035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-641fa50c-76a4-467d-aa4c-e0b485ae834d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:37.812725 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 820/1634] 10.222.0.35 () {58 vars in 1058 bytes} [Thu May 19 22:06:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:37.823578 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fa50c-76a4-467d-aa4c-e0b485ae834d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:37.843496 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-fa1cfae4-8d2f-40ee-a261-5f2e42aba1bc None None] MFA Rules not processed for user `534c79c90c1044f3b24a05e0ae2a20c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:37.845374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-fa1cfae4-8d2f-40ee-a261-5f2e42aba1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:37.851987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fa50c-76a4-467d-aa4c-e0b485ae834d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:37.862098 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415c458-84d0-4fc1-a3fb-1c792235871f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:37.863339 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415c458-84d0-4fc1-a3fb-1c792235871f service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:37.865033 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415c458-84d0-4fc1-a3fb-1c792235871f service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:37.865539 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415c458-84d0-4fc1-a3fb-1c792235871f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:37.890803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415c458-84d0-4fc1-a3fb-1c792235871f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:37.894381 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415c458-84d0-4fc1-a3fb-1c792235871f service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:37.930136 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 821/1635] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:06:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:06:37.931283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415c458-84d0-4fc1-a3fb-1c792235871f service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:37.962419 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415c458-84d0-4fc1-a3fb-1c792235871f service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:37.989137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb2a00-8e4b-4e80-b254-e4fa1b85c9fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:37.989906 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb2a00-8e4b-4e80-b254-e4fa1b85c9fa service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:37.990262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb2a00-8e4b-4e80-b254-e4fa1b85c9fa service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:37.990749 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb2a00-8e4b-4e80-b254-e4fa1b85c9fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:38.004323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb2a00-8e4b-4e80-b254-e4fa1b85c9fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:38.008252 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb2a00-8e4b-4e80-b254-e4fa1b85c9fa service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:38.031284 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 815/1636] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:37 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:06:38.031284 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cfae4-8d2f-40ee-a261-5f2e42aba1bc None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:38.031594 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 822/1637] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:06:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:06:38.043969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb2a00-8e4b-4e80-b254-e4fa1b85c9fa service nova] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:38.066713 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cfae4-8d2f-40ee-a261-5f2e42aba1bc None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:38.087658 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac54ab-9687-41db-9d3c-8aa89615bd1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:38.088972 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac54ab-9687-41db-9d3c-8aa89615bd1f service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:38.089359 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac54ab-9687-41db-9d3c-8aa89615bd1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:38.089733 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac54ab-9687-41db-9d3c-8aa89615bd1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:38.180480 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:38.236693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb2a00-8e4b-4e80-b254-e4fa1b85c9fa service nova] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:38.248444 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab47103-b58e-46ce-a6f5-b74a87c78018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:38.249977 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab47103-b58e-46ce-a6f5-b74a87c78018 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:38.250390 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab47103-b58e-46ce-a6f5-b74a87c78018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:38.250770 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab47103-b58e-46ce-a6f5-b74a87c78018 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:38.253537 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab47103-b58e-46ce-a6f5-b74a87c78018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:38.256189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac54ab-9687-41db-9d3c-8aa89615bd1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:38.257672 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac54ab-9687-41db-9d3c-8aa89615bd1f service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:38.269420 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab47103-b58e-46ce-a6f5-b74a87c78018 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:38.300482 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 816/1638] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:06:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:06:38.320635 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 823/1639] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:06:38 2022] POST /identity/v3/projects => generated 403 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:38.325348 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac54ab-9687-41db-9d3c-8aa89615bd1f service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:38.372009 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac54ab-9687-41db-9d3c-8aa89615bd1f service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:38.521672 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f2747-d200-45f8-ba2c-f728dcfb093f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:38.522462 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f2747-d200-45f8-ba2c-f728dcfb093f admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:38.522865 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f2747-d200-45f8-ba2c-f728dcfb093f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:38.523237 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f2747-d200-45f8-ba2c-f728dcfb093f admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:38.524041 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f2747-d200-45f8-ba2c-f728dcfb093f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:38.526213 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f2747-d200-45f8-ba2c-f728dcfb093f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:38.553976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908d1f0-ae10-4faa-8988-021c141b7914 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:38.555761 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:38.557463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908d1f0-ae10-4faa-8988-021c141b7914 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:38.558087 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908d1f0-ae10-4faa-8988-021c141b7914 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:38.561573 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 824/1640] 10.222.0.35 () {54 vars in 912 bytes} [Thu May 19 22:06:38 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 22:06:38.571348 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd1c0d-8aaf-4ecb-8d3c-90bcb97eff07 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:38.571945 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd1c0d-8aaf-4ecb-8d3c-90bcb97eff07 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:38.572445 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd1c0d-8aaf-4ecb-8d3c-90bcb97eff07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:38.578509 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 817/1641] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:06:38 2022] POST /identity/v3/users => generated 308 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:38.584314 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f2747-d200-45f8-ba2c-f728dcfb093f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:38.604459 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f2747-d200-45f8-ba2c-f728dcfb093f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:38.620061 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e673e-bbcc-43e9-aea3-898e32285743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:38.623242 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e673e-bbcc-43e9-aea3-898e32285743 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:38.624269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e673e-bbcc-43e9-aea3-898e32285743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:38.624714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e673e-bbcc-43e9-aea3-898e32285743 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:38.627205 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e673e-bbcc-43e9-aea3-898e32285743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:38.628046 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-33dd1c0d-8aaf-4ecb-8d3c-90bcb97eff07 None None] MFA Rules not processed for user `902ca8f1d59547a0ab187b4748311f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:38.631136 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-33dd1c0d-8aaf-4ecb-8d3c-90bcb97eff07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:38.631324 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e673e-bbcc-43e9-aea3-898e32285743 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:38.658033 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 818/1642] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:06:38.662552 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e673e-bbcc-43e9-aea3-898e32285743 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:38.691133 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e673e-bbcc-43e9-aea3-898e32285743 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:38.705292 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ebec8-5254-4797-9fcb-c3b03bc3e2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:38.706591 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ebec8-5254-4797-9fcb-c3b03bc3e2d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:38.706963 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ebec8-5254-4797-9fcb-c3b03bc3e2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:38.707371 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ebec8-5254-4797-9fcb-c3b03bc3e2d3 admin admin] PATH_INFO: `/v3/projects/ff4c3ef6e6f1453b8883456ca5351665/users/d9a9445f43514634af40092e2ce39519/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:38.756320 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ebec8-5254-4797-9fcb-c3b03bc3e2d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff4c3ef6e6f1453b8883456ca5351665, user_id=d9a9445f43514634af40092e2ce39519, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:38.759470 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ebec8-5254-4797-9fcb-c3b03bc3e2d3 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:38.811307 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 819/1643] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:06:38 2022] PUT /identity/v3/projects/ff4c3ef6e6f1453b8883456ca5351665/users/d9a9445f43514634af40092e2ce39519/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:06:38.819472 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ebec8-5254-4797-9fcb-c3b03bc3e2d3 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:38.913155 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 825/1644] 10.222.0.35 () {58 vars in 1009 bytes} [Thu May 19 22:06:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:38.929046 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd1c0d-8aaf-4ecb-8d3c-90bcb97eff07 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:38.930697 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-33dd1c0d-8aaf-4ecb-8d3c-90bcb97eff07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:38.958557 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ebec8-5254-4797-9fcb-c3b03bc3e2d3 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:38.967919 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220d11f-5244-4057-aff0-6f04efad65eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:38.969423 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220d11f-5244-4057-aff0-6f04efad65eb admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:38.970729 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220d11f-5244-4057-aff0-6f04efad65eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:38.971248 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220d11f-5244-4057-aff0-6f04efad65eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:38.972621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220d11f-5244-4057-aff0-6f04efad65eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:38.975120 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220d11f-5244-4057-aff0-6f04efad65eb admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:38.994379 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 820/1645] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:06:38.999127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220d11f-5244-4057-aff0-6f04efad65eb admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:39.020789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220d11f-5244-4057-aff0-6f04efad65eb admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:39.034358 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4fa90-a7fb-4c3c-979f-9842b8487c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:39.035266 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4fa90-a7fb-4c3c-979f-9842b8487c4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:39.035544 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4fa90-a7fb-4c3c-979f-9842b8487c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:39.035814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4fa90-a7fb-4c3c-979f-9842b8487c4b admin admin] PATH_INFO: `/v3/projects/ff4c3ef6e6f1453b8883456ca5351665/users/d9a9445f43514634af40092e2ce39519/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:39.039130 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4fa90-a7fb-4c3c-979f-9842b8487c4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff4c3ef6e6f1453b8883456ca5351665, user_id=d9a9445f43514634af40092e2ce39519, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:39.042022 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4fa90-a7fb-4c3c-979f-9842b8487c4b admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:39.049478 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd1c0d-8aaf-4ecb-8d3c-90bcb97eff07 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:39.081228 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 821/1646] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:06:38 2022] PUT /identity/v3/projects/ff4c3ef6e6f1453b8883456ca5351665/users/d9a9445f43514634af40092e2ce39519/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:06:39.144211 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed93ea4-180a-4e76-acfb-856715f25a65 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf64f4ec145742d78eee6c4a447515dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:39.145448 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed93ea4-180a-4e76-acfb-856715f25a65 service glance] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:39.146191 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed93ea4-180a-4e76-acfb-856715f25a65 service glance] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:39.146754 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed93ea4-180a-4e76-acfb-856715f25a65 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:39.210584 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:39.280130 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed93ea4-180a-4e76-acfb-856715f25a65 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:39.282049 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed93ea4-180a-4e76-acfb-856715f25a65 service glance] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:39.299372 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 826/1647] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:06:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:06:39.845463 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d14c4-713c-496e-84cc-ea1fc2928710 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:39.846760 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d14c4-713c-496e-84cc-ea1fc2928710 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:39.847203 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d14c4-713c-496e-84cc-ea1fc2928710 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:39.849229 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 822/1648] 10.222.0.35 () {54 vars in 912 bytes} [Thu May 19 22:06:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:06:39.854630 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94633aeb-f1a1-4ac3-bcc7-f6437a4bf7a3 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:39.855222 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94633aeb-f1a1-4ac3-bcc7-f6437a4bf7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:39.855222 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94633aeb-f1a1-4ac3-bcc7-f6437a4bf7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:39.982019 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-94633aeb-f1a1-4ac3-bcc7-f6437a4bf7a3 None None] MFA Rules not processed for user `a571d6fe63334552b532aae15299ef9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:39.983263 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-94633aeb-f1a1-4ac3-bcc7-f6437a4bf7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:40.131774 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 827/1649] 10.222.0.35 () {58 vars in 1009 bytes} [Thu May 19 22:06:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:40.218065 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d14c4-713c-496e-84cc-ea1fc2928710 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:40.240839 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d14c4-713c-496e-84cc-ea1fc2928710 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:40.251728 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1e138-d91b-40c1-a454-7abdae568268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:40.252850 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1e138-d91b-40c1-a454-7abdae568268 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:40.256979 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1e138-d91b-40c1-a454-7abdae568268 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:40.257395 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1e138-d91b-40c1-a454-7abdae568268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:40.288660 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1e138-d91b-40c1-a454-7abdae568268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:40.292789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1e138-d91b-40c1-a454-7abdae568268 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:40.321884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 823/1650] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:06:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:06:40.885160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94633aeb-f1a1-4ac3-bcc7-f6437a4bf7a3 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:41.037971 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94633aeb-f1a1-4ac3-bcc7-f6437a4bf7a3 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:41.046673 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71d41d-a2ea-411e-bd38-69570d294412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:41.047929 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71d41d-a2ea-411e-bd38-69570d294412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:41.048767 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71d41d-a2ea-411e-bd38-69570d294412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:41.049338 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71d41d-a2ea-411e-bd38-69570d294412 admin admin] PATH_INFO: `/v3/users/b03c9719f6f24ad493d32fbc3e8bc962` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:41.051848 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71d41d-a2ea-411e-bd38-69570d294412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b03c9719f6f24ad493d32fbc3e8bc962)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:41.054983 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71d41d-a2ea-411e-bd38-69570d294412 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:41.143040 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cc71d41d-a2ea-411e-bd38-69570d294412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b03c9719f6f24ad493d32fbc3e8bc962'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:41.154918 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cc71d41d-a2ea-411e-bd38-69570d294412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b03c9719f6f24ad493d32fbc3e8bc962'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:41.156927 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cc71d41d-a2ea-411e-bd38-69570d294412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b03c9719f6f24ad493d32fbc3e8bc962'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:41.161635 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:41.181609 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cc71d41d-a2ea-411e-bd38-69570d294412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b03c9719f6f24ad493d32fbc3e8bc962'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:41.199622 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cc71d41d-a2ea-411e-bd38-69570d294412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b03c9719f6f24ad493d32fbc3e8bc962'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:41.221158 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 828/1651] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:06:40 2022] DELETE /identity/v3/users/b03c9719f6f24ad493d32fbc3e8bc962 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:06:41.223888 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b2aee-7dde-4648-b877-203ac7892739 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:41.224381 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b2aee-7dde-4648-b877-203ac7892739 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:41.224740 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b2aee-7dde-4648-b877-203ac7892739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:41.247188 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-869b2aee-7dde-4648-b877-203ac7892739 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:41.250222 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-869b2aee-7dde-4648-b877-203ac7892739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:41.367437 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 824/1652] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:41.398795 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71d41d-a2ea-411e-bd38-69570d294412 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:41.400450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cc71d41d-a2ea-411e-bd38-69570d294412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:41.637458 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71d41d-a2ea-411e-bd38-69570d294412 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:41.649600 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04786d-8ebd-41d8-bfb3-1c55f15e496e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:41.650285 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04786d-8ebd-41d8-bfb3-1c55f15e496e service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:41.650567 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04786d-8ebd-41d8-bfb3-1c55f15e496e service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:41.653158 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04786d-8ebd-41d8-bfb3-1c55f15e496e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:41.669231 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fd900-1055-4eef-99d4-ebe686ec0099 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:41.669455 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fd900-1055-4eef-99d4-ebe686ec0099 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:41.669787 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fd900-1055-4eef-99d4-ebe686ec0099 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:41.672567 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 825/1653] 10.222.0.35 () {54 vars in 960 bytes} [Thu May 19 22:06:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 22:06:41.687265 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d30fa0-bc7d-448e-a936-86648a5f6eaa None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:41.687667 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d30fa0-bc7d-448e-a936-86648a5f6eaa None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:41.687909 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d30fa0-bc7d-448e-a936-86648a5f6eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:41.692740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04786d-8ebd-41d8-bfb3-1c55f15e496e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:41.694130 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04786d-8ebd-41d8-bfb3-1c55f15e496e service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:41.717184 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 829/1654] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:06:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:06:41.763213 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-64d30fa0-bc7d-448e-a936-86648a5f6eaa None None] MFA Rules not processed for user `b1004beeeaed4af4a92c89ad31008b32`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:41.765098 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-64d30fa0-bc7d-448e-a936-86648a5f6eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:41.824648 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:42.008202 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 826/1655] 10.222.0.35 () {58 vars in 1057 bytes} [Thu May 19 22:06:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:06:42.017350 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04786d-8ebd-41d8-bfb3-1c55f15e496e service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:42.034316 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04786d-8ebd-41d8-bfb3-1c55f15e496e service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:42.062944 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2bef23-eee5-49b2-9b42-3a7a1efc555d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1004beeeaed4af4a92c89ad31008b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:42.066040 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bef23-eee5-49b2-9b42-3a7a1efc555d service placement] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:42.067053 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bef23-eee5-49b2-9b42-3a7a1efc555d service placement] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:42.068104 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bef23-eee5-49b2-9b42-3a7a1efc555d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:42.073669 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6a2bef23-eee5-49b2-9b42-3a7a1efc555d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:42.132628 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2bef23-eee5-49b2-9b42-3a7a1efc555d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:42.135242 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2bef23-eee5-49b2-9b42-3a7a1efc555d service placement] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:42.166021 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 830/1656] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:06:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:06:43.045954 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d85527-d145-4585-be84-e54b92b6c1cf None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:43.047220 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d85527-d145-4585-be84-e54b92b6c1cf None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:43.050115 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d85527-d145-4585-be84-e54b92b6c1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:43.131066 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-d7d85527-d145-4585-be84-e54b92b6c1cf None None] MFA Rules not processed for user `d9a9445f43514634af40092e2ce39519`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:43.135543 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d7d85527-d145-4585-be84-e54b92b6c1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:43.447760 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 827/1657] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:43 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:43.498871 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2bef23-eee5-49b2-9b42-3a7a1efc555d service placement] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:43.501759 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6a2bef23-eee5-49b2-9b42-3a7a1efc555d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:43.564826 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2bef23-eee5-49b2-9b42-3a7a1efc555d service placement] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:43.573353 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0609f-a572-4a3c-943a-eed8a85f1c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:43.576588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0609f-a572-4a3c-943a-eed8a85f1c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:43.577097 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0609f-a572-4a3c-943a-eed8a85f1c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:43.577766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0609f-a572-4a3c-943a-eed8a85f1c41 admin admin] PATH_INFO: `/v3/projects/ebdd3e70c48847a9bb872628f072784e` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:43.584227 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0609f-a572-4a3c-943a-eed8a85f1c41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebdd3e70c48847a9bb872628f072784e)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:43.587366 dv-cinder-842237-1-smb devstack@keystone.service[80209]: WARNING py.warnings [None req-0ae0609f-a572-4a3c-943a-eed8a85f1c41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 22:06:43.587366 dv-cinder-842237-1-smb devstack@keystone.service[80209]: warnings.warn(msg) May 19 22:06:43.587366 dv-cinder-842237-1-smb devstack@keystone.service[80209]: May 19 22:06:43.590399 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0609f-a572-4a3c-943a-eed8a85f1c41 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:43.804002 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0ae0609f-a572-4a3c-943a-eed8a85f1c41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebdd3e70c48847a9bb872628f072784e', 'request_id': 'req-0ae0609f-a572-4a3c-943a-eed8a85f1c41'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:43.827942 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0ae0609f-a572-4a3c-943a-eed8a85f1c41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebdd3e70c48847a9bb872628f072784e', 'request_id': 'req-0ae0609f-a572-4a3c-943a-eed8a85f1c41'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:43.852520 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0ae0609f-a572-4a3c-943a-eed8a85f1c41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebdd3e70c48847a9bb872628f072784e', 'request_id': 'req-0ae0609f-a572-4a3c-943a-eed8a85f1c41'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:43.940023 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0ae0609f-a572-4a3c-943a-eed8a85f1c41 admin admin] The token cache is being invalidate because project ebdd3e70c48847a9bb872628f072784e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:06:43.940322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0ae0609f-a572-4a3c-943a-eed8a85f1c41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:43.942600 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0ae0609f-a572-4a3c-943a-eed8a85f1c41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:43.954996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 831/1658] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:06:43 2022] DELETE /identity/v3/projects/ebdd3e70c48847a9bb872628f072784e => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:06:43.956733 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82986f79-bf55-47fe-98a8-51b003d5ba96 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:43.957155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82986f79-bf55-47fe-98a8-51b003d5ba96 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:43.957549 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82986f79-bf55-47fe-98a8-51b003d5ba96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:44.031443 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-82986f79-bf55-47fe-98a8-51b003d5ba96 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:44.038949 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-82986f79-bf55-47fe-98a8-51b003d5ba96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:44.317379 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 828/1659] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:44.325762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c5fe9-7e44-4d39-ba33-05c7294e592f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:44.326434 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c5fe9-7e44-4d39-ba33-05c7294e592f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:44.326850 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c5fe9-7e44-4d39-ba33-05c7294e592f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:44.382853 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-052c5fe9-7e44-4d39-ba33-05c7294e592f None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:44.384429 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-052c5fe9-7e44-4d39-ba33-05c7294e592f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:44.404821 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 832/1660] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:44.409319 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82986f79-bf55-47fe-98a8-51b003d5ba96 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:44.426766 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82986f79-bf55-47fe-98a8-51b003d5ba96 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:44.445932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3e473-a572-4b10-ab55-58ca449f215d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:44.446687 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3e473-a572-4b10-ab55-58ca449f215d admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:44.446971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3e473-a572-4b10-ab55-58ca449f215d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:44.447248 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3e473-a572-4b10-ab55-58ca449f215d admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:44.448030 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3e473-a572-4b10-ab55-58ca449f215d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:06:44.458167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3e473-a572-4b10-ab55-58ca449f215d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:44.459971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3e473-a572-4b10-ab55-58ca449f215d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:44.494969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c5fe9-7e44-4d39-ba33-05c7294e592f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:44.508540 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 829/1661] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:06:44.519512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c5fe9-7e44-4d39-ba33-05c7294e592f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:44.540341 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67dfc7-408b-46d3-b49a-3c6f0d9f4818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:44.541069 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67dfc7-408b-46d3-b49a-3c6f0d9f4818 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:44.541399 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67dfc7-408b-46d3-b49a-3c6f0d9f4818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:44.541801 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67dfc7-408b-46d3-b49a-3c6f0d9f4818 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:44.543217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67dfc7-408b-46d3-b49a-3c6f0d9f4818 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:44.545325 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67dfc7-408b-46d3-b49a-3c6f0d9f4818 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:44.631941 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 833/1662] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:06:44 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:06:44.636114 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3e473-a572-4b10-ab55-58ca449f215d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:44.649776 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3e473-a572-4b10-ab55-58ca449f215d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:44.798153 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:44.869428 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a99d73-31cc-44cd-b3ee-e18fd1000ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:44.870563 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a99d73-31cc-44cd-b3ee-e18fd1000ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:44.870563 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a99d73-31cc-44cd-b3ee-e18fd1000ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:44.875927 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a99d73-31cc-44cd-b3ee-e18fd1000ad9 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:44.881626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a99d73-31cc-44cd-b3ee-e18fd1000ad9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:44.883712 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a99d73-31cc-44cd-b3ee-e18fd1000ad9 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:44.972454 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 830/1663] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:06:44 2022] POST /identity/v3/users => generated 288 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:44.977110 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67dfc7-408b-46d3-b49a-3c6f0d9f4818 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:44.999352 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67dfc7-408b-46d3-b49a-3c6f0d9f4818 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:45.021554 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f157b7-793d-499f-a035-4dc1768d3f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:45.022376 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f157b7-793d-499f-a035-4dc1768d3f04 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:45.022877 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f157b7-793d-499f-a035-4dc1768d3f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:45.023493 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f157b7-793d-499f-a035-4dc1768d3f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:45.024578 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f157b7-793d-499f-a035-4dc1768d3f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:45.042775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f157b7-793d-499f-a035-4dc1768d3f04 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:45.111313 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 834/1664] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:06:45.117710 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a99d73-31cc-44cd-b3ee-e18fd1000ad9 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:45.134896 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a99d73-31cc-44cd-b3ee-e18fd1000ad9 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:45.161355 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c7b9e-04ac-4a24-a3ac-885f65b62643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:45.162190 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c7b9e-04ac-4a24-a3ac-885f65b62643 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:45.162952 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c7b9e-04ac-4a24-a3ac-885f65b62643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:45.172498 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c7b9e-04ac-4a24-a3ac-885f65b62643 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:45.172498 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c7b9e-04ac-4a24-a3ac-885f65b62643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:45.174674 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c7b9e-04ac-4a24-a3ac-885f65b62643 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:45.221897 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 831/1665] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:06:45.226446 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f157b7-793d-499f-a035-4dc1768d3f04 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:45.246834 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f157b7-793d-499f-a035-4dc1768d3f04 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:45.260209 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d6763-6550-4aa8-a762-1c09e4be6bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:45.261792 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d6763-6550-4aa8-a762-1c09e4be6bea admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:45.262437 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d6763-6550-4aa8-a762-1c09e4be6bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:45.262936 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d6763-6550-4aa8-a762-1c09e4be6bea admin admin] PATH_INFO: `/v3/projects/fb571e7d7088401c98e4fd529e41c10c/users/5b7e4b1813f04e1fb324c8519c6ff6fb/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:45.274650 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:45.321074 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d6763-6550-4aa8-a762-1c09e4be6bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb571e7d7088401c98e4fd529e41c10c, user_id=5b7e4b1813f04e1fb324c8519c6ff6fb, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:45.330137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d6763-6550-4aa8-a762-1c09e4be6bea admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:45.382835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 835/1666] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:06:45 2022] PUT /identity/v3/projects/fb571e7d7088401c98e4fd529e41c10c/users/5b7e4b1813f04e1fb324c8519c6ff6fb/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:06:45.394766 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c128eaf-4e7a-4de9-8fcc-25fa6c023691 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:45.395316 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c128eaf-4e7a-4de9-8fcc-25fa6c023691 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:45.395718 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c128eaf-4e7a-4de9-8fcc-25fa6c023691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:45.453576 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0c128eaf-4e7a-4de9-8fcc-25fa6c023691 None None] MFA Rules not processed for user `5b7e4b1813f04e1fb324c8519c6ff6fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:45.456191 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0c128eaf-4e7a-4de9-8fcc-25fa6c023691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:45.566964 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 832/1667] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:45.628072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d6763-6550-4aa8-a762-1c09e4be6bea admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:45.630816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4a1d6763-6550-4aa8-a762-1c09e4be6bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:45.897609 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d6763-6550-4aa8-a762-1c09e4be6bea admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:45.932663 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f2c20-2ab0-4cd0-87b5-f74e0f52c750 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:45.933578 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f2c20-2ab0-4cd0-87b5-f74e0f52c750 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:45.934001 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f2c20-2ab0-4cd0-87b5-f74e0f52c750 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:45.934422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f2c20-2ab0-4cd0-87b5-f74e0f52c750 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:45.960858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f2c20-2ab0-4cd0-87b5-f74e0f52c750 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:45.962825 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f2c20-2ab0-4cd0-87b5-f74e0f52c750 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:46.001517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 836/1668] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:06:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:06:46.527284 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea33486-e58f-4700-ba2b-23842bb6363c None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:46.528183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea33486-e58f-4700-ba2b-23842bb6363c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:46.528674 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea33486-e58f-4700-ba2b-23842bb6363c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:46.566682 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8ea33486-e58f-4700-ba2b-23842bb6363c None None] MFA Rules not processed for user `6d4c4b75552b4c739079f328a6efba40`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:46.569734 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8ea33486-e58f-4700-ba2b-23842bb6363c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:46.664754 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f2c20-2ab0-4cd0-87b5-f74e0f52c750 service nova] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:46.682950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 833/1669] 10.222.0.35 () {58 vars in 1009 bytes} [Thu May 19 22:06:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:06:46.885234 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f2c20-2ab0-4cd0-87b5-f74e0f52c750 service nova] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:46.905166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563306bf-24f2-4aaf-b00e-4ec24b14c51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:46.906390 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563306bf-24f2-4aaf-b00e-4ec24b14c51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:46.906696 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563306bf-24f2-4aaf-b00e-4ec24b14c51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:46.906945 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563306bf-24f2-4aaf-b00e-4ec24b14c51a admin admin] PATH_INFO: `/v3/users/5b7e4b1813f04e1fb324c8519c6ff6fb` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:46.913654 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563306bf-24f2-4aaf-b00e-4ec24b14c51a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b7e4b1813f04e1fb324c8519c6ff6fb)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:46.920173 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563306bf-24f2-4aaf-b00e-4ec24b14c51a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:46.938480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5824d-fb5f-4b6a-9a10-d6e83dbda871 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:46.939450 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5824d-fb5f-4b6a-9a10-d6e83dbda871 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:46.939896 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5824d-fb5f-4b6a-9a10-d6e83dbda871 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:46.941879 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 834/1670] 10.222.0.35 () {54 vars in 921 bytes} [Thu May 19 22:06:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 22:06:46.953158 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a282ae0-624b-4f9d-ba44-14049712c66a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:46.954228 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a282ae0-624b-4f9d-ba44-14049712c66a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:46.954938 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a282ae0-624b-4f9d-ba44-14049712c66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:47.012979 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-5a282ae0-624b-4f9d-ba44-14049712c66a None None] MFA Rules not processed for user `b1004beeeaed4af4a92c89ad31008b32`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:47.018932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5a282ae0-624b-4f9d-ba44-14049712c66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:47.118298 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-563306bf-24f2-4aaf-b00e-4ec24b14c51a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b7e4b1813f04e1fb324c8519c6ff6fb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:47.177472 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-563306bf-24f2-4aaf-b00e-4ec24b14c51a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b7e4b1813f04e1fb324c8519c6ff6fb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:47.183519 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-563306bf-24f2-4aaf-b00e-4ec24b14c51a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b7e4b1813f04e1fb324c8519c6ff6fb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:47.254117 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:47.289309 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 835/1671] 10.222.0.35 () {58 vars in 1018 bytes} [Thu May 19 22:06:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:47.290636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a282ae0-624b-4f9d-ba44-14049712c66a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:47.292631 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5a282ae0-624b-4f9d-ba44-14049712c66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:47.294070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:47.303199 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-563306bf-24f2-4aaf-b00e-4ec24b14c51a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b7e4b1813f04e1fb324c8519c6ff6fb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:47.341912 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-563306bf-24f2-4aaf-b00e-4ec24b14c51a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b7e4b1813f04e1fb324c8519c6ff6fb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:47.368108 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 837/1672] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:06:46 2022] DELETE /identity/v3/users/5b7e4b1813f04e1fb324c8519c6ff6fb => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:06:47.369328 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563306bf-24f2-4aaf-b00e-4ec24b14c51a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:47.385807 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-563306bf-24f2-4aaf-b00e-4ec24b14c51a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:47.471363 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a282ae0-624b-4f9d-ba44-14049712c66a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:47.555072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563306bf-24f2-4aaf-b00e-4ec24b14c51a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:47.577096 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8846a-ed3e-40bd-99aa-6a6ca6316a8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1004beeeaed4af4a92c89ad31008b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:47.577776 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8846a-ed3e-40bd-99aa-6a6ca6316a8f service placement] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:47.578353 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8846a-ed3e-40bd-99aa-6a6ca6316a8f service placement] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:47.578660 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8846a-ed3e-40bd-99aa-6a6ca6316a8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:47.595228 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8846a-ed3e-40bd-99aa-6a6ca6316a8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:47.597291 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8846a-ed3e-40bd-99aa-6a6ca6316a8f service placement] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:47.619689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 838/1673] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:06:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:06:47.621823 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00571244-e871-4ada-ac75-72e10159f12b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:47.622185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00571244-e871-4ada-ac75-72e10159f12b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:47.622410 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00571244-e871-4ada-ac75-72e10159f12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:47.683088 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8f701-5ce2-40ad-bcd3-6130368d6f17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a4208619f84f16b735871ee114e660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:47.683780 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8f701-5ce2-40ad-bcd3-6130368d6f17 service swift] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:47.684061 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8f701-5ce2-40ad-bcd3-6130368d6f17 service swift] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:47.684341 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8f701-5ce2-40ad-bcd3-6130368d6f17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:47.686558 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-00571244-e871-4ada-ac75-72e10159f12b None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:47.687885 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-00571244-e871-4ada-ac75-72e10159f12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:47.697148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cec8f701-5ce2-40ad-bcd3-6130368d6f17 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:47.849634 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 839/1674] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:47.861866 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8f701-5ce2-40ad-bcd3-6130368d6f17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:47.864957 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8f701-5ce2-40ad-bcd3-6130368d6f17 service swift] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:47.873778 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00571244-e871-4ada-ac75-72e10159f12b None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:47.875466 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-00571244-e871-4ada-ac75-72e10159f12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:47.897121 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 836/1675] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 22:06:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 22:06:48.022090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00571244-e871-4ada-ac75-72e10159f12b None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:48.038890 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04516b67-b88b-4092-a89b-7d6646206e0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:48.039606 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04516b67-b88b-4092-a89b-7d6646206e0c service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:48.039895 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04516b67-b88b-4092-a89b-7d6646206e0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:48.040178 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04516b67-b88b-4092-a89b-7d6646206e0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:48.088706 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04516b67-b88b-4092-a89b-7d6646206e0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:48.116694 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04516b67-b88b-4092-a89b-7d6646206e0c service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:48.175966 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 840/1676] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:06:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:06:48.670338 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8f701-5ce2-40ad-bcd3-6130368d6f17 service swift] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:48.673479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cec8f701-5ce2-40ad-bcd3-6130368d6f17 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:48.732295 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8f701-5ce2-40ad-bcd3-6130368d6f17 service swift] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:48.764482 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec271f-e711-4594-8108-348297067d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:48.765730 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec271f-e711-4594-8108-348297067d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:48.769013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec271f-e711-4594-8108-348297067d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:48.769548 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec271f-e711-4594-8108-348297067d55 admin admin] PATH_INFO: `/v3/users/58496871ebee432da7225564905946c8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:48.772216 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec271f-e711-4594-8108-348297067d55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58496871ebee432da7225564905946c8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:48.775179 dv-cinder-842237-1-smb devstack@keystone.service[80210]: WARNING py.warnings [None req-3cec271f-e711-4594-8108-348297067d55 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 22:06:48.775179 dv-cinder-842237-1-smb devstack@keystone.service[80210]: warnings.warn(msg) May 19 22:06:48.775179 dv-cinder-842237-1-smb devstack@keystone.service[80210]: May 19 22:06:48.779339 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec271f-e711-4594-8108-348297067d55 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:48.880378 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:48.933537 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3cec271f-e711-4594-8108-348297067d55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58496871ebee432da7225564905946c8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:48.948962 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3cec271f-e711-4594-8108-348297067d55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58496871ebee432da7225564905946c8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:49.008545 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3cec271f-e711-4594-8108-348297067d55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58496871ebee432da7225564905946c8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:49.009337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3cec271f-e711-4594-8108-348297067d55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58496871ebee432da7225564905946c8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:49.009960 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3cec271f-e711-4594-8108-348297067d55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58496871ebee432da7225564905946c8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:49.053168 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 837/1677] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:06:48 2022] DELETE /identity/v3/users/58496871ebee432da7225564905946c8 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:06:49.058039 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1107b-c5d5-444e-a5a1-793330f0d7e7 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:49.058553 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1107b-c5d5-444e-a5a1-793330f0d7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:49.058648 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1107b-c5d5-444e-a5a1-793330f0d7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:49.099758 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-eda1107b-c5d5-444e-a5a1-793330f0d7e7 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:49.104584 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-eda1107b-c5d5-444e-a5a1-793330f0d7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:49.157753 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:49.312822 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 841/1678] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:49.386256 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec271f-e711-4594-8108-348297067d55 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:49.387865 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3cec271f-e711-4594-8108-348297067d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:49.639713 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec271f-e711-4594-8108-348297067d55 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:49.651619 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74222fd-9591-4ba8-b95e-216fb5370348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:49.652581 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74222fd-9591-4ba8-b95e-216fb5370348 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:49.652959 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74222fd-9591-4ba8-b95e-216fb5370348 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:49.653216 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74222fd-9591-4ba8-b95e-216fb5370348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:49.691704 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74222fd-9591-4ba8-b95e-216fb5370348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:49.693932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74222fd-9591-4ba8-b95e-216fb5370348 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:49.732016 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 838/1679] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:06:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:06:49.922714 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98feb15-4177-47c0-813f-fa9f929af48f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:49.923587 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98feb15-4177-47c0-813f-fa9f929af48f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:49.923871 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98feb15-4177-47c0-813f-fa9f929af48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:49.983385 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-f98feb15-4177-47c0-813f-fa9f929af48f None None] MFA Rules not processed for user `a571d6fe63334552b532aae15299ef9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:49.984682 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f98feb15-4177-47c0-813f-fa9f929af48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:50.011169 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 842/1680] 10.222.0.77 () {58 vars in 1015 bytes} [Thu May 19 22:06:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:50.301536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74222fd-9591-4ba8-b95e-216fb5370348 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:50.304089 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e74222fd-9591-4ba8-b95e-216fb5370348 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:50.325769 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74222fd-9591-4ba8-b95e-216fb5370348 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:50.335201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e6f98-5c65-4aad-887b-82b2aa9ea4b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:50.335878 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e6f98-5c65-4aad-887b-82b2aa9ea4b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:50.336340 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e6f98-5c65-4aad-887b-82b2aa9ea4b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:50.336956 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e6f98-5c65-4aad-887b-82b2aa9ea4b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:50.369569 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e6f98-5c65-4aad-887b-82b2aa9ea4b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:50.374095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e6f98-5c65-4aad-887b-82b2aa9ea4b4 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:50.410172 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 839/1681] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:06:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:06:50.695173 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98feb15-4177-47c0-813f-fa9f929af48f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:50.701518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f98feb15-4177-47c0-813f-fa9f929af48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:50.741676 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98feb15-4177-47c0-813f-fa9f929af48f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:50.749085 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9765f-f5e8-4f80-93b2-8e35fbb47b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:50.753292 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9765f-f5e8-4f80-93b2-8e35fbb47b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:50.754264 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9765f-f5e8-4f80-93b2-8e35fbb47b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:50.755572 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9765f-f5e8-4f80-93b2-8e35fbb47b7b admin admin] PATH_INFO: `/v3/users/c08198bb776a4291b65c65301a9a0fc7` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:50.758803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d9765f-f5e8-4f80-93b2-8e35fbb47b7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c08198bb776a4291b65c65301a9a0fc7)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:50.761451 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d9765f-f5e8-4f80-93b2-8e35fbb47b7b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:50.809133 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e6f98-5c65-4aad-887b-82b2aa9ea4b4 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:50.810920 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6b8e6f98-5c65-4aad-887b-82b2aa9ea4b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:50.844778 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e6f98-5c65-4aad-887b-82b2aa9ea4b4 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:50.886015 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c99af-913a-424b-91a4-3ddc1bad7413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:50.891476 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c99af-913a-424b-91a4-3ddc1bad7413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:50.892536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c99af-913a-424b-91a4-3ddc1bad7413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:50.893518 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c99af-913a-424b-91a4-3ddc1bad7413 admin admin] PATH_INFO: `/v3/users/534c79c90c1044f3b24a05e0ae2a20c7` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:50.898272 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c99af-913a-424b-91a4-3ddc1bad7413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=534c79c90c1044f3b24a05e0ae2a20c7)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:50.903076 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c99af-913a-424b-91a4-3ddc1bad7413 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:50.909846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c4d9765f-f5e8-4f80-93b2-8e35fbb47b7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c08198bb776a4291b65c65301a9a0fc7'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:50.930927 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c4d9765f-f5e8-4f80-93b2-8e35fbb47b7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c08198bb776a4291b65c65301a9a0fc7'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:50.933134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c4d9765f-f5e8-4f80-93b2-8e35fbb47b7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c08198bb776a4291b65c65301a9a0fc7'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:50.969200 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c4d9765f-f5e8-4f80-93b2-8e35fbb47b7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c08198bb776a4291b65c65301a9a0fc7'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:50.990168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c4d9765f-f5e8-4f80-93b2-8e35fbb47b7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c08198bb776a4291b65c65301a9a0fc7'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:51.018045 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 843/1682] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:06:50 2022] DELETE /identity/v3/users/c08198bb776a4291b65c65301a9a0fc7 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:06:51.019981 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4347e-ee39-4c80-ab77-0271450932bf None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:51.023913 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4347e-ee39-4c80-ab77-0271450932bf None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:51.025511 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4347e-ee39-4c80-ab77-0271450932bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:51.040395 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8f4c99af-913a-424b-91a4-3ddc1bad7413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '534c79c90c1044f3b24a05e0ae2a20c7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:51.057178 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8f4c99af-913a-424b-91a4-3ddc1bad7413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '534c79c90c1044f3b24a05e0ae2a20c7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:51.075222 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4bf4347e-ee39-4c80-ab77-0271450932bf None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:51.078353 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4bf4347e-ee39-4c80-ab77-0271450932bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:51.089994 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8f4c99af-913a-424b-91a4-3ddc1bad7413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '534c79c90c1044f3b24a05e0ae2a20c7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:51.091100 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8f4c99af-913a-424b-91a4-3ddc1bad7413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '534c79c90c1044f3b24a05e0ae2a20c7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:51.092500 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8f4c99af-913a-424b-91a4-3ddc1bad7413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '534c79c90c1044f3b24a05e0ae2a20c7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:51.135250 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 840/1683] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:06:50 2022] DELETE /identity/v3/users/534c79c90c1044f3b24a05e0ae2a20c7 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:06:51.308255 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 844/1684] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:51.433105 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c99af-913a-424b-91a4-3ddc1bad7413 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:51.433105 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8f4c99af-913a-424b-91a4-3ddc1bad7413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:51.441181 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:51.711638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c99af-913a-424b-91a4-3ddc1bad7413 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:51.715556 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96701c-6485-45b1-9da4-6c47f094ff51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:51.716321 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96701c-6485-45b1-9da4-6c47f094ff51 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:51.716690 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96701c-6485-45b1-9da4-6c47f094ff51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:51.716980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96701c-6485-45b1-9da4-6c47f094ff51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:51.863155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96701c-6485-45b1-9da4-6c47f094ff51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:51.864921 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96701c-6485-45b1-9da4-6c47f094ff51 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:51.898166 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 841/1685] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:06:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:06:52.213073 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4347e-ee39-4c80-ab77-0271450932bf None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:52.216448 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4bf4347e-ee39-4c80-ab77-0271450932bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:52.245648 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4347e-ee39-4c80-ab77-0271450932bf None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:52.253882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a60eb-6c80-429b-88d3-4e4f7f7a920a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:52.255439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a60eb-6c80-429b-88d3-4e4f7f7a920a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:52.256862 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a60eb-6c80-429b-88d3-4e4f7f7a920a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:52.257921 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a60eb-6c80-429b-88d3-4e4f7f7a920a admin admin] PATH_INFO: `/v3/projects/fb571e7d7088401c98e4fd529e41c10c` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:52.261175 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a60eb-6c80-429b-88d3-4e4f7f7a920a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb571e7d7088401c98e4fd529e41c10c)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:52.264509 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a60eb-6c80-429b-88d3-4e4f7f7a920a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:52.312018 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:52.354619 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-591a60eb-6c80-429b-88d3-4e4f7f7a920a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb571e7d7088401c98e4fd529e41c10c', 'request_id': 'req-591a60eb-6c80-429b-88d3-4e4f7f7a920a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:52.378487 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-591a60eb-6c80-429b-88d3-4e4f7f7a920a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb571e7d7088401c98e4fd529e41c10c', 'request_id': 'req-591a60eb-6c80-429b-88d3-4e4f7f7a920a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:52.387754 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-591a60eb-6c80-429b-88d3-4e4f7f7a920a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb571e7d7088401c98e4fd529e41c10c', 'request_id': 'req-591a60eb-6c80-429b-88d3-4e4f7f7a920a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:52.406813 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-591a60eb-6c80-429b-88d3-4e4f7f7a920a admin admin] The token cache is being invalidate because project fb571e7d7088401c98e4fd529e41c10c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:06:52.407268 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-591a60eb-6c80-429b-88d3-4e4f7f7a920a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:52.408189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-591a60eb-6c80-429b-88d3-4e4f7f7a920a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:52.414522 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 845/1686] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:06:52 2022] DELETE /identity/v3/projects/fb571e7d7088401c98e4fd529e41c10c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:06:52.416377 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e017083-ff8b-4a4d-b39f-cc8f6dbc2088 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:52.416709 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e017083-ff8b-4a4d-b39f-cc8f6dbc2088 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:52.417042 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e017083-ff8b-4a4d-b39f-cc8f6dbc2088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:52.453364 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7e017083-ff8b-4a4d-b39f-cc8f6dbc2088 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:52.456467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7e017083-ff8b-4a4d-b39f-cc8f6dbc2088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:52.574430 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 842/1687] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:52.583046 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a534688-a4c2-4e37-aa71-773212a19839 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:52.583288 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a534688-a4c2-4e37-aa71-773212a19839 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:52.586571 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a534688-a4c2-4e37-aa71-773212a19839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:52.631684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-3a534688-a4c2-4e37-aa71-773212a19839 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:52.633170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3a534688-a4c2-4e37-aa71-773212a19839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:52.652767 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 846/1688] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:52.658569 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e017083-ff8b-4a4d-b39f-cc8f6dbc2088 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:52.674787 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e017083-ff8b-4a4d-b39f-cc8f6dbc2088 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:52.693225 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdcac32-5b8f-4ecc-aebc-318936d1b444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:52.694166 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcac32-5b8f-4ecc-aebc-318936d1b444 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:52.694631 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcac32-5b8f-4ecc-aebc-318936d1b444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:52.694923 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcac32-5b8f-4ecc-aebc-318936d1b444 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:52.696858 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdcac32-5b8f-4ecc-aebc-318936d1b444 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:06:52.697387 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdcac32-5b8f-4ecc-aebc-318936d1b444 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:52.700089 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdcac32-5b8f-4ecc-aebc-318936d1b444 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:52.769965 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a534688-a4c2-4e37-aa71-773212a19839 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:52.779762 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 843/1689] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:06:52.783731 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a534688-a4c2-4e37-aa71-773212a19839 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:52.810201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed13438-a12c-48bd-a814-a4918096f02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:52.811000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed13438-a12c-48bd-a814-a4918096f02c admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:52.812011 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed13438-a12c-48bd-a814-a4918096f02c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:52.812948 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed13438-a12c-48bd-a814-a4918096f02c admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:52.815053 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed13438-a12c-48bd-a814-a4918096f02c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:52.820018 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed13438-a12c-48bd-a814-a4918096f02c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:52.903707 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 847/1690] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:06:52 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:52.905419 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdcac32-5b8f-4ecc-aebc-318936d1b444 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:52.921647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdcac32-5b8f-4ecc-aebc-318936d1b444 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:53.085398 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:53.163761 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191a275-679f-4f97-8529-34aedf7d1b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:53.166330 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191a275-679f-4f97-8529-34aedf7d1b13 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:53.166733 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191a275-679f-4f97-8529-34aedf7d1b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:53.167052 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191a275-679f-4f97-8529-34aedf7d1b13 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:53.170168 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191a275-679f-4f97-8529-34aedf7d1b13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:53.173728 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191a275-679f-4f97-8529-34aedf7d1b13 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:53.243065 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 844/1691] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:06:52 2022] POST /identity/v3/users => generated 286 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:53.247229 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed13438-a12c-48bd-a814-a4918096f02c admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:53.263610 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed13438-a12c-48bd-a814-a4918096f02c admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:53.278428 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0417e2-a693-4c9d-a59f-816f37c102d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:53.279217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0417e2-a693-4c9d-a59f-816f37c102d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:53.279504 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0417e2-a693-4c9d-a59f-816f37c102d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:53.279778 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0417e2-a693-4c9d-a59f-816f37c102d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:53.284034 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0417e2-a693-4c9d-a59f-816f37c102d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:53.286028 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0417e2-a693-4c9d-a59f-816f37c102d4 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:53.348262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 848/1692] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:06:53.353247 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191a275-679f-4f97-8529-34aedf7d1b13 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:53.387488 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191a275-679f-4f97-8529-34aedf7d1b13 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:53.408107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e8616-015c-4054-8cd2-6b1b9cf0e0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:53.410236 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e8616-015c-4054-8cd2-6b1b9cf0e0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:53.410424 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e8616-015c-4054-8cd2-6b1b9cf0e0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:53.410771 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e8616-015c-4054-8cd2-6b1b9cf0e0f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:53.412249 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e8616-015c-4054-8cd2-6b1b9cf0e0f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:53.414786 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e8616-015c-4054-8cd2-6b1b9cf0e0f1 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:53.434864 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 845/1693] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:06:53.440857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0417e2-a693-4c9d-a59f-816f37c102d4 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:53.472358 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0417e2-a693-4c9d-a59f-816f37c102d4 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:53.478223 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848f957-9bee-405d-9852-34b0283cdcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:53.480060 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848f957-9bee-405d-9852-34b0283cdcab admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:53.480766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848f957-9bee-405d-9852-34b0283cdcab admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:53.481102 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848f957-9bee-405d-9852-34b0283cdcab admin admin] PATH_INFO: `/v3/projects/e6812b0c1bb046fdad4c9faad9d861dc/users/91df5b56520c4e90a96283ff0b8befd1/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:53.515493 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848f957-9bee-405d-9852-34b0283cdcab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6812b0c1bb046fdad4c9faad9d861dc, user_id=91df5b56520c4e90a96283ff0b8befd1, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:53.520141 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848f957-9bee-405d-9852-34b0283cdcab admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:53.569853 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 849/1694] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:06:53 2022] PUT /identity/v3/projects/e6812b0c1bb046fdad4c9faad9d861dc/users/91df5b56520c4e90a96283ff0b8befd1/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:06:53.582530 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cebb15-cb57-4c28-ab12-8e085568fce3 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:53.584081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cebb15-cb57-4c28-ab12-8e085568fce3 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:53.590588 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cebb15-cb57-4c28-ab12-8e085568fce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:53.667581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ff461-f311-403f-a8b7-c0472df75c77 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:53.668086 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ff461-f311-403f-a8b7-c0472df75c77 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:53.668086 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ff461-f311-403f-a8b7-c0472df75c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:53.713568 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-88cebb15-cb57-4c28-ab12-8e085568fce3 None None] MFA Rules not processed for user `91df5b56520c4e90a96283ff0b8befd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:53.714867 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-88cebb15-cb57-4c28-ab12-8e085568fce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:53.777454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-f08ff461-f311-403f-a8b7-c0472df75c77 None None] MFA Rules not processed for user `d20d381f9231454cb27a575538d652ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:53.785988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f08ff461-f311-403f-a8b7-c0472df75c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:53.883071 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 846/1695] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:53.887828 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cebb15-cb57-4c28-ab12-8e085568fce3 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:53.889630 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-88cebb15-cb57-4c28-ab12-8e085568fce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:54.055794 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cebb15-cb57-4c28-ab12-8e085568fce3 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:54.058126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 850/1696] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:54.059320 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ff461-f311-403f-a8b7-c0472df75c77 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:54.079915 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b0863-6f0a-41b6-a0e4-ccc434b5c7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:54.081636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b0863-6f0a-41b6-a0e4-ccc434b5c7c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:54.083275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b0863-6f0a-41b6-a0e4-ccc434b5c7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:54.084761 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b0863-6f0a-41b6-a0e4-ccc434b5c7c6 admin admin] PATH_INFO: `/v3/projects/81c85a559398411aa82e31206a8bc24a` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:54.088472 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b0863-6f0a-41b6-a0e4-ccc434b5c7c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81c85a559398411aa82e31206a8bc24a)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:54.090986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b0863-6f0a-41b6-a0e4-ccc434b5c7c6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:54.095422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ff461-f311-403f-a8b7-c0472df75c77 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:54.122800 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9eb6c-3f0d-4ed1-8000-5ddbacd48870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:54.128854 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9eb6c-3f0d-4ed1-8000-5ddbacd48870 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:54.129361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9eb6c-3f0d-4ed1-8000-5ddbacd48870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:54.130178 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9eb6c-3f0d-4ed1-8000-5ddbacd48870 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:54.133314 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9eb6c-3f0d-4ed1-8000-5ddbacd48870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:54.140281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9eb6c-3f0d-4ed1-8000-5ddbacd48870 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:54.221472 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 851/1697] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:06:54 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:54.222177 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9eb6c-3f0d-4ed1-8000-5ddbacd48870 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:54.229315 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-bcc9eb6c-3f0d-4ed1-8000-5ddbacd48870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:54.273519 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9f0b0863-6f0a-41b6-a0e4-ccc434b5c7c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81c85a559398411aa82e31206a8bc24a', 'request_id': 'req-9f0b0863-6f0a-41b6-a0e4-ccc434b5c7c6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:54.279499 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:54.290262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:54.293787 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9f0b0863-6f0a-41b6-a0e4-ccc434b5c7c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81c85a559398411aa82e31206a8bc24a', 'request_id': 'req-9f0b0863-6f0a-41b6-a0e4-ccc434b5c7c6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:54.309893 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9f0b0863-6f0a-41b6-a0e4-ccc434b5c7c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81c85a559398411aa82e31206a8bc24a', 'request_id': 'req-9f0b0863-6f0a-41b6-a0e4-ccc434b5c7c6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:54.355093 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9f0b0863-6f0a-41b6-a0e4-ccc434b5c7c6 admin admin] The token cache is being invalidate because project 81c85a559398411aa82e31206a8bc24a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:06:54.355389 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9f0b0863-6f0a-41b6-a0e4-ccc434b5c7c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:54.356789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9f0b0863-6f0a-41b6-a0e4-ccc434b5c7c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:54.358598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9eb6c-3f0d-4ed1-8000-5ddbacd48870 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:54.359399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 847/1698] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:06:53 2022] DELETE /identity/v3/projects/81c85a559398411aa82e31206a8bc24a => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:06:54.360106 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b0863-6f0a-41b6-a0e4-ccc434b5c7c6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:54.368743 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9f0b0863-6f0a-41b6-a0e4-ccc434b5c7c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:54.458518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc367bff-beaa-4147-8a45-ab72080ed3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:54.459944 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc367bff-beaa-4147-8a45-ab72080ed3cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:54.460544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc367bff-beaa-4147-8a45-ab72080ed3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:54.461053 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc367bff-beaa-4147-8a45-ab72080ed3cb admin admin] PATH_INFO: `/v3/projects/00e6a8214f7c474eb66250c458500762` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:54.462721 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc367bff-beaa-4147-8a45-ab72080ed3cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=00e6a8214f7c474eb66250c458500762)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:54.465467 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc367bff-beaa-4147-8a45-ab72080ed3cb admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:54.549429 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-fc367bff-beaa-4147-8a45-ab72080ed3cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00e6a8214f7c474eb66250c458500762', 'request_id': 'req-fc367bff-beaa-4147-8a45-ab72080ed3cb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:54.558938 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-fc367bff-beaa-4147-8a45-ab72080ed3cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00e6a8214f7c474eb66250c458500762', 'request_id': 'req-fc367bff-beaa-4147-8a45-ab72080ed3cb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:54.560173 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b0863-6f0a-41b6-a0e4-ccc434b5c7c6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:54.567057 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-fc367bff-beaa-4147-8a45-ab72080ed3cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00e6a8214f7c474eb66250c458500762', 'request_id': 'req-fc367bff-beaa-4147-8a45-ab72080ed3cb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:54.604618 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-fc367bff-beaa-4147-8a45-ab72080ed3cb admin admin] The token cache is being invalidate because project 00e6a8214f7c474eb66250c458500762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:06:54.604913 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-fc367bff-beaa-4147-8a45-ab72080ed3cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:54.609335 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-fc367bff-beaa-4147-8a45-ab72080ed3cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:54.611949 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 852/1699] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:06:54 2022] DELETE /identity/v3/projects/00e6a8214f7c474eb66250c458500762 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:06:54.612949 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc367bff-beaa-4147-8a45-ab72080ed3cb admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:54.614380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-fc367bff-beaa-4147-8a45-ab72080ed3cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:54.748183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206454c0-07d4-4fbd-a758-86954c8b8e24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:54.748954 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206454c0-07d4-4fbd-a758-86954c8b8e24 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:54.749245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206454c0-07d4-4fbd-a758-86954c8b8e24 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:54.752367 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206454c0-07d4-4fbd-a758-86954c8b8e24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:54.762741 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:54.764152 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-206454c0-07d4-4fbd-a758-86954c8b8e24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:54.787381 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc367bff-beaa-4147-8a45-ab72080ed3cb admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:54.803538 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b630b-4a94-4adf-9f35-a5adef2651b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:54.804187 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b630b-4a94-4adf-9f35-a5adef2651b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:54.804497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b630b-4a94-4adf-9f35-a5adef2651b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:54.804776 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b630b-4a94-4adf-9f35-a5adef2651b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:54.805538 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b630b-4a94-4adf-9f35-a5adef2651b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:54.807596 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b630b-4a94-4adf-9f35-a5adef2651b6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:54.860190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 853/1700] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:06:54 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:54.868177 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca53e0-ea8e-42f0-91be-9b38f6cc2e08 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:54.869091 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca53e0-ea8e-42f0-91be-9b38f6cc2e08 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:54.870305 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca53e0-ea8e-42f0-91be-9b38f6cc2e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:54.911744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-52ca53e0-ea8e-42f0-91be-9b38f6cc2e08 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:54.915233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-52ca53e0-ea8e-42f0-91be-9b38f6cc2e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:54.948802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 854/1701] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:54.952362 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca53e0-ea8e-42f0-91be-9b38f6cc2e08 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:54.957856 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-52ca53e0-ea8e-42f0-91be-9b38f6cc2e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:54.976319 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206454c0-07d4-4fbd-a758-86954c8b8e24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:54.978091 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206454c0-07d4-4fbd-a758-86954c8b8e24 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:55.005674 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca53e0-ea8e-42f0-91be-9b38f6cc2e08 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:55.032807 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc743e-ccf1-4f6c-8945-150262043376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:55.033668 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 848/1702] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:06:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:06:55.034798 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206454c0-07d4-4fbd-a758-86954c8b8e24 service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:55.036688 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc743e-ccf1-4f6c-8945-150262043376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:55.036989 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc743e-ccf1-4f6c-8945-150262043376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:55.037357 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc743e-ccf1-4f6c-8945-150262043376 admin admin] PATH_INFO: `/v3/users/d9a9445f43514634af40092e2ce39519` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:55.047625 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc743e-ccf1-4f6c-8945-150262043376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9a9445f43514634af40092e2ce39519)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:55.060517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc743e-ccf1-4f6c-8945-150262043376 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:55.087716 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206454c0-07d4-4fbd-a758-86954c8b8e24 service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:55.106244 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb5618-1ef5-44b1-8b84-e593aaba7138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:55.106786 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb5618-1ef5-44b1-8b84-e593aaba7138 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:55.112262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb5618-1ef5-44b1-8b84-e593aaba7138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:55.113261 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb5618-1ef5-44b1-8b84-e593aaba7138 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:55.114944 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb5618-1ef5-44b1-8b84-e593aaba7138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:55.129187 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb5618-1ef5-44b1-8b84-e593aaba7138 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:55.168861 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 849/1703] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:06:55.174510 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261a726-b7db-40de-8c0a-cf0520a9f3f0 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:55.175973 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261a726-b7db-40de-8c0a-cf0520a9f3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:55.177078 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261a726-b7db-40de-8c0a-cf0520a9f3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:55.193194 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:55.245798 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-d261a726-b7db-40de-8c0a-cf0520a9f3f0 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:55.247275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d261a726-b7db-40de-8c0a-cf0520a9f3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:55.258982 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 850/1704] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:55.263579 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261a726-b7db-40de-8c0a-cf0520a9f3f0 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:55.267734 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cebc743e-ccf1-4f6c-8945-150262043376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9a9445f43514634af40092e2ce39519'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:55.276455 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261a726-b7db-40de-8c0a-cf0520a9f3f0 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:55.283022 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb81cd1-f8d4-4825-912b-823f817c28b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:55.284246 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb81cd1-f8d4-4825-912b-823f817c28b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:55.284745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb81cd1-f8d4-4825-912b-823f817c28b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:55.285163 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb81cd1-f8d4-4825-912b-823f817c28b2 admin admin] PATH_INFO: `/v3/projects/69481cbdff9645118721703123e183e5/users/867f1dee8f3745b0aece30b8eba163e6/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:55.297480 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cebc743e-ccf1-4f6c-8945-150262043376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9a9445f43514634af40092e2ce39519'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:55.300805 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cebc743e-ccf1-4f6c-8945-150262043376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9a9445f43514634af40092e2ce39519'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:55.321149 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb81cd1-f8d4-4825-912b-823f817c28b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69481cbdff9645118721703123e183e5, user_id=867f1dee8f3745b0aece30b8eba163e6, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:55.330198 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb81cd1-f8d4-4825-912b-823f817c28b2 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:55.348862 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cebc743e-ccf1-4f6c-8945-150262043376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9a9445f43514634af40092e2ce39519'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:55.375672 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 851/1705] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:06:55 2022] PUT /identity/v3/projects/69481cbdff9645118721703123e183e5/users/867f1dee8f3745b0aece30b8eba163e6/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:06:55.377174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb81cd1-f8d4-4825-912b-823f817c28b2 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:55.388771 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5bb81cd1-f8d4-4825-912b-823f817c28b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:55.389421 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cebc743e-ccf1-4f6c-8945-150262043376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9a9445f43514634af40092e2ce39519'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:55.421846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 855/1706] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:06:54 2022] DELETE /identity/v3/users/d9a9445f43514634af40092e2ce39519 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:06:55.435007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc743e-ccf1-4f6c-8945-150262043376 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:55.443654 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cebc743e-ccf1-4f6c-8945-150262043376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:55.695129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc743e-ccf1-4f6c-8945-150262043376 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:55.703482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81a07f-69a1-41e3-ba5b-69474f257ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:55.705250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81a07f-69a1-41e3-ba5b-69474f257ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:55.706506 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81a07f-69a1-41e3-ba5b-69474f257ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:55.706968 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81a07f-69a1-41e3-ba5b-69474f257ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:55.708323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81a07f-69a1-41e3-ba5b-69474f257ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:55.710880 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81a07f-69a1-41e3-ba5b-69474f257ac5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:55.735269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 856/1707] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:06:55.736933 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81a07f-69a1-41e3-ba5b-69474f257ac5 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:55.738193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb81cd1-f8d4-4825-912b-823f817c28b2 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:55.739045 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-fe81a07f-69a1-41e3-ba5b-69474f257ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:55.756366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5cc4e-2d42-4155-bd00-5a876942395d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:55.757192 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5cc4e-2d42-4155-bd00-5a876942395d admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:55.757492 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5cc4e-2d42-4155-bd00-5a876942395d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:55.757773 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5cc4e-2d42-4155-bd00-5a876942395d admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:55.758532 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb5cc4e-2d42-4155-bd00-5a876942395d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:06:55.758898 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb5cc4e-2d42-4155-bd00-5a876942395d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:55.759058 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81a07f-69a1-41e3-ba5b-69474f257ac5 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:55.760636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb5cc4e-2d42-4155-bd00-5a876942395d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:55.766270 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee81bd2-6d72-471d-8347-0a1ebd772ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:55.768685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee81bd2-6d72-471d-8347-0a1ebd772ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:55.769016 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee81bd2-6d72-471d-8347-0a1ebd772ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:55.769633 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee81bd2-6d72-471d-8347-0a1ebd772ffd admin admin] PATH_INFO: `/v3/projects/755f180bb9124c2b9e937c46bdd9a7d0` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:55.770934 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee81bd2-6d72-471d-8347-0a1ebd772ffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=755f180bb9124c2b9e937c46bdd9a7d0)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:55.773083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee81bd2-6d72-471d-8347-0a1ebd772ffd admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:55.810052 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 852/1708] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:06:55.810052 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5cc4e-2d42-4155-bd00-5a876942395d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:55.852657 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5cc4e-2d42-4155-bd00-5a876942395d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:55.853690 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=83,keystone:INSERT=4,keystone:DELETE=13 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:55.885451 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cee81bd2-6d72-471d-8347-0a1ebd772ffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '755f180bb9124c2b9e937c46bdd9a7d0', 'request_id': 'req-cee81bd2-6d72-471d-8347-0a1ebd772ffd'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:55.906309 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cee81bd2-6d72-471d-8347-0a1ebd772ffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '755f180bb9124c2b9e937c46bdd9a7d0', 'request_id': 'req-cee81bd2-6d72-471d-8347-0a1ebd772ffd'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:55.923614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cee81bd2-6d72-471d-8347-0a1ebd772ffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '755f180bb9124c2b9e937c46bdd9a7d0', 'request_id': 'req-cee81bd2-6d72-471d-8347-0a1ebd772ffd'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:55.952887 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cee81bd2-6d72-471d-8347-0a1ebd772ffd admin admin] The token cache is being invalidate because project 755f180bb9124c2b9e937c46bdd9a7d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:06:55.953897 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cee81bd2-6d72-471d-8347-0a1ebd772ffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:55.956357 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cee81bd2-6d72-471d-8347-0a1ebd772ffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:55.959335 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 857/1709] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:06:55 2022] DELETE /identity/v3/projects/755f180bb9124c2b9e937c46bdd9a7d0 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:06:55.960701 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee81bd2-6d72-471d-8347-0a1ebd772ffd admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:55.964987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cee81bd2-6d72-471d-8347-0a1ebd772ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:56.027532 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c4325-f7a1-4d73-89ec-b6f82057f5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:56.028657 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c4325-f7a1-4d73-89ec-b6f82057f5cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:56.028951 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c4325-f7a1-4d73-89ec-b6f82057f5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:56.029235 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c4325-f7a1-4d73-89ec-b6f82057f5cc admin admin] PATH_INFO: `/v3/projects/69481cbdff9645118721703123e183e5/users/867f1dee8f3745b0aece30b8eba163e6/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:56.037394 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c4325-f7a1-4d73-89ec-b6f82057f5cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=69481cbdff9645118721703123e183e5, user_id=867f1dee8f3745b0aece30b8eba163e6, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:56.047012 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c4325-f7a1-4d73-89ec-b6f82057f5cc admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:56.104960 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 853/1710] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:06:55 2022] PUT /identity/v3/projects/69481cbdff9645118721703123e183e5/users/867f1dee8f3745b0aece30b8eba163e6/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:06:56.105977 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c4325-f7a1-4d73-89ec-b6f82057f5cc admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:56.117728 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8d5c4325-f7a1-4d73-89ec-b6f82057f5cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:56.223455 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee81bd2-6d72-471d-8347-0a1ebd772ffd admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:56.365835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7b061-558d-40e6-b7f6-6b426343f5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:56.369324 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7b061-558d-40e6-b7f6-6b426343f5f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:56.369628 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7b061-558d-40e6-b7f6-6b426343f5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:56.370030 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7b061-558d-40e6-b7f6-6b426343f5f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:56.370806 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7b061-558d-40e6-b7f6-6b426343f5f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:56.379794 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7b061-558d-40e6-b7f6-6b426343f5f1 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:56.404644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c4325-f7a1-4d73-89ec-b6f82057f5cc admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:56.427368 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcc02d-d6be-42fc-9527-21c74f2b971e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:56.430200 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcc02d-d6be-42fc-9527-21c74f2b971e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:56.431563 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcc02d-d6be-42fc-9527-21c74f2b971e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:56.431866 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcc02d-d6be-42fc-9527-21c74f2b971e admin admin] PATH_INFO: `/v3/users/5027b02f0d0e4113987488bb94bb3a97` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:56.436442 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 858/1711] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:06:55 2022] POST /identity/v3/projects => generated 405 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:56.438122 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd7f46-085a-4c4e-aaf6-7849968e738b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:56.438463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd7f46-085a-4c4e-aaf6-7849968e738b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:56.438745 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd7f46-085a-4c4e-aaf6-7849968e738b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:56.441209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcc02d-d6be-42fc-9527-21c74f2b971e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5027b02f0d0e4113987488bb94bb3a97)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:56.445755 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcc02d-d6be-42fc-9527-21c74f2b971e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:56.452500 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:56.501728 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-3ccd7f46-085a-4c4e-aaf6-7849968e738b None None] MFA Rules not processed for user `867f1dee8f3745b0aece30b8eba163e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:56.503625 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3ccd7f46-085a-4c4e-aaf6-7849968e738b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:56.608275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d0bcc02d-d6be-42fc-9527-21c74f2b971e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5027b02f0d0e4113987488bb94bb3a97'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:56.625359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:56.629929 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d0bcc02d-d6be-42fc-9527-21c74f2b971e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5027b02f0d0e4113987488bb94bb3a97'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:56.691985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d0bcc02d-d6be-42fc-9527-21c74f2b971e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5027b02f0d0e4113987488bb94bb3a97'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:56.696420 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d0bcc02d-d6be-42fc-9527-21c74f2b971e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5027b02f0d0e4113987488bb94bb3a97'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:56.697218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d0bcc02d-d6be-42fc-9527-21c74f2b971e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5027b02f0d0e4113987488bb94bb3a97'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:56.709602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 859/1712] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:56.710585 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd7f46-085a-4c4e-aaf6-7849968e738b None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:56.775507 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 854/1713] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:06:56 2022] DELETE /identity/v3/users/5027b02f0d0e4113987488bb94bb3a97 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:06:56.779032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcc02d-d6be-42fc-9527-21c74f2b971e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:56.786189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d0bcc02d-d6be-42fc-9527-21c74f2b971e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:56.895179 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd7f46-085a-4c4e-aaf6-7849968e738b None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:56.986245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcc02d-d6be-42fc-9527-21c74f2b971e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:57.005458 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b20312-fa4c-49ed-bcdd-8e77cecc1a37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:57.006619 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b20312-fa4c-49ed-bcdd-8e77cecc1a37 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:57.007189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b20312-fa4c-49ed-bcdd-8e77cecc1a37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:57.007746 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b20312-fa4c-49ed-bcdd-8e77cecc1a37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:57.011140 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b2b20312-fa4c-49ed-bcdd-8e77cecc1a37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:57.080687 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd866471-6ab9-45da-acf3-e24ed1db8cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:57.081402 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd866471-6ab9-45da-acf3-e24ed1db8cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:57.081695 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd866471-6ab9-45da-acf3-e24ed1db8cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:57.081979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd866471-6ab9-45da-acf3-e24ed1db8cc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:57.082725 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd866471-6ab9-45da-acf3-e24ed1db8cc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:57.084833 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd866471-6ab9-45da-acf3-e24ed1db8cc0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:57.135334 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 860/1714] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:06:56 2022] POST /identity/v3/users => generated 303 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:57.136352 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd866471-6ab9-45da-acf3-e24ed1db8cc0 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:57.145357 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-fd866471-6ab9-45da-acf3-e24ed1db8cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:57.184714 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd866471-6ab9-45da-acf3-e24ed1db8cc0 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:57.201445 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7b1fc-cea4-4836-bcbd-78fedc366b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:57.202465 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7b1fc-cea4-4836-bcbd-78fedc366b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:57.202755 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7b1fc-cea4-4836-bcbd-78fedc366b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:57.203035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7b1fc-cea4-4836-bcbd-78fedc366b3f admin admin] PATH_INFO: `/v3/projects/ff4c3ef6e6f1453b8883456ca5351665` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:57.208253 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7b1fc-cea4-4836-bcbd-78fedc366b3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff4c3ef6e6f1453b8883456ca5351665)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:57.210253 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7b1fc-cea4-4836-bcbd-78fedc366b3f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:57.220733 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b20312-fa4c-49ed-bcdd-8e77cecc1a37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:57.228746 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b20312-fa4c-49ed-bcdd-8e77cecc1a37 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:57.287174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 855/1715] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:06:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:06:57.288904 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b20312-fa4c-49ed-bcdd-8e77cecc1a37 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:57.294515 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b2b20312-fa4c-49ed-bcdd-8e77cecc1a37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:57.325867 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b20312-fa4c-49ed-bcdd-8e77cecc1a37 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:57.337478 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff5dbd-6ee3-4cec-b713-c76b7605bc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:57.338976 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff5dbd-6ee3-4cec-b713-c76b7605bc44 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:57.339527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff5dbd-6ee3-4cec-b713-c76b7605bc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:57.340057 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff5dbd-6ee3-4cec-b713-c76b7605bc44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:57.341082 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff5dbd-6ee3-4cec-b713-c76b7605bc44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:57.343149 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff5dbd-6ee3-4cec-b713-c76b7605bc44 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:57.379173 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 856/1716] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:06:57.384562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0c5c7-ee42-48f5-b4d3-79a71fff0e07 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:57.384993 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0c5c7-ee42-48f5-b4d3-79a71fff0e07 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:57.385372 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0c5c7-ee42-48f5-b4d3-79a71fff0e07 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:57.389880 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 857/1717] 10.222.0.35 () {54 vars in 921 bytes} [Thu May 19 22:06:57 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:06:57.391195 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0c5c7-ee42-48f5-b4d3-79a71fff0e07 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:57.461144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-37e7b1fc-cea4-4836-bcbd-78fedc366b3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff4c3ef6e6f1453b8883456ca5351665', 'request_id': 'req-37e7b1fc-cea4-4836-bcbd-78fedc366b3f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:57.484308 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-37e7b1fc-cea4-4836-bcbd-78fedc366b3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff4c3ef6e6f1453b8883456ca5351665', 'request_id': 'req-37e7b1fc-cea4-4836-bcbd-78fedc366b3f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:57.496621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:57.508469 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-37e7b1fc-cea4-4836-bcbd-78fedc366b3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff4c3ef6e6f1453b8883456ca5351665', 'request_id': 'req-37e7b1fc-cea4-4836-bcbd-78fedc366b3f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:57.556057 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-37e7b1fc-cea4-4836-bcbd-78fedc366b3f admin admin] The token cache is being invalidate because project ff4c3ef6e6f1453b8883456ca5351665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:06:57.556057 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-37e7b1fc-cea4-4836-bcbd-78fedc366b3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:57.556454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-37e7b1fc-cea4-4836-bcbd-78fedc366b3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:57.560608 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 861/1718] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:06:57 2022] DELETE /identity/v3/projects/ff4c3ef6e6f1453b8883456ca5351665 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:06:57.565645 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064cbae-950a-496f-b470-32d7f1da7a8b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:57.566015 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064cbae-950a-496f-b470-32d7f1da7a8b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:57.566316 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064cbae-950a-496f-b470-32d7f1da7a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:57.609514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:57.643993 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e064cbae-950a-496f-b470-32d7f1da7a8b None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:57.645842 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e064cbae-950a-496f-b470-32d7f1da7a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:57.670998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 862/1719] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:06:57.672864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2c46c-ae31-43e6-8158-40e8e39da6f3 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:57.672864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2c46c-ae31-43e6-8158-40e8e39da6f3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:57.673670 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2c46c-ae31-43e6-8158-40e8e39da6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:57.693848 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0c5c7-ee42-48f5-b4d3-79a71fff0e07 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:57.713479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753c27c-b90d-4ca0-b30a-1a76ab4030f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:57.714314 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753c27c-b90d-4ca0-b30a-1a76ab4030f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:57.714714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753c27c-b90d-4ca0-b30a-1a76ab4030f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:57.715101 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753c27c-b90d-4ca0-b30a-1a76ab4030f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:57.715994 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753c27c-b90d-4ca0-b30a-1a76ab4030f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:57.719026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753c27c-b90d-4ca0-b30a-1a76ab4030f7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:57.739937 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 858/1720] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:06:57.741577 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799cc5f-75ea-4e39-ba68-72b124896e2c None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:57.741986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799cc5f-75ea-4e39-ba68-72b124896e2c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:57.742516 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799cc5f-75ea-4e39-ba68-72b124896e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:57.836790 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-2799cc5f-75ea-4e39-ba68-72b124896e2c None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:57.844821 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2799cc5f-75ea-4e39-ba68-72b124896e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:57.886374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 859/1721] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:57.887418 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799cc5f-75ea-4e39-ba68-72b124896e2c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:57.893741 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2799cc5f-75ea-4e39-ba68-72b124896e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:57.915684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799cc5f-75ea-4e39-ba68-72b124896e2c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:57.937448 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a698b3-111e-4556-b12f-c842a8ed4ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:57.941115 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a698b3-111e-4556-b12f-c842a8ed4ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:57.941394 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a698b3-111e-4556-b12f-c842a8ed4ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:57.941885 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a698b3-111e-4556-b12f-c842a8ed4ce0 admin admin] PATH_INFO: `/v3/projects/9fad83e743434930ae53c74a5d7c0248/users/317e502f0c06467eadecc7d5caaa3503/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:57.974048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a698b3-111e-4556-b12f-c842a8ed4ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fad83e743434930ae53c74a5d7c0248, user_id=317e502f0c06467eadecc7d5caaa3503, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:57.984791 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a698b3-111e-4556-b12f-c842a8ed4ce0 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:58.026899 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 860/1722] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:06:57 2022] PUT /identity/v3/projects/9fad83e743434930ae53c74a5d7c0248/users/317e502f0c06467eadecc7d5caaa3503/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:06:58.029446 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a698b3-111e-4556-b12f-c842a8ed4ce0 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:58.171310 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a3a2c46c-ae31-43e6-8158-40e8e39da6f3 None None] MFA Rules not processed for user `902ca8f1d59547a0ab187b4748311f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:58.176010 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a3a2c46c-ae31-43e6-8158-40e8e39da6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:58.179462 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a698b3-111e-4556-b12f-c842a8ed4ce0 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:58.193230 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f1121-26b9-498a-89ab-c2657fbd9d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:58.193923 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f1121-26b9-498a-89ab-c2657fbd9d9f admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:58.194250 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f1121-26b9-498a-89ab-c2657fbd9d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:58.194681 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f1121-26b9-498a-89ab-c2657fbd9d9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:58.203123 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f1121-26b9-498a-89ab-c2657fbd9d9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:06:58.203123 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f1121-26b9-498a-89ab-c2657fbd9d9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:58.205280 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f1121-26b9-498a-89ab-c2657fbd9d9f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:58.245164 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 861/1723] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:06:58.256424 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed017e4c-99ce-4b17-a0ce-91dd90798237 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:58.256875 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed017e4c-99ce-4b17-a0ce-91dd90798237 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:58.257039 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed017e4c-99ce-4b17-a0ce-91dd90798237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:58.411501 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 863/1724] 10.222.0.35 () {58 vars in 1018 bytes} [Thu May 19 22:06:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 740 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:58.412652 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2c46c-ae31-43e6-8158-40e8e39da6f3 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:58.414536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-ed017e4c-99ce-4b17-a0ce-91dd90798237 None None] MFA Rules not processed for user `317e502f0c06467eadecc7d5caaa3503`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:58.416835 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ed017e4c-99ce-4b17-a0ce-91dd90798237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:58.424642 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2c46c-ae31-43e6-8158-40e8e39da6f3 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:58.429805 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703cf7b-f7c5-47c6-b5fe-e431a58c74c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:58.430671 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703cf7b-f7c5-47c6-b5fe-e431a58c74c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:58.431735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703cf7b-f7c5-47c6-b5fe-e431a58c74c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:58.432710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703cf7b-f7c5-47c6-b5fe-e431a58c74c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:58.433679 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703cf7b-f7c5-47c6-b5fe-e431a58c74c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:58.436229 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703cf7b-f7c5-47c6-b5fe-e431a58c74c1 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:58.473569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 864/1725] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:06:58 2022] POST /identity/v3/projects => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:58.479366 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703cf7b-f7c5-47c6-b5fe-e431a58c74c1 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:58.486603 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2703cf7b-f7c5-47c6-b5fe-e431a58c74c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:58.610111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 862/1726] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:58 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:58.610111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed017e4c-99ce-4b17-a0ce-91dd90798237 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:58.635029 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed017e4c-99ce-4b17-a0ce-91dd90798237 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:58.646955 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:58.695986 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703cf7b-f7c5-47c6-b5fe-e431a58c74c1 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:58.712201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1b843-4981-4943-a68e-713066b2d0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:58.714429 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1b843-4981-4943-a68e-713066b2d0b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:58.715029 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1b843-4981-4943-a68e-713066b2d0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:58.715483 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1b843-4981-4943-a68e-713066b2d0b3 admin admin] PATH_INFO: `/v3/users/91df5b56520c4e90a96283ff0b8befd1` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:58.717226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1b843-4981-4943-a68e-713066b2d0b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91df5b56520c4e90a96283ff0b8befd1)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:58.732898 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1b843-4981-4943-a68e-713066b2d0b3 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:58.781738 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf580d9-eb95-48fd-8eb2-510d6cd4f876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:58.784785 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf580d9-eb95-48fd-8eb2-510d6cd4f876 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:58.785077 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf580d9-eb95-48fd-8eb2-510d6cd4f876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:58.785362 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf580d9-eb95-48fd-8eb2-510d6cd4f876 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:58.786088 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf580d9-eb95-48fd-8eb2-510d6cd4f876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:58.788098 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf580d9-eb95-48fd-8eb2-510d6cd4f876 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:58.849288 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ecb1b843-4981-4943-a68e-713066b2d0b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91df5b56520c4e90a96283ff0b8befd1'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:58.863867 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 863/1727] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:06:58 2022] POST /identity/v3/users => generated 284 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:58.865914 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf580d9-eb95-48fd-8eb2-510d6cd4f876 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:58.871351 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-eaf580d9-eb95-48fd-8eb2-510d6cd4f876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:58.875732 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ecb1b843-4981-4943-a68e-713066b2d0b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91df5b56520c4e90a96283ff0b8befd1'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:58.876982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ecb1b843-4981-4943-a68e-713066b2d0b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91df5b56520c4e90a96283ff0b8befd1'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:58.906165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:58.915742 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ecb1b843-4981-4943-a68e-713066b2d0b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91df5b56520c4e90a96283ff0b8befd1'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:58.936036 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ecb1b843-4981-4943-a68e-713066b2d0b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91df5b56520c4e90a96283ff0b8befd1'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:58.947854 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 865/1728] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:06:58 2022] DELETE /identity/v3/users/91df5b56520c4e90a96283ff0b8befd1 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:06:58.947854 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1b843-4981-4943-a68e-713066b2d0b3 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:58.949517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ecb1b843-4981-4943-a68e-713066b2d0b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:59.062055 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1b843-4981-4943-a68e-713066b2d0b3 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:59.074155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf580d9-eb95-48fd-8eb2-510d6cd4f876 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:59.079737 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebac5af-0712-461a-ab4c-e33355cbf4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:59.098142 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebac5af-0712-461a-ab4c-e33355cbf4fc admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:59.098479 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebac5af-0712-461a-ab4c-e33355cbf4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:59.098808 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebac5af-0712-461a-ab4c-e33355cbf4fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:59.104841 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebac5af-0712-461a-ab4c-e33355cbf4fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:59.107533 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebac5af-0712-461a-ab4c-e33355cbf4fc admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:59.161341 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 866/1729] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:06:58 2022] POST /identity/v3/projects => generated 403 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:59.164187 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebac5af-0712-461a-ab4c-e33355cbf4fc admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:59.171928 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9ebac5af-0712-461a-ab4c-e33355cbf4fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:59.216597 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d651d0-fc8a-48e2-9ba9-0b3a2a82945d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:59.219209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d651d0-fc8a-48e2-9ba9-0b3a2a82945d service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:59.219497 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d651d0-fc8a-48e2-9ba9-0b3a2a82945d service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:59.219772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d651d0-fc8a-48e2-9ba9-0b3a2a82945d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:59.226942 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c4d651d0-fc8a-48e2-9ba9-0b3a2a82945d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:59.259209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d651d0-fc8a-48e2-9ba9-0b3a2a82945d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:59.264854 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d651d0-fc8a-48e2-9ba9-0b3a2a82945d service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:59.313172 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 864/1730] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:06:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:06:59.319350 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca23d5-1522-419b-875c-aae0f9aec48b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:59.324454 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca23d5-1522-419b-875c-aae0f9aec48b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:59.326099 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca23d5-1522-419b-875c-aae0f9aec48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:59.419818 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-beca23d5-1522-419b-875c-aae0f9aec48b None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:06:59.419818 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-beca23d5-1522-419b-875c-aae0f9aec48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:59.439149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebac5af-0712-461a-ab4c-e33355cbf4fc admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:59.446871 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec2d7a-49a0-4684-a49b-ba18fe78fd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:59.447717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec2d7a-49a0-4684-a49b-ba18fe78fd4b admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:59.448074 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec2d7a-49a0-4684-a49b-ba18fe78fd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:59.448639 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec2d7a-49a0-4684-a49b-ba18fe78fd4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:59.449618 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec2d7a-49a0-4684-a49b-ba18fe78fd4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:59.451633 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec2d7a-49a0-4684-a49b-ba18fe78fd4b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:59.455818 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 865/1731] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:06:59.456860 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca23d5-1522-419b-875c-aae0f9aec48b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:59.470937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 867/1732] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:06:59.476438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec2d7a-49a0-4684-a49b-ba18fe78fd4b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:59.491660 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca23d5-1522-419b-875c-aae0f9aec48b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:59.494711 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec2d7a-49a0-4684-a49b-ba18fe78fd4b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:59.502762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0115c-9434-49af-9dbb-e9515af318bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:59.503862 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0115c-9434-49af-9dbb-e9515af318bc admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:59.504211 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0115c-9434-49af-9dbb-e9515af318bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:59.504828 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0115c-9434-49af-9dbb-e9515af318bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:59.506739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0115c-9434-49af-9dbb-e9515af318bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:59.507460 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca182ba1-a4c9-4081-b2b7-8480ea6919a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:59.508390 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca182ba1-a4c9-4081-b2b7-8480ea6919a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:59.509769 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0115c-9434-49af-9dbb-e9515af318bc admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:59.510335 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca182ba1-a4c9-4081-b2b7-8480ea6919a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:59.515978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca182ba1-a4c9-4081-b2b7-8480ea6919a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:59.517591 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca182ba1-a4c9-4081-b2b7-8480ea6919a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:59.522329 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca182ba1-a4c9-4081-b2b7-8480ea6919a6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:59.531374 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 868/1733] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:06:59.532732 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0115c-9434-49af-9dbb-e9515af318bc admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:59.545161 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0115c-9434-49af-9dbb-e9515af318bc admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:59.557062 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcf25b-0d29-407a-8106-3a5555d15f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:59.557062 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcf25b-0d29-407a-8106-3a5555d15f4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:59.557062 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcf25b-0d29-407a-8106-3a5555d15f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:59.557062 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcf25b-0d29-407a-8106-3a5555d15f4d admin admin] PATH_INFO: `/v3/projects/4b6d5f78e86c470b977d4caba29df4bc/users/3dbdcce3752945d58c716349f2907caa/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:59.578320 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:59.600985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 866/1734] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:06:59 2022] POST /identity/v3/users => generated 308 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:06:59.604313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca182ba1-a4c9-4081-b2b7-8480ea6919a6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:59.612859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdcf25b-0d29-407a-8106-3a5555d15f4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b6d5f78e86c470b977d4caba29df4bc, user_id=3dbdcce3752945d58c716349f2907caa, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:59.621606 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdcf25b-0d29-407a-8106-3a5555d15f4d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:59.634354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca182ba1-a4c9-4081-b2b7-8480ea6919a6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:59.650068 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05017b-48d3-4e6f-9704-a45a990eeccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:59.650068 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05017b-48d3-4e6f-9704-a45a990eeccf admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:59.650372 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05017b-48d3-4e6f-9704-a45a990eeccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:59.652929 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05017b-48d3-4e6f-9704-a45a990eeccf admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:59.653972 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05017b-48d3-4e6f-9704-a45a990eeccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:59.658009 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 869/1735] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:06:59 2022] PUT /identity/v3/projects/4b6d5f78e86c470b977d4caba29df4bc/users/3dbdcce3752945d58c716349f2907caa/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:06:59.670631 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05017b-48d3-4e6f-9704-a45a990eeccf admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:59.671549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcf25b-0d29-407a-8106-3a5555d15f4d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:59.674820 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7cdcf25b-0d29-407a-8106-3a5555d15f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:59.728952 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 867/1736] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:06:59.731716 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05017b-48d3-4e6f-9704-a45a990eeccf admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:06:59.732562 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:06:59.735986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8b05017b-48d3-4e6f-9704-a45a990eeccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:06:59.807629 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcf25b-0d29-407a-8106-3a5555d15f4d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:59.816192 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7904e-39d2-49f4-9efd-1ecc9be28d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:06:59.817749 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7904e-39d2-49f4-9efd-1ecc9be28d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:06:59.817930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7904e-39d2-49f4-9efd-1ecc9be28d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:06:59.818168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7904e-39d2-49f4-9efd-1ecc9be28d92 admin admin] PATH_INFO: `/v3/projects/aabd57f1d3e6449ea1ff0b53682f8aee` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:06:59.819536 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7904e-39d2-49f4-9efd-1ecc9be28d92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aabd57f1d3e6449ea1ff0b53682f8aee)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:06:59.836439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7904e-39d2-49f4-9efd-1ecc9be28d92 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:06:59.953709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-35d7904e-39d2-49f4-9efd-1ecc9be28d92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aabd57f1d3e6449ea1ff0b53682f8aee', 'request_id': 'req-35d7904e-39d2-49f4-9efd-1ecc9be28d92'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:59.954977 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05017b-48d3-4e6f-9704-a45a990eeccf admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:06:59.973850 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-35d7904e-39d2-49f4-9efd-1ecc9be28d92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aabd57f1d3e6449ea1ff0b53682f8aee', 'request_id': 'req-35d7904e-39d2-49f4-9efd-1ecc9be28d92'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:06:59.988353 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-35d7904e-39d2-49f4-9efd-1ecc9be28d92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aabd57f1d3e6449ea1ff0b53682f8aee', 'request_id': 'req-35d7904e-39d2-49f4-9efd-1ecc9be28d92'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:00.020232 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-35d7904e-39d2-49f4-9efd-1ecc9be28d92 admin admin] The token cache is being invalidate because project aabd57f1d3e6449ea1ff0b53682f8aee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:00.021949 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-35d7904e-39d2-49f4-9efd-1ecc9be28d92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:00.024859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-35d7904e-39d2-49f4-9efd-1ecc9be28d92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:00.028274 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 870/1737] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:06:59 2022] DELETE /identity/v3/projects/aabd57f1d3e6449ea1ff0b53682f8aee => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:00.029668 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f836f-8649-4fa6-87c9-f9d0716f11aa None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:00.029963 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f836f-8649-4fa6-87c9-f9d0716f11aa None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:00.030243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f836f-8649-4fa6-87c9-f9d0716f11aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:00.108586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-1b1f836f-8649-4fa6-87c9-f9d0716f11aa None None] MFA Rules not processed for user `3dbdcce3752945d58c716349f2907caa`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:00.111454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1b1f836f-8649-4fa6-87c9-f9d0716f11aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:00.134015 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b0a5f-2dd1-481a-a0ad-8d45b3e2773f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:00.137916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b0a5f-2dd1-481a-a0ad-8d45b3e2773f service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:00.138273 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b0a5f-2dd1-481a-a0ad-8d45b3e2773f service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:00.138552 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b0a5f-2dd1-481a-a0ad-8d45b3e2773f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:00.145108 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f18b0a5f-2dd1-481a-a0ad-8d45b3e2773f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:00.374257 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 871/1738] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:00.376949 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f836f-8649-4fa6-87c9-f9d0716f11aa None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:00.382555 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1b1f836f-8649-4fa6-87c9-f9d0716f11aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:00.397962 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b0a5f-2dd1-481a-a0ad-8d45b3e2773f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:00.399441 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b0a5f-2dd1-481a-a0ad-8d45b3e2773f service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:00.427020 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 868/1739] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:06:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:00.428615 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c500fbc-4956-4c4a-a2ca-c442307eb5ac None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:00.428909 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c500fbc-4956-4c4a-a2ca-c442307eb5ac None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:00.429200 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c500fbc-4956-4c4a-a2ca-c442307eb5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:00.433513 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f836f-8649-4fa6-87c9-f9d0716f11aa None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:00.443834 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b76fc-efe6-4f93-b33f-f73fe335904d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:00.446869 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b76fc-efe6-4f93-b33f-f73fe335904d admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:00.447196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b76fc-efe6-4f93-b33f-f73fe335904d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:00.447483 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b76fc-efe6-4f93-b33f-f73fe335904d admin admin] PATH_INFO: `/v3/projects/46434d2bebc4423881b7558e09258a9a/users/57e5780cad864c539ba77c831f784fb8/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:00.478708 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1c500fbc-4956-4c4a-a2ca-c442307eb5ac None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:00.479918 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1c500fbc-4956-4c4a-a2ca-c442307eb5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:00.493491 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b76fc-efe6-4f93-b33f-f73fe335904d admin admin] RBAC: Authorizing `identity:create_grant(project_id=46434d2bebc4423881b7558e09258a9a, user_id=57e5780cad864c539ba77c831f784fb8, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:00.507900 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 869/1740] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:00.508958 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c500fbc-4956-4c4a-a2ca-c442307eb5ac None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:00.510596 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b76fc-efe6-4f93-b33f-f73fe335904d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:00.514321 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1c500fbc-4956-4c4a-a2ca-c442307eb5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:00.549716 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 872/1741] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:00 2022] PUT /identity/v3/projects/46434d2bebc4423881b7558e09258a9a/users/57e5780cad864c539ba77c831f784fb8/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:00.551664 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a68ccf-fa82-4aef-96d2-4cf35bc750a6 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:00.552001 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a68ccf-fa82-4aef-96d2-4cf35bc750a6 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:00.553902 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a68ccf-fa82-4aef-96d2-4cf35bc750a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:00.557355 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c500fbc-4956-4c4a-a2ca-c442307eb5ac None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:00.610061 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-62a68ccf-fa82-4aef-96d2-4cf35bc750a6 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:00.618767 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-62a68ccf-fa82-4aef-96d2-4cf35bc750a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:00.682601 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:00.708491 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a644e2-1771-40a7-b7bd-761505b29709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:00.709194 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a644e2-1771-40a7-b7bd-761505b29709 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:00.709483 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a644e2-1771-40a7-b7bd-761505b29709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:00.709766 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a644e2-1771-40a7-b7bd-761505b29709 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:00.710462 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a644e2-1771-40a7-b7bd-761505b29709 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:00.713715 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:00.715850 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a644e2-1771-40a7-b7bd-761505b29709 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:00.777650 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 870/1742] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:00 2022] POST /identity/v3/projects => generated 369 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:00.778647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a644e2-1771-40a7-b7bd-761505b29709 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:00.846895 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 873/1743] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:00.851215 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a68ccf-fa82-4aef-96d2-4cf35bc750a6 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:00.884869 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a68ccf-fa82-4aef-96d2-4cf35bc750a6 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:00.944365 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a644e2-1771-40a7-b7bd-761505b29709 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:00.958776 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d49e4-66e0-466d-9e49-6fda9b3f72f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:00.959602 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d49e4-66e0-466d-9e49-6fda9b3f72f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:00.959858 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d49e4-66e0-466d-9e49-6fda9b3f72f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:00.960115 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d49e4-66e0-466d-9e49-6fda9b3f72f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:00.960788 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d49e4-66e0-466d-9e49-6fda9b3f72f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:00.962437 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d49e4-66e0-466d-9e49-6fda9b3f72f9 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:00.999129 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 871/1744] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:01.000205 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d49e4-66e0-466d-9e49-6fda9b3f72f9 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:01.012258 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d49e4-66e0-466d-9e49-6fda9b3f72f9 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:01.023855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448181c-07e0-4df3-a840-311a7f86c86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:01.024647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448181c-07e0-4df3-a840-311a7f86c86c admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:01.026710 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448181c-07e0-4df3-a840-311a7f86c86c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:01.026992 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448181c-07e0-4df3-a840-311a7f86c86c admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:01.027757 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448181c-07e0-4df3-a840-311a7f86c86c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:07:01.028073 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448181c-07e0-4df3-a840-311a7f86c86c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:01.029833 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448181c-07e0-4df3-a840-311a7f86c86c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:01.048339 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 872/1745] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:07:01.049283 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448181c-07e0-4df3-a840-311a7f86c86c admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:01.066932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448181c-07e0-4df3-a840-311a7f86c86c admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:01.067827 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08061314-72c0-4161-9083-9c824654254c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:01.068799 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08061314-72c0-4161-9083-9c824654254c admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:01.068947 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08061314-72c0-4161-9083-9c824654254c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:01.069225 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08061314-72c0-4161-9083-9c824654254c admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:01.069914 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08061314-72c0-4161-9083-9c824654254c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:01.072263 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fb99a-98e7-4525-8c52-6e781400fbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:01.073269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fb99a-98e7-4525-8c52-6e781400fbc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:01.073641 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fb99a-98e7-4525-8c52-6e781400fbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:01.073977 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fb99a-98e7-4525-8c52-6e781400fbc0 admin admin] PATH_INFO: `/v3/projects/46434d2bebc4423881b7558e09258a9a/users/57e5780cad864c539ba77c831f784fb8/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:01.076925 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fb99a-98e7-4525-8c52-6e781400fbc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46434d2bebc4423881b7558e09258a9a, user_id=57e5780cad864c539ba77c831f784fb8, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:01.077955 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08061314-72c0-4161-9083-9c824654254c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:01.084262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fb99a-98e7-4525-8c52-6e781400fbc0 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:01.132271 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 873/1746] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:01 2022] PUT /identity/v3/projects/46434d2bebc4423881b7558e09258a9a/users/57e5780cad864c539ba77c831f784fb8/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:01.133879 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fb99a-98e7-4525-8c52-6e781400fbc0 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:01.179380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 874/1747] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:00 2022] POST /identity/v3/users => generated 291 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:01.183504 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a75507-937c-4d4d-93bb-6e3abb72b2b4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:01.183672 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a75507-937c-4d4d-93bb-6e3abb72b2b4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:01.197410 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a75507-937c-4d4d-93bb-6e3abb72b2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:01.292030 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fb99a-98e7-4525-8c52-6e781400fbc0 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:01.304358 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f9d10-a161-4621-804c-e456289fd140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:01.305136 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f9d10-a161-4621-804c-e456289fd140 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:01.305392 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f9d10-a161-4621-804c-e456289fd140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:01.305665 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f9d10-a161-4621-804c-e456289fd140 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:01.306374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f9d10-a161-4621-804c-e456289fd140 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:01.308877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f9d10-a161-4621-804c-e456289fd140 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:01.362778 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-f3a75507-937c-4d4d-93bb-6e3abb72b2b4 None None] MFA Rules not processed for user `57e5780cad864c539ba77c831f784fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:01.364649 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f3a75507-937c-4d4d-93bb-6e3abb72b2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:01.405691 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 874/1748] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:01 2022] POST /identity/v3/projects => generated 385 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:01.406772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f9d10-a161-4621-804c-e456289fd140 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:01.458578 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:01.537375 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f9d10-a161-4621-804c-e456289fd140 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:01.546845 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa0a37-e353-48a5-9e1a-e76dd2509825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:01.548256 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa0a37-e353-48a5-9e1a-e76dd2509825 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:01.548715 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa0a37-e353-48a5-9e1a-e76dd2509825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:01.549149 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa0a37-e353-48a5-9e1a-e76dd2509825 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:01.550494 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa0a37-e353-48a5-9e1a-e76dd2509825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:01.552697 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa0a37-e353-48a5-9e1a-e76dd2509825 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:01.574339 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 875/1749] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:01.576223 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb68489-5263-4eee-8936-29ede595de9d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:01.585831 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb68489-5263-4eee-8936-29ede595de9d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:01.586528 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb68489-5263-4eee-8936-29ede595de9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:01.613889 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 875/1750] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:01 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:01.613889 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a75507-937c-4d4d-93bb-6e3abb72b2b4 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:01.618368 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-ccb68489-5263-4eee-8936-29ede595de9d None None] MFA Rules not processed for user `d20d381f9231454cb27a575538d652ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:01.620015 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ccb68489-5263-4eee-8936-29ede595de9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:01.643789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a75507-937c-4d4d-93bb-6e3abb72b2b4 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:01.653080 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214f065-90c8-453c-a041-2a0d5ecb533b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:01.653938 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214f065-90c8-453c-a041-2a0d5ecb533b admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:01.654227 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214f065-90c8-453c-a041-2a0d5ecb533b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:01.654621 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214f065-90c8-453c-a041-2a0d5ecb533b admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:01.657772 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a214f065-90c8-453c-a041-2a0d5ecb533b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:01.678447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a214f065-90c8-453c-a041-2a0d5ecb533b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:01.737991 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 876/1751] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:01 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:01.738632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 876/1752] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:01.739509 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb68489-5263-4eee-8936-29ede595de9d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:01.743923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214f065-90c8-453c-a041-2a0d5ecb533b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:01.773135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ccb68489-5263-4eee-8936-29ede595de9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:01.777251 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214f065-90c8-453c-a041-2a0d5ecb533b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:01.796094 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ad673-fb14-4aaf-8262-14a1b339d39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:01.799101 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ad673-fb14-4aaf-8262-14a1b339d39b admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:01.799659 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ad673-fb14-4aaf-8262-14a1b339d39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:01.800258 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ad673-fb14-4aaf-8262-14a1b339d39b admin admin] PATH_INFO: `/v3/projects/fa121f4f2f7045a1acb7e3b4770b9396/users/8c94c83a225e4e42afb846a2c8f8a552/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:01.871570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ad673-fb14-4aaf-8262-14a1b339d39b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa121f4f2f7045a1acb7e3b4770b9396, user_id=8c94c83a225e4e42afb846a2c8f8a552, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:01.879277 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ad673-fb14-4aaf-8262-14a1b339d39b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:01.915842 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 877/1753] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:01 2022] PUT /identity/v3/projects/fa121f4f2f7045a1acb7e3b4770b9396/users/8c94c83a225e4e42afb846a2c8f8a552/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:01.916751 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ad673-fb14-4aaf-8262-14a1b339d39b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:01.928073 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:01.955974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb68489-5263-4eee-8936-29ede595de9d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:02.035946 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00adf46-48ba-4e62-aef0-b7d444166619 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:02.036693 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00adf46-48ba-4e62-aef0-b7d444166619 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:02.037975 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00adf46-48ba-4e62-aef0-b7d444166619 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:02.037975 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00adf46-48ba-4e62-aef0-b7d444166619 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:02.107212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ad673-fb14-4aaf-8262-14a1b339d39b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:02.114175 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483e8d3-82c1-4770-9ff2-8160a40650cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:02.115459 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483e8d3-82c1-4770-9ff2-8160a40650cd admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:02.115832 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483e8d3-82c1-4770-9ff2-8160a40650cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:02.116295 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483e8d3-82c1-4770-9ff2-8160a40650cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:02.120664 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483e8d3-82c1-4770-9ff2-8160a40650cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:02.122533 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483e8d3-82c1-4770-9ff2-8160a40650cd admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:02.146305 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 878/1754] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:02.147221 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483e8d3-82c1-4770-9ff2-8160a40650cd admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:02.150715 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:02.174364 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483e8d3-82c1-4770-9ff2-8160a40650cd admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:02.186523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fca042-3c36-4825-9db4-eef2709b2c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:02.187220 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fca042-3c36-4825-9db4-eef2709b2c21 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:02.187506 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fca042-3c36-4825-9db4-eef2709b2c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:02.187791 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fca042-3c36-4825-9db4-eef2709b2c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:02.188826 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fca042-3c36-4825-9db4-eef2709b2c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:02.192222 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fca042-3c36-4825-9db4-eef2709b2c21 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:02.206369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00adf46-48ba-4e62-aef0-b7d444166619 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:02.207850 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00adf46-48ba-4e62-aef0-b7d444166619 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:02.222143 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 879/1755] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:02.222143 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88cd8d-8b7c-4b5f-875e-b25cec6e3a10 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:02.222143 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88cd8d-8b7c-4b5f-875e-b25cec6e3a10 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:02.222143 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88cd8d-8b7c-4b5f-875e-b25cec6e3a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:02.232871 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 877/1756] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:01 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:02.235174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00adf46-48ba-4e62-aef0-b7d444166619 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:02.261821 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00adf46-48ba-4e62-aef0-b7d444166619 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:02.274789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30793e-abd6-4ac8-8344-35cfe86be2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:02.275489 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30793e-abd6-4ac8-8344-35cfe86be2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:02.275842 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30793e-abd6-4ac8-8344-35cfe86be2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:02.276124 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30793e-abd6-4ac8-8344-35cfe86be2a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:02.276919 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30793e-abd6-4ac8-8344-35cfe86be2a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:02.279137 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30793e-abd6-4ac8-8344-35cfe86be2a0 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:02.285256 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-cc88cd8d-8b7c-4b5f-875e-b25cec6e3a10 None None] MFA Rules not processed for user `8bd7f018e42d45a5bea3c9ffaa567496`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:02.286518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cc88cd8d-8b7c-4b5f-875e-b25cec6e3a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:02.308577 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 878/1757] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:02.309590 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30793e-abd6-4ac8-8344-35cfe86be2a0 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:02.337861 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30793e-abd6-4ac8-8344-35cfe86be2a0 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:02.356626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2d73c-cd59-4209-a76f-8bf720790675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:02.357672 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2d73c-cd59-4209-a76f-8bf720790675 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:02.358311 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2d73c-cd59-4209-a76f-8bf720790675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:02.358613 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2d73c-cd59-4209-a76f-8bf720790675 admin admin] PATH_INFO: `/v3/projects/fa121f4f2f7045a1acb7e3b4770b9396/users/8c94c83a225e4e42afb846a2c8f8a552/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:02.386009 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2d73c-cd59-4209-a76f-8bf720790675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa121f4f2f7045a1acb7e3b4770b9396, user_id=8c94c83a225e4e42afb846a2c8f8a552, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:02.401582 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2d73c-cd59-4209-a76f-8bf720790675 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:02.451501 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 879/1758] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:02 2022] PUT /identity/v3/projects/fa121f4f2f7045a1acb7e3b4770b9396/users/8c94c83a225e4e42afb846a2c8f8a552/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:02.453067 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c30f4-8d5f-4403-95ff-dd9acdea86e3 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:02.453362 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c30f4-8d5f-4403-95ff-dd9acdea86e3 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:02.453666 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c30f4-8d5f-4403-95ff-dd9acdea86e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:02.501857 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8e9c30f4-8d5f-4403-95ff-dd9acdea86e3 None None] MFA Rules not processed for user `c9e6e9d4d6cb499cbd4c886534176b66`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:02.503550 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8e9c30f4-8d5f-4403-95ff-dd9acdea86e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:02.523059 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 880/1759] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:02.523059 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88cd8d-8b7c-4b5f-875e-b25cec6e3a10 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:02.541913 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88cd8d-8b7c-4b5f-875e-b25cec6e3a10 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:02.666402 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 880/1760] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:02.673460 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738d299-269e-4ace-a2da-3b0316724db4 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:02.673768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738d299-269e-4ace-a2da-3b0316724db4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:02.674055 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738d299-269e-4ace-a2da-3b0316724db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:02.730158 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4c68c-76df-45bd-bd30-2010ee976a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:02.730999 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4c68c-76df-45bd-bd30-2010ee976a10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:02.731287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4c68c-76df-45bd-bd30-2010ee976a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:02.731564 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4c68c-76df-45bd-bd30-2010ee976a10 admin admin] PATH_INFO: `/v3/projects/dbd24e8860e44b19871c0dd7f3ddaf65/users/aa38637798a7459dbbc84d798ae06316/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:02.746568 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3738d299-269e-4ace-a2da-3b0316724db4 None None] MFA Rules not processed for user `8c94c83a225e4e42afb846a2c8f8a552`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:02.748445 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3738d299-269e-4ace-a2da-3b0316724db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:02.761364 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a4c68c-76df-45bd-bd30-2010ee976a10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbd24e8860e44b19871c0dd7f3ddaf65, user_id=aa38637798a7459dbbc84d798ae06316, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:02.765060 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a4c68c-76df-45bd-bd30-2010ee976a10 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:02.780596 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:02.787532 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 881/1761] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:02 2022] PUT /identity/v3/projects/dbd24e8860e44b19871c0dd7f3ddaf65/users/aa38637798a7459dbbc84d798ae06316/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:02.788438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4c68c-76df-45bd-bd30-2010ee976a10 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:02.791223 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a1a4c68c-76df-45bd-bd30-2010ee976a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:02.877876 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 881/1762] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:02 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:02.879521 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738d299-269e-4ace-a2da-3b0316724db4 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:02.891709 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738d299-269e-4ace-a2da-3b0316724db4 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:02.906894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4c68c-76df-45bd-bd30-2010ee976a10 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:02.915354 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5ca34-703a-4705-b530-39bdb4a83f2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:02.916046 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5ca34-703a-4705-b530-39bdb4a83f2b service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:02.916502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5ca34-703a-4705-b530-39bdb4a83f2b service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:02.917614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5ca34-703a-4705-b530-39bdb4a83f2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:02.932281 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:02.997985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb5097-0cef-433b-8456-265bd4b849a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:02.999138 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5ca34-703a-4705-b530-39bdb4a83f2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:02.999411 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb5097-0cef-433b-8456-265bd4b849a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:02.999999 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb5097-0cef-433b-8456-265bd4b849a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:03.000520 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb5097-0cef-433b-8456-265bd4b849a2 admin admin] PATH_INFO: `/v3/users/317e502f0c06467eadecc7d5caaa3503` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:03.002275 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5ca34-703a-4705-b530-39bdb4a83f2b service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:03.004239 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb5097-0cef-433b-8456-265bd4b849a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=317e502f0c06467eadecc7d5caaa3503)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:03.006511 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb5097-0cef-433b-8456-265bd4b849a2 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:03.014505 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 882/1763] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:03.015482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5ca34-703a-4705-b530-39bdb4a83f2b service nova] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:03.017550 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6ce5ca34-703a-4705-b530-39bdb4a83f2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:03.036003 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5ca34-703a-4705-b530-39bdb4a83f2b service nova] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:03.042807 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6e9cb-2f7e-4bbb-b8ca-2f08f08d9884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:03.044569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6e9cb-2f7e-4bbb-b8ca-2f08f08d9884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:03.045113 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6e9cb-2f7e-4bbb-b8ca-2f08f08d9884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:03.045486 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6e9cb-2f7e-4bbb-b8ca-2f08f08d9884 admin admin] PATH_INFO: `/v3/projects/e6812b0c1bb046fdad4c9faad9d861dc` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:03.048108 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6e9cb-2f7e-4bbb-b8ca-2f08f08d9884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6812b0c1bb046fdad4c9faad9d861dc)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:03.050209 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6e9cb-2f7e-4bbb-b8ca-2f08f08d9884 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:03.105498 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6fbb5097-0cef-433b-8456-265bd4b849a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '317e502f0c06467eadecc7d5caaa3503'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:03.133755 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6fbb5097-0cef-433b-8456-265bd4b849a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '317e502f0c06467eadecc7d5caaa3503'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:03.149761 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-77c6e9cb-2f7e-4bbb-b8ca-2f08f08d9884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6812b0c1bb046fdad4c9faad9d861dc', 'request_id': 'req-77c6e9cb-2f7e-4bbb-b8ca-2f08f08d9884'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:03.169051 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6fbb5097-0cef-433b-8456-265bd4b849a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '317e502f0c06467eadecc7d5caaa3503'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:03.169805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6fbb5097-0cef-433b-8456-265bd4b849a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '317e502f0c06467eadecc7d5caaa3503'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:03.171155 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-77c6e9cb-2f7e-4bbb-b8ca-2f08f08d9884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6812b0c1bb046fdad4c9faad9d861dc', 'request_id': 'req-77c6e9cb-2f7e-4bbb-b8ca-2f08f08d9884'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:03.174117 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6fbb5097-0cef-433b-8456-265bd4b849a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '317e502f0c06467eadecc7d5caaa3503'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:03.188082 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-77c6e9cb-2f7e-4bbb-b8ca-2f08f08d9884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6812b0c1bb046fdad4c9faad9d861dc', 'request_id': 'req-77c6e9cb-2f7e-4bbb-b8ca-2f08f08d9884'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:03.228280 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 882/1764] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:02 2022] DELETE /identity/v3/users/317e502f0c06467eadecc7d5caaa3503 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:03.228280 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d7c80-1ff2-477b-804e-d16043371b52 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:03.232774 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d7c80-1ff2-477b-804e-d16043371b52 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:03.234769 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d7c80-1ff2-477b-804e-d16043371b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:03.241557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-77c6e9cb-2f7e-4bbb-b8ca-2f08f08d9884 admin admin] The token cache is being invalidate because project e6812b0c1bb046fdad4c9faad9d861dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:03.241859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-77c6e9cb-2f7e-4bbb-b8ca-2f08f08d9884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:03.244672 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-77c6e9cb-2f7e-4bbb-b8ca-2f08f08d9884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:03.246394 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 883/1765] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:03 2022] DELETE /identity/v3/projects/e6812b0c1bb046fdad4c9faad9d861dc => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:03.253616 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a3d55-6f52-4521-85cc-75a4ea2b4190 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:03.253895 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a3d55-6f52-4521-85cc-75a4ea2b4190 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:03.254105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a3d55-6f52-4521-85cc-75a4ea2b4190 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:03.264870 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 884/1766] 10.222.0.35 () {54 vars in 912 bytes} [Thu May 19 22:07:03 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:07:03.266326 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21db07-f783-49da-95c6-69363688dda4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:03.266770 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21db07-f783-49da-95c6-69363688dda4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:03.267052 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21db07-f783-49da-95c6-69363688dda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:03.289661 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6b5d7c80-1ff2-477b-804e-d16043371b52 None None] MFA Rules not processed for user `c9e6e9d4d6cb499cbd4c886534176b66`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:03.292084 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6b5d7c80-1ff2-477b-804e-d16043371b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:03.352912 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-3d21db07-f783-49da-95c6-69363688dda4 None None] MFA Rules not processed for user `aa38637798a7459dbbc84d798ae06316`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:03.354544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3d21db07-f783-49da-95c6-69363688dda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:03.376446 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:03.475879 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 883/1767] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:03.476913 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d7c80-1ff2-477b-804e-d16043371b52 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:03.478856 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6b5d7c80-1ff2-477b-804e-d16043371b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:03.530067 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 885/1768] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:03.532166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9bb47-5973-4540-b7fc-358925c1a21c None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:03.532782 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9bb47-5973-4540-b7fc-358925c1a21c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:03.533179 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9bb47-5973-4540-b7fc-358925c1a21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:03.555119 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-76d9bb47-5973-4540-b7fc-358925c1a21c None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:03.556567 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-76d9bb47-5973-4540-b7fc-358925c1a21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:03.615899 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:03.622575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d7c80-1ff2-477b-804e-d16043371b52 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:03.636633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5459a04-7ae4-4588-b656-1cd961031553 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:03.637320 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5459a04-7ae4-4588-b656-1cd961031553 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:03.637606 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5459a04-7ae4-4588-b656-1cd961031553 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:03.637886 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5459a04-7ae4-4588-b656-1cd961031553 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:03.641117 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f5459a04-7ae4-4588-b656-1cd961031553 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:03.662085 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 886/1769] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:03.663556 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9bb47-5973-4540-b7fc-358925c1a21c None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:03.674099 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-76d9bb47-5973-4540-b7fc-358925c1a21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:03.691497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9bb47-5973-4540-b7fc-358925c1a21c None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:03.698815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd971d6a-9ef4-4367-9729-f0c6867c9a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:03.705055 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd971d6a-9ef4-4367-9729-f0c6867c9a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:03.707066 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd971d6a-9ef4-4367-9729-f0c6867c9a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:03.708141 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd971d6a-9ef4-4367-9729-f0c6867c9a03 admin admin] PATH_INFO: `/v3/users/867f1dee8f3745b0aece30b8eba163e6` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:03.712572 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd971d6a-9ef4-4367-9729-f0c6867c9a03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=867f1dee8f3745b0aece30b8eba163e6)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:03.716366 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd971d6a-9ef4-4367-9729-f0c6867c9a03 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:03.792887 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5459a04-7ae4-4588-b656-1cd961031553 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:03.794652 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5459a04-7ae4-4588-b656-1cd961031553 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:03.815665 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 884/1770] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:03 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:03.817856 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76021190-5769-4176-a621-81da5e5b1bcd None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:03.817856 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76021190-5769-4176-a621-81da5e5b1bcd None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:03.817856 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76021190-5769-4176-a621-81da5e5b1bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:03.865342 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-76021190-5769-4176-a621-81da5e5b1bcd None None] MFA Rules not processed for user `a571d6fe63334552b532aae15299ef9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:03.866635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-76021190-5769-4176-a621-81da5e5b1bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:03.899977 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-fd971d6a-9ef4-4367-9729-f0c6867c9a03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '867f1dee8f3745b0aece30b8eba163e6'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:03.925269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-fd971d6a-9ef4-4367-9729-f0c6867c9a03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '867f1dee8f3745b0aece30b8eba163e6'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:03.927010 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-fd971d6a-9ef4-4367-9729-f0c6867c9a03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '867f1dee8f3745b0aece30b8eba163e6'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:03.948330 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-fd971d6a-9ef4-4367-9729-f0c6867c9a03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '867f1dee8f3745b0aece30b8eba163e6'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:03.979347 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-fd971d6a-9ef4-4367-9729-f0c6867c9a03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '867f1dee8f3745b0aece30b8eba163e6'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:03.989887 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 887/1771] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:03 2022] DELETE /identity/v3/users/867f1dee8f3745b0aece30b8eba163e6 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:03.991885 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd971d6a-9ef4-4367-9729-f0c6867c9a03 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:04.003106 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-fd971d6a-9ef4-4367-9729-f0c6867c9a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:04.023971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 885/1772] 10.222.0.35 () {58 vars in 1009 bytes} [Thu May 19 22:07:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:04.025006 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76021190-5769-4176-a621-81da5e5b1bcd None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:04.026447 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-76021190-5769-4176-a621-81da5e5b1bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:04.062250 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76021190-5769-4176-a621-81da5e5b1bcd None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:04.066878 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:04.179997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea2171-a274-4f1e-abed-52a0e77479d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:04.181012 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea2171-a274-4f1e-abed-52a0e77479d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:04.181413 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea2171-a274-4f1e-abed-52a0e77479d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:04.181791 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea2171-a274-4f1e-abed-52a0e77479d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:04.182586 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea2171-a274-4f1e-abed-52a0e77479d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:04.184851 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea2171-a274-4f1e-abed-52a0e77479d3 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:04.202994 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd971d6a-9ef4-4367-9729-f0c6867c9a03 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:04.216134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a04426-0034-453b-a9cd-d2f429c18d48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:04.217412 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a04426-0034-453b-a9cd-d2f429c18d48 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:04.218078 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a04426-0034-453b-a9cd-d2f429c18d48 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:04.218490 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a04426-0034-453b-a9cd-d2f429c18d48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:04.222468 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d8a04426-0034-453b-a9cd-d2f429c18d48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:04.246189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 886/1773] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:04 2022] POST /identity/v3/projects => generated 387 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:04.247372 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea2171-a274-4f1e-abed-52a0e77479d3 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:04.251906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9dea2171-a274-4f1e-abed-52a0e77479d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:04.356735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a04426-0034-453b-a9cd-d2f429c18d48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:04.357965 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a04426-0034-453b-a9cd-d2f429c18d48 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:04.406489 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 888/1774] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:04.408366 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a04426-0034-453b-a9cd-d2f429c18d48 service nova] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:04.418640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d8a04426-0034-453b-a9cd-d2f429c18d48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:04.429217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:04.530901 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea2171-a274-4f1e-abed-52a0e77479d3 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:04.547324 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e484b-40ad-4b87-970a-9582459b99c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:04.547324 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e484b-40ad-4b87-970a-9582459b99c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:04.547324 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e484b-40ad-4b87-970a-9582459b99c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:04.547324 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e484b-40ad-4b87-970a-9582459b99c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:04.550184 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f02e484b-40ad-4b87-970a-9582459b99c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:04.569224 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a04426-0034-453b-a9cd-d2f429c18d48 service nova] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:04.706602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33d63b-2f57-480b-88e2-7c9bee031121 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:04.709112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33d63b-2f57-480b-88e2-7c9bee031121 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:04.709505 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33d63b-2f57-480b-88e2-7c9bee031121 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:04.709892 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33d63b-2f57-480b-88e2-7c9bee031121 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:04.715664 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2d33d63b-2f57-480b-88e2-7c9bee031121 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:04.742478 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e484b-40ad-4b87-970a-9582459b99c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:04.744057 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e484b-40ad-4b87-970a-9582459b99c1 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:04.777890 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 887/1775] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:04.779057 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e484b-40ad-4b87-970a-9582459b99c1 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:04.781913 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f02e484b-40ad-4b87-970a-9582459b99c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:04.790852 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:04.808209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e484b-40ad-4b87-970a-9582459b99c1 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:04.821577 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a3865-6651-4216-bba3-54c8922424c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:04.822720 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a3865-6651-4216-bba3-54c8922424c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:04.823437 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a3865-6651-4216-bba3-54c8922424c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:04.823940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a3865-6651-4216-bba3-54c8922424c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:04.856214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a3865-6651-4216-bba3-54c8922424c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:04.858162 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a3865-6651-4216-bba3-54c8922424c8 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:04.881217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 888/1776] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:04.882220 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a3865-6651-4216-bba3-54c8922424c8 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:04.884702 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33d63b-2f57-480b-88e2-7c9bee031121 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:04.886706 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33d63b-2f57-480b-88e2-7c9bee031121 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:04.905565 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 889/1777] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:04 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:04.906320 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a3865-6651-4216-bba3-54c8922424c8 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:04.921844 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57dffc-5c79-4843-bf52-a29197cefe5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:04.921844 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57dffc-5c79-4843-bf52-a29197cefe5d admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:04.922349 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57dffc-5c79-4843-bf52-a29197cefe5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:04.922675 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57dffc-5c79-4843-bf52-a29197cefe5d admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:04.924129 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57dffc-5c79-4843-bf52-a29197cefe5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:04.926438 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57dffc-5c79-4843-bf52-a29197cefe5d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:04.995550 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33d63b-2f57-480b-88e2-7c9bee031121 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:04.999802 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 889/1778] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:04 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:05.020806 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33d63b-2f57-480b-88e2-7c9bee031121 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:05.029066 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b483c-1028-4f7d-8666-bcd5923603f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:05.031201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b483c-1028-4f7d-8666-bcd5923603f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:05.031201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b483c-1028-4f7d-8666-bcd5923603f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:05.031201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b483c-1028-4f7d-8666-bcd5923603f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:05.032489 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b483c-1028-4f7d-8666-bcd5923603f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:05.037161 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b483c-1028-4f7d-8666-bcd5923603f7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:05.057637 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 890/1779] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:05.064386 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57dffc-5c79-4843-bf52-a29197cefe5d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:05.112479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57dffc-5c79-4843-bf52-a29197cefe5d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:05.123591 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b60423-3bf9-40ed-93ea-eca79400dc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:05.125725 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b60423-3bf9-40ed-93ea-eca79400dc9a admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:05.128526 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b60423-3bf9-40ed-93ea-eca79400dc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:05.129049 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b60423-3bf9-40ed-93ea-eca79400dc9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:05.133536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b60423-3bf9-40ed-93ea-eca79400dc9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:05.137709 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b60423-3bf9-40ed-93ea-eca79400dc9a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:05.174710 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 890/1780] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:05.179299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b483c-1028-4f7d-8666-bcd5923603f7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:05.225749 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b483c-1028-4f7d-8666-bcd5923603f7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:05.248051 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad957b-140a-446e-a2e8-30737c75b883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:05.249632 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad957b-140a-446e-a2e8-30737c75b883 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:05.250132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad957b-140a-446e-a2e8-30737c75b883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:05.250621 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad957b-140a-446e-a2e8-30737c75b883 admin admin] PATH_INFO: `/v3/projects/31337418bf384126a682b85da6650da0/users/55c3133d2d984921955a41056788e87d/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:05.310591 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad957b-140a-446e-a2e8-30737c75b883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31337418bf384126a682b85da6650da0, user_id=55c3133d2d984921955a41056788e87d, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:05.321739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad957b-140a-446e-a2e8-30737c75b883 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:05.387972 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa4696-7ab9-4eca-bb71-334443006f2d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:05.388641 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa4696-7ab9-4eca-bb71-334443006f2d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:05.388641 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa4696-7ab9-4eca-bb71-334443006f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:05.392623 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 891/1781] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:05 2022] PUT /identity/v3/projects/31337418bf384126a682b85da6650da0/users/55c3133d2d984921955a41056788e87d/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:05.474412 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-37fa4696-7ab9-4eca-bb71-334443006f2d None None] MFA Rules not processed for user `55c3133d2d984921955a41056788e87d`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:05.476396 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-37fa4696-7ab9-4eca-bb71-334443006f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:05.644338 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad957b-140a-446e-a2e8-30737c75b883 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:05.654304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c9ad957b-140a-446e-a2e8-30737c75b883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:05.667842 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 891/1782] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:05.684007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa4696-7ab9-4eca-bb71-334443006f2d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:05.793439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:05.836882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad957b-140a-446e-a2e8-30737c75b883 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:05.854660 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62042a-2abe-4544-a95b-1462f5bf6031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:05.855209 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62042a-2abe-4544-a95b-1462f5bf6031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:05.855494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62042a-2abe-4544-a95b-1462f5bf6031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:05.855768 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62042a-2abe-4544-a95b-1462f5bf6031 admin admin] PATH_INFO: `/v3/projects/69481cbdff9645118721703123e183e5` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:05.861986 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab62042a-2abe-4544-a95b-1462f5bf6031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69481cbdff9645118721703123e183e5)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:05.863980 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab62042a-2abe-4544-a95b-1462f5bf6031 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:05.871059 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa4696-7ab9-4eca-bb71-334443006f2d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:05.884947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3c610-652d-4604-be67-a87eed9b6899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:05.885696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3c610-652d-4604-be67-a87eed9b6899 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:05.885983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3c610-652d-4604-be67-a87eed9b6899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:05.886266 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3c610-652d-4604-be67-a87eed9b6899 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:05.886974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3c610-652d-4604-be67-a87eed9b6899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:05.889006 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3c610-652d-4604-be67-a87eed9b6899 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:05.975632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 892/1783] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:05 2022] POST /identity/v3/projects => generated 387 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:05.979153 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3c610-652d-4604-be67-a87eed9b6899 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:06.042214 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ab62042a-2abe-4544-a95b-1462f5bf6031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69481cbdff9645118721703123e183e5', 'request_id': 'req-ab62042a-2abe-4544-a95b-1462f5bf6031'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:06.057527 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ab62042a-2abe-4544-a95b-1462f5bf6031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69481cbdff9645118721703123e183e5', 'request_id': 'req-ab62042a-2abe-4544-a95b-1462f5bf6031'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:06.068838 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ab62042a-2abe-4544-a95b-1462f5bf6031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69481cbdff9645118721703123e183e5', 'request_id': 'req-ab62042a-2abe-4544-a95b-1462f5bf6031'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:06.099493 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ab62042a-2abe-4544-a95b-1462f5bf6031 admin admin] The token cache is being invalidate because project 69481cbdff9645118721703123e183e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:06.099796 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ab62042a-2abe-4544-a95b-1462f5bf6031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:06.103137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ab62042a-2abe-4544-a95b-1462f5bf6031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:06.108046 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 892/1784] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:05 2022] DELETE /identity/v3/projects/69481cbdff9645118721703123e183e5 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:07:06.112779 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cad9c-f52c-4afa-81a9-8904da1431e4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:06.113250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cad9c-f52c-4afa-81a9-8904da1431e4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:06.113536 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cad9c-f52c-4afa-81a9-8904da1431e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:06.180834 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3c610-652d-4604-be67-a87eed9b6899 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:06.188005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd6a6f-1b1d-4ccd-ae33-e32dbc1b3564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:06.190117 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd6a6f-1b1d-4ccd-ae33-e32dbc1b3564 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:06.190935 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd6a6f-1b1d-4ccd-ae33-e32dbc1b3564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:06.191411 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd6a6f-1b1d-4ccd-ae33-e32dbc1b3564 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:06.192603 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd6a6f-1b1d-4ccd-ae33-e32dbc1b3564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:06.194465 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-772cad9c-f52c-4afa-81a9-8904da1431e4 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:06.195707 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-772cad9c-f52c-4afa-81a9-8904da1431e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:06.196103 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd6a6f-1b1d-4ccd-ae33-e32dbc1b3564 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:06.219942 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 893/1785] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:06.225507 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b926e-b220-4e54-bdb3-726370cb6ccf None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:06.225856 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b926e-b220-4e54-bdb3-726370cb6ccf None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:06.226113 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b926e-b220-4e54-bdb3-726370cb6ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:06.278416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 893/1786] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:05 2022] POST /identity/v3/users => generated 300 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:06.283658 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd6a6f-1b1d-4ccd-ae33-e32dbc1b3564 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:06.286600 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-584b926e-b220-4e54-bdb3-726370cb6ccf None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:06.288825 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-584b926e-b220-4e54-bdb3-726370cb6ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:06.290310 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-fdfd6a6f-1b1d-4ccd-ae33-e32dbc1b3564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:06.301948 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 894/1787] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:06.302976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b926e-b220-4e54-bdb3-726370cb6ccf None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:06.304483 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-584b926e-b220-4e54-bdb3-726370cb6ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:06.330462 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b926e-b220-4e54-bdb3-726370cb6ccf None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:06.333675 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd6a6f-1b1d-4ccd-ae33-e32dbc1b3564 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:06.336071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a909b84-f351-4973-bbca-0fcc4d39ca0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:06.340526 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a909b84-f351-4973-bbca-0fcc4d39ca0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:06.340526 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a909b84-f351-4973-bbca-0fcc4d39ca0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:06.340526 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a909b84-f351-4973-bbca-0fcc4d39ca0d admin admin] PATH_INFO: `/v3/projects/9fad83e743434930ae53c74a5d7c0248` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:06.346879 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a909b84-f351-4973-bbca-0fcc4d39ca0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fad83e743434930ae53c74a5d7c0248)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:06.350800 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a909b84-f351-4973-bbca-0fcc4d39ca0d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:06.356164 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad38701-93af-4d6a-bacf-7ac4af22a608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:06.357461 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad38701-93af-4d6a-bacf-7ac4af22a608 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:06.357760 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad38701-93af-4d6a-bacf-7ac4af22a608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:06.358046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad38701-93af-4d6a-bacf-7ac4af22a608 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:06.361638 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:06.362918 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad38701-93af-4d6a-bacf-7ac4af22a608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:06.369697 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad38701-93af-4d6a-bacf-7ac4af22a608 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:06.416655 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 894/1788] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:06.421795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad38701-93af-4d6a-bacf-7ac4af22a608 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:06.455228 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5a909b84-f351-4973-bbca-0fcc4d39ca0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fad83e743434930ae53c74a5d7c0248', 'request_id': 'req-5a909b84-f351-4973-bbca-0fcc4d39ca0d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:06.463006 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad38701-93af-4d6a-bacf-7ac4af22a608 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:06.472242 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5a909b84-f351-4973-bbca-0fcc4d39ca0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fad83e743434930ae53c74a5d7c0248', 'request_id': 'req-5a909b84-f351-4973-bbca-0fcc4d39ca0d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:06.480525 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5a909b84-f351-4973-bbca-0fcc4d39ca0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fad83e743434930ae53c74a5d7c0248', 'request_id': 'req-5a909b84-f351-4973-bbca-0fcc4d39ca0d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:06.508165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5a909b84-f351-4973-bbca-0fcc4d39ca0d admin admin] The token cache is being invalidate because project 9fad83e743434930ae53c74a5d7c0248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:06.508494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5a909b84-f351-4973-bbca-0fcc4d39ca0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:06.510323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5a909b84-f351-4973-bbca-0fcc4d39ca0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:06.512816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 895/1789] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:06 2022] DELETE /identity/v3/projects/9fad83e743434930ae53c74a5d7c0248 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:06.515639 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a909b84-f351-4973-bbca-0fcc4d39ca0d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:06.519884 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5a909b84-f351-4973-bbca-0fcc4d39ca0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:06.738414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a909b84-f351-4973-bbca-0fcc4d39ca0d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:06.756226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bbd27-041a-45c4-af19-d5bd8508caf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:06.757287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bbd27-041a-45c4-af19-d5bd8508caf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:06.757671 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bbd27-041a-45c4-af19-d5bd8508caf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:06.762648 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bbd27-041a-45c4-af19-d5bd8508caf2 admin admin] PATH_INFO: `/v3/projects/09b3e2630a254db4a083cbbbf666dc04/users/529402d779104aa0bcbdd35880e93fb7/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:06.819105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747bbd27-041a-45c4-af19-d5bd8508caf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09b3e2630a254db4a083cbbbf666dc04, user_id=529402d779104aa0bcbdd35880e93fb7, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:06.824797 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747bbd27-041a-45c4-af19-d5bd8508caf2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:06.878608 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 896/1790] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:06 2022] PUT /identity/v3/projects/09b3e2630a254db4a083cbbbf666dc04/users/529402d779104aa0bcbdd35880e93fb7/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:06.878608 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bbd27-041a-45c4-af19-d5bd8508caf2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:06.882443 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-747bbd27-041a-45c4-af19-d5bd8508caf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:06.982734 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b642a-5ef1-4c30-b0cf-89d0d5b44302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:06.983525 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b642a-5ef1-4c30-b0cf-89d0d5b44302 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:06.983806 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b642a-5ef1-4c30-b0cf-89d0d5b44302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:06.987562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b642a-5ef1-4c30-b0cf-89d0d5b44302 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:06.988371 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b642a-5ef1-4c30-b0cf-89d0d5b44302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:07:06.990473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b642a-5ef1-4c30-b0cf-89d0d5b44302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:06.994332 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b642a-5ef1-4c30-b0cf-89d0d5b44302 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:07.032659 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 895/1791] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 613 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:07:07.034827 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b57e3f-7c00-4181-b67a-6ed6e4c1326b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:07.035127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b57e3f-7c00-4181-b67a-6ed6e4c1326b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:07.035402 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b57e3f-7c00-4181-b67a-6ed6e4c1326b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:07.042040 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bbd27-041a-45c4-af19-d5bd8508caf2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:07.057129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67abd23-a4a8-4bd3-922a-4c98cc205f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:07.059257 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67abd23-a4a8-4bd3-922a-4c98cc205f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:07.060715 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67abd23-a4a8-4bd3-922a-4c98cc205f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:07.061477 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67abd23-a4a8-4bd3-922a-4c98cc205f9d admin admin] PATH_INFO: `/v3/users/57e5780cad864c539ba77c831f784fb8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:07.066924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67abd23-a4a8-4bd3-922a-4c98cc205f9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=57e5780cad864c539ba77c831f784fb8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:07.074835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67abd23-a4a8-4bd3-922a-4c98cc205f9d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:07.086254 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-85b57e3f-7c00-4181-b67a-6ed6e4c1326b None None] MFA Rules not processed for user `c9e6e9d4d6cb499cbd4c886534176b66`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:07.088359 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-85b57e3f-7c00-4181-b67a-6ed6e4c1326b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:07.122008 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:07.153834 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:07.213918 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 896/1792] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:07.215013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a67abd23-a4a8-4bd3-922a-4c98cc205f9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57e5780cad864c539ba77c831f784fb8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:07.215141 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b57e3f-7c00-4181-b67a-6ed6e4c1326b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:07.228601 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b57e3f-7c00-4181-b67a-6ed6e4c1326b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:07.236142 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcfe939-3911-4706-81c6-c60b23abf492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:07.237108 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfe939-3911-4706-81c6-c60b23abf492 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:07.237495 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfe939-3911-4706-81c6-c60b23abf492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:07.237873 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfe939-3911-4706-81c6-c60b23abf492 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:07.238885 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcfe939-3911-4706-81c6-c60b23abf492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:07.241446 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcfe939-3911-4706-81c6-c60b23abf492 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:07.245682 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a67abd23-a4a8-4bd3-922a-4c98cc205f9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57e5780cad864c539ba77c831f784fb8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:07.253308 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a67abd23-a4a8-4bd3-922a-4c98cc205f9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57e5780cad864c539ba77c831f784fb8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:07.257364 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 897/1793] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:07.260042 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcfe939-3911-4706-81c6-c60b23abf492 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:07.264379 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1dcfe939-3911-4706-81c6-c60b23abf492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:07.318980 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a67abd23-a4a8-4bd3-922a-4c98cc205f9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57e5780cad864c539ba77c831f784fb8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:07.335783 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a67abd23-a4a8-4bd3-922a-4c98cc205f9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57e5780cad864c539ba77c831f784fb8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:07.349871 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcfe939-3911-4706-81c6-c60b23abf492 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:07.351820 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 897/1794] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:06 2022] DELETE /identity/v3/users/57e5780cad864c539ba77c831f784fb8 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:07.353386 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67abd23-a4a8-4bd3-922a-4c98cc205f9d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:07.360083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a67abd23-a4a8-4bd3-922a-4c98cc205f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:07.480633 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67abd23-a4a8-4bd3-922a-4c98cc205f9d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:07.491475 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6d6ef-99ca-4f42-8412-55253310699f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:07.496097 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6d6ef-99ca-4f42-8412-55253310699f admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:07.496392 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6d6ef-99ca-4f42-8412-55253310699f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:07.496777 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6d6ef-99ca-4f42-8412-55253310699f admin admin] PATH_INFO: `/v3/projects/09b3e2630a254db4a083cbbbf666dc04/users/529402d779104aa0bcbdd35880e93fb7/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:07.504031 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6d6ef-99ca-4f42-8412-55253310699f admin admin] RBAC: Authorizing `identity:create_grant(project_id=09b3e2630a254db4a083cbbbf666dc04, user_id=529402d779104aa0bcbdd35880e93fb7, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:07.512645 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6d6ef-99ca-4f42-8412-55253310699f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:07.556675 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 898/1795] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:07 2022] PUT /identity/v3/projects/09b3e2630a254db4a083cbbbf666dc04/users/529402d779104aa0bcbdd35880e93fb7/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:07.558300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab115e4-faad-4253-89a2-520242ec4788 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:07.558770 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab115e4-faad-4253-89a2-520242ec4788 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:07.559057 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab115e4-faad-4253-89a2-520242ec4788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:07.578373 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce4a10-74d8-4176-a3a1-8e69ffb19e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:07.581943 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce4a10-74d8-4176-a3a1-8e69ffb19e1a admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:07.583167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce4a10-74d8-4176-a3a1-8e69ffb19e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:07.583737 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce4a10-74d8-4176-a3a1-8e69ffb19e1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:07.584749 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce4a10-74d8-4176-a3a1-8e69ffb19e1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:07.590137 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce4a10-74d8-4176-a3a1-8e69ffb19e1a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:07.679250 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 898/1796] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:07 2022] POST /identity/v3/projects => generated 363 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:07.684026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c7e66-ebec-43b5-82a9-7dd2525bda76 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:07.685007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c7e66-ebec-43b5-82a9-7dd2525bda76 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:07.686075 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c7e66-ebec-43b5-82a9-7dd2525bda76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:07.689768 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6ab115e4-faad-4253-89a2-520242ec4788 None None] MFA Rules not processed for user `529402d779104aa0bcbdd35880e93fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:07.697966 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6ab115e4-faad-4253-89a2-520242ec4788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:07.723939 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-919c7e66-ebec-43b5-82a9-7dd2525bda76 None None] MFA Rules not processed for user `8bd7f018e42d45a5bea3c9ffaa567496`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:07.725912 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-919c7e66-ebec-43b5-82a9-7dd2525bda76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:07.866704 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 899/1797] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:07.867704 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c7e66-ebec-43b5-82a9-7dd2525bda76 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:08.021462 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 899/1798] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:08.027072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab115e4-faad-4253-89a2-520242ec4788 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:08.030000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6ab115e4-faad-4253-89a2-520242ec4788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:08.055729 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:08.121152 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c7e66-ebec-43b5-82a9-7dd2525bda76 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:08.160198 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:08.168571 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a22197-4acc-4f08-a0ac-10b1efbd2a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:08.174281 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a22197-4acc-4f08-a0ac-10b1efbd2a13 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:08.174933 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a22197-4acc-4f08-a0ac-10b1efbd2a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:08.176014 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a22197-4acc-4f08-a0ac-10b1efbd2a13 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:08.186316 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a22197-4acc-4f08-a0ac-10b1efbd2a13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:08.198763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a22197-4acc-4f08-a0ac-10b1efbd2a13 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:08.290438 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 900/1799] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:07 2022] POST /identity/v3/users => generated 282 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:08.294413 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a22197-4acc-4f08-a0ac-10b1efbd2a13 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:08.321545 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a22197-4acc-4f08-a0ac-10b1efbd2a13 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:08.349910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570a1e2-82c9-49d6-9938-65e047458b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:08.352819 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570a1e2-82c9-49d6-9938-65e047458b80 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:08.353595 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570a1e2-82c9-49d6-9938-65e047458b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:08.353772 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab115e4-faad-4253-89a2-520242ec4788 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:08.354987 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570a1e2-82c9-49d6-9938-65e047458b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:08.355911 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570a1e2-82c9-49d6-9938-65e047458b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:08.359459 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570a1e2-82c9-49d6-9938-65e047458b80 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:08.369394 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8cabf-d068-499f-ac51-62752c995b17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:08.370896 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8cabf-d068-499f-ac51-62752c995b17 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:08.372274 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8cabf-d068-499f-ac51-62752c995b17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:08.372733 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8cabf-d068-499f-ac51-62752c995b17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:08.397456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 901/1800] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:08.399491 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570a1e2-82c9-49d6-9938-65e047458b80 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:08.399776 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b8cabf-d068-499f-ac51-62752c995b17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:08.401884 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b8cabf-d068-499f-ac51-62752c995b17 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:08.427099 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570a1e2-82c9-49d6-9938-65e047458b80 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:08.433961 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 900/1801] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:08.437399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7f552-3e36-4aef-8798-d798c3dfda3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:08.438923 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7f552-3e36-4aef-8798-d798c3dfda3a admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:08.440094 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7f552-3e36-4aef-8798-d798c3dfda3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:08.440851 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7f552-3e36-4aef-8798-d798c3dfda3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:08.442045 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7f552-3e36-4aef-8798-d798c3dfda3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:08.444180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7f552-3e36-4aef-8798-d798c3dfda3a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:08.465829 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8cabf-d068-499f-ac51-62752c995b17 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:08.473510 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 902/1802] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:08.481458 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8cabf-d068-499f-ac51-62752c995b17 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:08.492577 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d9cda-8b8d-4210-b40c-efb573c402b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:08.493859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d9cda-8b8d-4210-b40c-efb573c402b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:08.495656 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d9cda-8b8d-4210-b40c-efb573c402b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:08.496624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d9cda-8b8d-4210-b40c-efb573c402b5 admin admin] PATH_INFO: `/v3/projects/a3c6ea95e985490d90eb518e51800619/users/8000a906c6754f27a8bf115d7c2274b5/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:08.546431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d9cda-8b8d-4210-b40c-efb573c402b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3c6ea95e985490d90eb518e51800619, user_id=8000a906c6754f27a8bf115d7c2274b5, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:08.550669 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d9cda-8b8d-4210-b40c-efb573c402b5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:08.613547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ee1a5-86cb-4503-ab4e-4c6ab4e40798 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:08.614376 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ee1a5-86cb-4503-ab4e-4c6ab4e40798 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:08.614376 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ee1a5-86cb-4503-ab4e-4c6ab4e40798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:08.616561 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 901/1803] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:08 2022] PUT /identity/v3/projects/a3c6ea95e985490d90eb518e51800619/users/8000a906c6754f27a8bf115d7c2274b5/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:08.696495 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-d47ee1a5-86cb-4503-ab4e-4c6ab4e40798 None None] MFA Rules not processed for user `8000a906c6754f27a8bf115d7c2274b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:08.698248 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d47ee1a5-86cb-4503-ab4e-4c6ab4e40798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:08.905335 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 903/1804] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:08 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:08.906514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d9cda-8b8d-4210-b40c-efb573c402b5 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:08.915522 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ee1a5-86cb-4503-ab4e-4c6ab4e40798 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:08.916995 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d47ee1a5-86cb-4503-ab4e-4c6ab4e40798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:09.129838 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d9cda-8b8d-4210-b40c-efb573c402b5 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:09.133917 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ee1a5-86cb-4503-ab4e-4c6ab4e40798 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:09.150893 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681a45c-46e4-4b4f-891e-d32a8d01d0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:09.151897 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681a45c-46e4-4b4f-891e-d32a8d01d0a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:09.152788 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681a45c-46e4-4b4f-891e-d32a8d01d0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:09.153054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681a45c-46e4-4b4f-891e-d32a8d01d0a4 admin admin] PATH_INFO: `/v3/projects/46434d2bebc4423881b7558e09258a9a` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:09.160258 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681a45c-46e4-4b4f-891e-d32a8d01d0a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46434d2bebc4423881b7558e09258a9a)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:09.161113 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cfb81-bb15-4e0d-b2d6-904bc19394b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:09.162609 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cfb81-bb15-4e0d-b2d6-904bc19394b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:09.164867 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cfb81-bb15-4e0d-b2d6-904bc19394b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:09.165294 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cfb81-bb15-4e0d-b2d6-904bc19394b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:09.166416 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cfb81-bb15-4e0d-b2d6-904bc19394b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:09.170381 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681a45c-46e4-4b4f-891e-d32a8d01d0a4 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:09.170581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cfb81-bb15-4e0d-b2d6-904bc19394b8 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:09.261720 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 902/1805] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:08 2022] POST /identity/v3/projects => generated 363 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:09.267148 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cfb81-bb15-4e0d-b2d6-904bc19394b8 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:09.384647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9681a45c-46e4-4b4f-891e-d32a8d01d0a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46434d2bebc4423881b7558e09258a9a', 'request_id': 'req-9681a45c-46e4-4b4f-891e-d32a8d01d0a4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:09.389803 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:09.399211 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9681a45c-46e4-4b4f-891e-d32a8d01d0a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46434d2bebc4423881b7558e09258a9a', 'request_id': 'req-9681a45c-46e4-4b4f-891e-d32a8d01d0a4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:09.436798 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9681a45c-46e4-4b4f-891e-d32a8d01d0a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46434d2bebc4423881b7558e09258a9a', 'request_id': 'req-9681a45c-46e4-4b4f-891e-d32a8d01d0a4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:09.484672 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9681a45c-46e4-4b4f-891e-d32a8d01d0a4 admin admin] The token cache is being invalidate because project 46434d2bebc4423881b7558e09258a9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:09.485910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9681a45c-46e4-4b4f-891e-d32a8d01d0a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:09.489407 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9681a45c-46e4-4b4f-891e-d32a8d01d0a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:09.496285 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 904/1806] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:08 2022] DELETE /identity/v3/projects/46434d2bebc4423881b7558e09258a9a => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:09.504133 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d33794-b108-42de-8d6c-6b43749c8254 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:09.504378 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d33794-b108-42de-8d6c-6b43749c8254 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:09.504566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d33794-b108-42de-8d6c-6b43749c8254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:09.574527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c0d33794-b108-42de-8d6c-6b43749c8254 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:09.577814 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cfb81-bb15-4e0d-b2d6-904bc19394b8 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:09.580745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c0d33794-b108-42de-8d6c-6b43749c8254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:09.672370 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:09.840740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150b17c-973a-4a82-b052-769cfdb947f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:09.845344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150b17c-973a-4a82-b052-769cfdb947f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:09.846393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150b17c-973a-4a82-b052-769cfdb947f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:09.846660 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150b17c-973a-4a82-b052-769cfdb947f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:09.847421 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4150b17c-973a-4a82-b052-769cfdb947f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:09.849540 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4150b17c-973a-4a82-b052-769cfdb947f7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:09.855707 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 905/1807] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:09.868088 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a610d43-22a6-4fda-9269-6e0d6b1f5338 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:09.868362 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a610d43-22a6-4fda-9269-6e0d6b1f5338 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:09.868580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a610d43-22a6-4fda-9269-6e0d6b1f5338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:09.926729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 903/1808] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:09 2022] POST /identity/v3/users => generated 288 bytes in 661 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:09.933151 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150b17c-973a-4a82-b052-769cfdb947f7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:09.935116 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-4a610d43-22a6-4fda-9269-6e0d6b1f5338 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:09.942218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4a610d43-22a6-4fda-9269-6e0d6b1f5338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:09.944201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4150b17c-973a-4a82-b052-769cfdb947f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:09.987933 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 906/1809] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:09.992730 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a610d43-22a6-4fda-9269-6e0d6b1f5338 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:10.004392 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150b17c-973a-4a82-b052-769cfdb947f7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:10.021281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a0c83-7eb1-453f-a24e-3755b596c5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:10.022744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a0c83-7eb1-453f-a24e-3755b596c5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:10.024264 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a0c83-7eb1-453f-a24e-3755b596c5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:10.024866 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a0c83-7eb1-453f-a24e-3755b596c5c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:10.025373 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a610d43-22a6-4fda-9269-6e0d6b1f5338 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:10.028948 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a0c83-7eb1-453f-a24e-3755b596c5c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:10.035817 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a0c83-7eb1-453f-a24e-3755b596c5c1 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:10.045568 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb333f-6e2e-4323-bb55-f5c338f1429b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:10.047164 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb333f-6e2e-4323-bb55-f5c338f1429b admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:10.051464 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb333f-6e2e-4323-bb55-f5c338f1429b admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:10.056444 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb333f-6e2e-4323-bb55-f5c338f1429b admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:10.062064 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb333f-6e2e-4323-bb55-f5c338f1429b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:07:10.067123 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb333f-6e2e-4323-bb55-f5c338f1429b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:10.071736 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb333f-6e2e-4323-bb55-f5c338f1429b admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:10.090053 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 904/1810] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:10.090784 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a0c83-7eb1-453f-a24e-3755b596c5c1 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:10.093807 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-831a0c83-7eb1-453f-a24e-3755b596c5c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:10.120673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 907/1811] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 22:07:10.122946 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb333f-6e2e-4323-bb55-f5c338f1429b admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:10.153323 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb333f-6e2e-4323-bb55-f5c338f1429b admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:10.179183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e56530-8df9-4446-bd43-7d7764e4b930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:10.180264 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e56530-8df9-4446-bd43-7d7764e4b930 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:10.181417 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e56530-8df9-4446-bd43-7d7764e4b930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:10.181720 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e56530-8df9-4446-bd43-7d7764e4b930 admin admin] PATH_INFO: `/v3/projects/b1e6704fe36c46418341eb4eb1dea1be/users/585ba6d42f3143b0b9b2ea74c1a3838d/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:10.220587 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e56530-8df9-4446-bd43-7d7764e4b930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1e6704fe36c46418341eb4eb1dea1be, user_id=585ba6d42f3143b0b9b2ea74c1a3838d, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:10.226461 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e56530-8df9-4446-bd43-7d7764e4b930 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:10.258172 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 908/1812] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:10 2022] PUT /identity/v3/projects/b1e6704fe36c46418341eb4eb1dea1be/users/585ba6d42f3143b0b9b2ea74c1a3838d/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:10.262480 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a0c83-7eb1-453f-a24e-3755b596c5c1 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:10.263062 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e56530-8df9-4446-bd43-7d7764e4b930 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:10.395317 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e56530-8df9-4446-bd43-7d7764e4b930 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:10.408694 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11655d65-8395-4cab-841a-ca0cf01b9601 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:10.409640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11655d65-8395-4cab-841a-ca0cf01b9601 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:10.410082 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11655d65-8395-4cab-841a-ca0cf01b9601 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:10.410735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11655d65-8395-4cab-841a-ca0cf01b9601 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:10.411099 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbe632-ffd1-4694-b3c7-6eaa244f4290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:10.411919 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbe632-ffd1-4694-b3c7-6eaa244f4290 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:10.412223 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbe632-ffd1-4694-b3c7-6eaa244f4290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:10.413063 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbe632-ffd1-4694-b3c7-6eaa244f4290 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:10.413926 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-11655d65-8395-4cab-841a-ca0cf01b9601 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:10.414112 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbe632-ffd1-4694-b3c7-6eaa244f4290 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:10.423316 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbe632-ffd1-4694-b3c7-6eaa244f4290 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:10.484688 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 909/1813] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:10 2022] POST /identity/v3/projects => generated 355 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:10.488550 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbe632-ffd1-4694-b3c7-6eaa244f4290 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:10.522954 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11655d65-8395-4cab-841a-ca0cf01b9601 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:10.524769 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11655d65-8395-4cab-841a-ca0cf01b9601 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:10.531878 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:10.562360 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 905/1814] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:10.563498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11655d65-8395-4cab-841a-ca0cf01b9601 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:10.591640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11655d65-8395-4cab-841a-ca0cf01b9601 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:10.603272 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbe632-ffd1-4694-b3c7-6eaa244f4290 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:10.608499 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01534ad-1b6f-4663-90f5-cbee76f23e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:10.609960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01534ad-1b6f-4663-90f5-cbee76f23e00 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:10.610611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ad9a6-8895-42b4-be53-f8d5a64332bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:10.610822 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01534ad-1b6f-4663-90f5-cbee76f23e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:10.610822 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01534ad-1b6f-4663-90f5-cbee76f23e00 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:10.611776 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01534ad-1b6f-4663-90f5-cbee76f23e00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:10.611938 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ad9a6-8895-42b4-be53-f8d5a64332bb admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:10.612315 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ad9a6-8895-42b4-be53-f8d5a64332bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:10.612832 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ad9a6-8895-42b4-be53-f8d5a64332bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:10.613687 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ad9a6-8895-42b4-be53-f8d5a64332bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:10.616027 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ad9a6-8895-42b4-be53-f8d5a64332bb admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:10.617421 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01534ad-1b6f-4663-90f5-cbee76f23e00 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:10.634984 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 910/1815] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:10.635825 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ad9a6-8895-42b4-be53-f8d5a64332bb admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:10.639247 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6d6ad9a6-8895-42b4-be53-f8d5a64332bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:10.664944 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:10.675700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 906/1816] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:10 2022] POST /identity/v3/users => generated 278 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:10.677954 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01534ad-1b6f-4663-90f5-cbee76f23e00 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:10.682538 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ad9a6-8895-42b4-be53-f8d5a64332bb admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:10.692634 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01534ad-1b6f-4663-90f5-cbee76f23e00 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:10.698149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207f807-c4c9-4395-83d9-63b69a74c843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:10.699180 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207f807-c4c9-4395-83d9-63b69a74c843 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:10.699718 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207f807-c4c9-4395-83d9-63b69a74c843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:10.700484 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207f807-c4c9-4395-83d9-63b69a74c843 admin admin] PATH_INFO: `/v3/projects/b1e6704fe36c46418341eb4eb1dea1be/users/585ba6d42f3143b0b9b2ea74c1a3838d/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:10.702660 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4207f807-c4c9-4395-83d9-63b69a74c843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1e6704fe36c46418341eb4eb1dea1be, user_id=585ba6d42f3143b0b9b2ea74c1a3838d, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:10.706495 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4207f807-c4c9-4395-83d9-63b69a74c843 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:10.714688 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fae91-e9be-44ef-aa0f-783ba18e91b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:10.721233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 907/1817] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:10 2022] PUT /identity/v3/projects/b1e6704fe36c46418341eb4eb1dea1be/users/585ba6d42f3143b0b9b2ea74c1a3838d/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:10.722279 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207f807-c4c9-4395-83d9-63b69a74c843 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:10.722389 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fae91-e9be-44ef-aa0f-783ba18e91b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:10.726143 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fae91-e9be-44ef-aa0f-783ba18e91b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:10.726700 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fae91-e9be-44ef-aa0f-783ba18e91b8 admin admin] PATH_INFO: `/v3/users/3dbdcce3752945d58c716349f2907caa` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:10.729489 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fae91-e9be-44ef-aa0f-783ba18e91b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dbdcce3752945d58c716349f2907caa)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:10.735599 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fae91-e9be-44ef-aa0f-783ba18e91b8 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:10.853092 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207f807-c4c9-4395-83d9-63b69a74c843 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:10.886656 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319a153-0051-48c8-9d91-d525c44078c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:10.887288 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319a153-0051-48c8-9d91-d525c44078c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:10.887624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319a153-0051-48c8-9d91-d525c44078c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:10.887898 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319a153-0051-48c8-9d91-d525c44078c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:10.888959 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319a153-0051-48c8-9d91-d525c44078c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:10.890954 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319a153-0051-48c8-9d91-d525c44078c5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:10.899044 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4d1fae91-e9be-44ef-aa0f-783ba18e91b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dbdcce3752945d58c716349f2907caa'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:10.916363 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 908/1818] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:10.922683 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4d1fae91-e9be-44ef-aa0f-783ba18e91b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dbdcce3752945d58c716349f2907caa'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:10.928229 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061618d-f718-4d1f-b9fe-da673c2563c0 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:10.928376 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061618d-f718-4d1f-b9fe-da673c2563c0 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:10.928719 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061618d-f718-4d1f-b9fe-da673c2563c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:10.963564 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4d1fae91-e9be-44ef-aa0f-783ba18e91b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dbdcce3752945d58c716349f2907caa'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:10.967855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4d1fae91-e9be-44ef-aa0f-783ba18e91b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dbdcce3752945d58c716349f2907caa'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:10.968848 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4d1fae91-e9be-44ef-aa0f-783ba18e91b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dbdcce3752945d58c716349f2907caa'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:10.996720 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-7061618d-f718-4d1f-b9fe-da673c2563c0 None None] MFA Rules not processed for user `585ba6d42f3143b0b9b2ea74c1a3838d`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:10.997805 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7061618d-f718-4d1f-b9fe-da673c2563c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:11.015361 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 911/1819] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:10 2022] DELETE /identity/v3/users/3dbdcce3752945d58c716349f2907caa => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:11.018329 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fae91-e9be-44ef-aa0f-783ba18e91b8 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:11.021879 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4d1fae91-e9be-44ef-aa0f-783ba18e91b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:11.269022 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fae91-e9be-44ef-aa0f-783ba18e91b8 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:11.274453 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 909/1820] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:10 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:11.275277 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c03a1-cf8e-4956-99b5-9904e9686b9e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:11.275575 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c03a1-cf8e-4956-99b5-9904e9686b9e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:11.275855 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c03a1-cf8e-4956-99b5-9904e9686b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:11.298705 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda57c2-a424-4d0a-99d4-6bf62bf23d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:11.299526 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda57c2-a424-4d0a-99d4-6bf62bf23d64 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:11.299810 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda57c2-a424-4d0a-99d4-6bf62bf23d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:11.300088 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda57c2-a424-4d0a-99d4-6bf62bf23d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:11.305814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda57c2-a424-4d0a-99d4-6bf62bf23d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:11.307484 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda57c2-a424-4d0a-99d4-6bf62bf23d64 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:11.348202 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-b11c03a1-cf8e-4956-99b5-9904e9686b9e None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:11.351334 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 912/1821] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:11.355846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b11c03a1-cf8e-4956-99b5-9904e9686b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:11.364631 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda57c2-a424-4d0a-99d4-6bf62bf23d64 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:11.374399 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 910/1822] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:11.375465 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c03a1-cf8e-4956-99b5-9904e9686b9e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:11.379834 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-fcda57c2-a424-4d0a-99d4-6bf62bf23d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:11.390437 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c03a1-cf8e-4956-99b5-9904e9686b9e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:11.405117 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193602a7-6182-462a-9604-ab724e8ffca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:11.406457 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193602a7-6182-462a-9604-ab724e8ffca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:11.407265 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193602a7-6182-462a-9604-ab724e8ffca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:11.409135 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193602a7-6182-462a-9604-ab724e8ffca9 admin admin] PATH_INFO: `/v3/projects/4db7311081694a8b8481471e1e13efa1/users/acf607bd3eb246d19f688e98f21351f4/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:11.445443 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193602a7-6182-462a-9604-ab724e8ffca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4db7311081694a8b8481471e1e13efa1, user_id=acf607bd3eb246d19f688e98f21351f4, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:11.456126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193602a7-6182-462a-9604-ab724e8ffca9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:11.461218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:11.506439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 911/1823] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:11 2022] PUT /identity/v3/projects/4db7311081694a8b8481471e1e13efa1/users/acf607bd3eb246d19f688e98f21351f4/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:11.507927 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193602a7-6182-462a-9604-ab724e8ffca9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:11.514255 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-193602a7-6182-462a-9604-ab724e8ffca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:11.576104 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda57c2-a424-4d0a-99d4-6bf62bf23d64 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:11.605553 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:11.646633 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193602a7-6182-462a-9604-ab724e8ffca9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:11.652020 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66d518-18e1-4897-9448-8f301f981d46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:11.654457 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66d518-18e1-4897-9448-8f301f981d46 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:11.654457 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66d518-18e1-4897-9448-8f301f981d46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:11.654457 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66d518-18e1-4897-9448-8f301f981d46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:11.693815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e0320-d866-48f3-a827-2a3a68fe17f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:11.694080 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e0320-d866-48f3-a827-2a3a68fe17f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:11.694365 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e0320-d866-48f3-a827-2a3a68fe17f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:11.694644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e0320-d866-48f3-a827-2a3a68fe17f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:11.781040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e0320-d866-48f3-a827-2a3a68fe17f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:11.782938 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e0320-d866-48f3-a827-2a3a68fe17f4 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:11.794765 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 913/1824] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:11 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:11.796374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520fde8-c676-413c-be93-316cd5f8f039 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:11.796738 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520fde8-c676-413c-be93-316cd5f8f039 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:11.797001 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520fde8-c676-413c-be93-316cd5f8f039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:11.810675 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66d518-18e1-4897-9448-8f301f981d46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:11.815900 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66d518-18e1-4897-9448-8f301f981d46 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:11.848003 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 912/1825] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:11.861280 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7520fde8-c676-413c-be93-316cd5f8f039 None None] MFA Rules not processed for user `acf607bd3eb246d19f688e98f21351f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:11.862848 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7520fde8-c676-413c-be93-316cd5f8f039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:12.030672 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5da381-a968-4cb9-a8c6-b46c89a71497 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:12.033343 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5da381-a968-4cb9-a8c6-b46c89a71497 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:12.035573 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5da381-a968-4cb9-a8c6-b46c89a71497 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:12.043100 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 913/1826] 10.222.0.35 () {54 vars in 921 bytes} [Thu May 19 22:07:12 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:07:12.081528 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d02015-5c39-4682-9365-134aa6c3d066 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:12.081827 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d02015-5c39-4682-9365-134aa6c3d066 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:12.082114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d02015-5c39-4682-9365-134aa6c3d066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:12.112758 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 914/1827] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:11 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:12.113728 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520fde8-c676-413c-be93-316cd5f8f039 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:12.152564 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c4d02015-5c39-4682-9365-134aa6c3d066 None None] MFA Rules not processed for user `902ca8f1d59547a0ab187b4748311f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:12.155480 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c4d02015-5c39-4682-9365-134aa6c3d066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:12.168893 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520fde8-c676-413c-be93-316cd5f8f039 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:12.176189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5a470-baf1-46f5-b8a6-74c3425c221b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:12.176189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5a470-baf1-46f5-b8a6-74c3425c221b admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:12.176189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5a470-baf1-46f5-b8a6-74c3425c221b admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:12.176602 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5a470-baf1-46f5-b8a6-74c3425c221b admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:12.177090 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5a470-baf1-46f5-b8a6-74c3425c221b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:12.179200 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5a470-baf1-46f5-b8a6-74c3425c221b admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:12.231100 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:12.260552 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 915/1828] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:12 2022] POST /identity/v3/projects => generated 357 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:12.263823 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5a470-baf1-46f5-b8a6-74c3425c221b admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:12.411753 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 914/1829] 10.222.0.35 () {58 vars in 1018 bytes} [Thu May 19 22:07:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:12.513710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d02015-5c39-4682-9365-134aa6c3d066 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:12.515485 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c4d02015-5c39-4682-9365-134aa6c3d066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:12.521453 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5a470-baf1-46f5-b8a6-74c3425c221b admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:12.532192 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d02015-5c39-4682-9365-134aa6c3d066 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:12.559629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7f076-a8dd-43c7-9784-79d8bf32e8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:12.560586 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7f076-a8dd-43c7-9784-79d8bf32e8a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:12.560883 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7f076-a8dd-43c7-9784-79d8bf32e8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:12.561178 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7f076-a8dd-43c7-9784-79d8bf32e8a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:12.564680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd7f076-a8dd-43c7-9784-79d8bf32e8a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:12.570587 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd7f076-a8dd-43c7-9784-79d8bf32e8a6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:12.641073 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 916/1830] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:12 2022] POST /identity/v3/users => generated 285 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:12.643569 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7f076-a8dd-43c7-9784-79d8bf32e8a6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:12.645961 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9042fe-a530-4ea0-a9f7-c20e81f4bd83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:12.646749 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9042fe-a530-4ea0-a9f7-c20e81f4bd83 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:12.647138 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9042fe-a530-4ea0-a9f7-c20e81f4bd83 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:12.647517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9042fe-a530-4ea0-a9f7-c20e81f4bd83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:12.673777 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9042fe-a530-4ea0-a9f7-c20e81f4bd83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:12.675900 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9042fe-a530-4ea0-a9f7-c20e81f4bd83 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:12.676957 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7f076-a8dd-43c7-9784-79d8bf32e8a6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:12.696599 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac60fb0-3578-4d41-9b81-16346b7ed6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:12.698733 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac60fb0-3578-4d41-9b81-16346b7ed6ee admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:12.699031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac60fb0-3578-4d41-9b81-16346b7ed6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:12.699312 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac60fb0-3578-4d41-9b81-16346b7ed6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:12.705892 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac60fb0-3578-4d41-9b81-16346b7ed6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:12.709519 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac60fb0-3578-4d41-9b81-16346b7ed6ee admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:12.714715 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 915/1831] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:12.759053 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 917/1832] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:12.764321 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9042fe-a530-4ea0-a9f7-c20e81f4bd83 service nova] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:12.771464 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:12.790978 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9042fe-a530-4ea0-a9f7-c20e81f4bd83 service nova] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:12.805270 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0fc73-1fd8-4289-a492-1f484ae0b5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:12.806455 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0fc73-1fd8-4289-a492-1f484ae0b5c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:12.806903 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0fc73-1fd8-4289-a492-1f484ae0b5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:12.807384 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0fc73-1fd8-4289-a492-1f484ae0b5c6 admin admin] PATH_INFO: `/v3/projects/88ca4e008804492b9c2f4c43cc0cbe7f/users/cbdf3b0d41e24e3b9a3816e70ad73e7e/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:12.868544 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac60fb0-3578-4d41-9b81-16346b7ed6ee admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:12.870964 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4ac60fb0-3578-4d41-9b81-16346b7ed6ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:12.871688 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0fc73-1fd8-4289-a492-1f484ae0b5c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ca4e008804492b9c2f4c43cc0cbe7f, user_id=cbdf3b0d41e24e3b9a3816e70ad73e7e, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:12.886327 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0fc73-1fd8-4289-a492-1f484ae0b5c6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:12.895977 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac60fb0-3578-4d41-9b81-16346b7ed6ee admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:12.924221 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c34c88-9d92-4dfc-95da-d020035e55f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:12.930255 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c34c88-9d92-4dfc-95da-d020035e55f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:12.930545 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c34c88-9d92-4dfc-95da-d020035e55f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:12.930825 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c34c88-9d92-4dfc-95da-d020035e55f4 admin admin] PATH_INFO: `/v3/users/8000a906c6754f27a8bf115d7c2274b5` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:12.935101 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c34c88-9d92-4dfc-95da-d020035e55f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8000a906c6754f27a8bf115d7c2274b5)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:12.942360 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 916/1833] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:12 2022] PUT /identity/v3/projects/88ca4e008804492b9c2f4c43cc0cbe7f/users/cbdf3b0d41e24e3b9a3816e70ad73e7e/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:07:12.942609 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c34c88-9d92-4dfc-95da-d020035e55f4 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:12.946472 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0fc73-1fd8-4289-a492-1f484ae0b5c6 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:13.085329 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0fc73-1fd8-4289-a492-1f484ae0b5c6 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:13.101922 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f5c34c88-9d92-4dfc-95da-d020035e55f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8000a906c6754f27a8bf115d7c2274b5'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:13.121226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8219a-6533-40f8-900c-e3a23aca5699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:13.122576 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8219a-6533-40f8-900c-e3a23aca5699 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:13.124464 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8219a-6533-40f8-900c-e3a23aca5699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:13.125281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8219a-6533-40f8-900c-e3a23aca5699 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:13.126303 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f5c34c88-9d92-4dfc-95da-d020035e55f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8000a906c6754f27a8bf115d7c2274b5'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:13.128855 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8219a-6533-40f8-900c-e3a23aca5699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:13.133140 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8219a-6533-40f8-900c-e3a23aca5699 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:13.162065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 917/1834] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:13.163888 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f5c34c88-9d92-4dfc-95da-d020035e55f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8000a906c6754f27a8bf115d7c2274b5'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:13.164694 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f5c34c88-9d92-4dfc-95da-d020035e55f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8000a906c6754f27a8bf115d7c2274b5'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:13.165306 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f5c34c88-9d92-4dfc-95da-d020035e55f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8000a906c6754f27a8bf115d7c2274b5'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:13.167366 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8219a-6533-40f8-900c-e3a23aca5699 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:13.172255 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6fb8219a-6533-40f8-900c-e3a23aca5699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:13.207912 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8219a-6533-40f8-900c-e3a23aca5699 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:13.213468 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed150e5-80f6-47bf-b089-25e71ff9a3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:13.214463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed150e5-80f6-47bf-b089-25e71ff9a3ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:13.214842 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed150e5-80f6-47bf-b089-25e71ff9a3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:13.215191 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed150e5-80f6-47bf-b089-25e71ff9a3ae admin admin] PATH_INFO: `/v3/projects/88ca4e008804492b9c2f4c43cc0cbe7f/users/cbdf3b0d41e24e3b9a3816e70ad73e7e/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:13.217361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed150e5-80f6-47bf-b089-25e71ff9a3ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ca4e008804492b9c2f4c43cc0cbe7f, user_id=cbdf3b0d41e24e3b9a3816e70ad73e7e, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:13.220734 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed150e5-80f6-47bf-b089-25e71ff9a3ae admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:13.228008 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 918/1835] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:12 2022] DELETE /identity/v3/users/8000a906c6754f27a8bf115d7c2274b5 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:07:13.233337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efa136-7843-43c7-84e6-92a476a66cf4 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:13.233634 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efa136-7843-43c7-84e6-92a476a66cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:13.233979 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efa136-7843-43c7-84e6-92a476a66cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:13.253617 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 918/1836] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:13 2022] PUT /identity/v3/projects/88ca4e008804492b9c2f4c43cc0cbe7f/users/cbdf3b0d41e24e3b9a3816e70ad73e7e/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:13.266812 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-56efa136-7843-43c7-84e6-92a476a66cf4 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:13.267687 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec0866-e889-468b-9938-d74bcb1bafd4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:13.269328 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-56efa136-7843-43c7-84e6-92a476a66cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:13.269903 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec0866-e889-468b-9938-d74bcb1bafd4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:13.270374 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec0866-e889-468b-9938-d74bcb1bafd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:13.334026 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-34ec0866-e889-468b-9938-d74bcb1bafd4 None None] MFA Rules not processed for user `cbdf3b0d41e24e3b9a3816e70ad73e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:13.335288 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-34ec0866-e889-468b-9938-d74bcb1bafd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:13.366244 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:13.423130 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 919/1837] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:13.471843 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 919/1838] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:13 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:13.485186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efa136-7843-43c7-84e6-92a476a66cf4 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:13.485904 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec0866-e889-468b-9938-d74bcb1bafd4 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:13.488958 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-34ec0866-e889-468b-9938-d74bcb1bafd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:13.489654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-56efa136-7843-43c7-84e6-92a476a66cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:13.588114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:13.602486 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec0866-e889-468b-9938-d74bcb1bafd4 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:13.611337 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c5728-ea5b-4e85-948e-1846fce68df2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:13.612262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c5728-ea5b-4e85-948e-1846fce68df2 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:13.612735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c5728-ea5b-4e85-948e-1846fce68df2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:13.613306 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c5728-ea5b-4e85-948e-1846fce68df2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:13.640056 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c5728-ea5b-4e85-948e-1846fce68df2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:13.645852 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c5728-ea5b-4e85-948e-1846fce68df2 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:13.668574 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 920/1839] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:13 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:07:13.676332 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efa136-7843-43c7-84e6-92a476a66cf4 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:13.682746 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd493393-3628-4cd8-af73-d9bdb7e64870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:13.683514 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd493393-3628-4cd8-af73-d9bdb7e64870 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:13.683808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd493393-3628-4cd8-af73-d9bdb7e64870 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:13.684091 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd493393-3628-4cd8-af73-d9bdb7e64870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:13.701170 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd493393-3628-4cd8-af73-d9bdb7e64870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:13.703207 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd493393-3628-4cd8-af73-d9bdb7e64870 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:13.709526 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c5728-ea5b-4e85-948e-1846fce68df2 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:13.711238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d16c5728-ea5b-4e85-948e-1846fce68df2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:13.747087 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c5728-ea5b-4e85-948e-1846fce68df2 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:13.749777 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 920/1840] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:13.758780 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648cefc-458f-4587-9aa7-edf724d8a711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:13.760797 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648cefc-458f-4587-9aa7-edf724d8a711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:13.761211 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648cefc-458f-4587-9aa7-edf724d8a711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:13.762912 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648cefc-458f-4587-9aa7-edf724d8a711 admin admin] PATH_INFO: `/v3/projects/4b6d5f78e86c470b977d4caba29df4bc` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:13.765332 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648cefc-458f-4587-9aa7-edf724d8a711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b6d5f78e86c470b977d4caba29df4bc)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:13.768133 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648cefc-458f-4587-9aa7-edf724d8a711 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:13.882695 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd493393-3628-4cd8-af73-d9bdb7e64870 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:13.884257 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-bd493393-3628-4cd8-af73-d9bdb7e64870 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:13.903357 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d648cefc-458f-4587-9aa7-edf724d8a711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b6d5f78e86c470b977d4caba29df4bc', 'request_id': 'req-d648cefc-458f-4587-9aa7-edf724d8a711'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:13.913995 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd493393-3628-4cd8-af73-d9bdb7e64870 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:13.925994 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d648cefc-458f-4587-9aa7-edf724d8a711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b6d5f78e86c470b977d4caba29df4bc', 'request_id': 'req-d648cefc-458f-4587-9aa7-edf724d8a711'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:13.948322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d648cefc-458f-4587-9aa7-edf724d8a711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b6d5f78e86c470b977d4caba29df4bc', 'request_id': 'req-d648cefc-458f-4587-9aa7-edf724d8a711'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:13.977378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d648cefc-458f-4587-9aa7-edf724d8a711 admin admin] The token cache is being invalidate because project 4b6d5f78e86c470b977d4caba29df4bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:13.977679 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d648cefc-458f-4587-9aa7-edf724d8a711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:13.978438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d648cefc-458f-4587-9aa7-edf724d8a711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:13.980065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 921/1841] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:13 2022] DELETE /identity/v3/projects/4b6d5f78e86c470b977d4caba29df4bc => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:07:13.983979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648cefc-458f-4587-9aa7-edf724d8a711 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:13.988677 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d648cefc-458f-4587-9aa7-edf724d8a711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:14.078583 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd333e80-fc6c-4f17-a688-dcacf44e7ca6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:14.080159 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd333e80-fc6c-4f17-a688-dcacf44e7ca6 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:14.080494 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd333e80-fc6c-4f17-a688-dcacf44e7ca6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:14.080907 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd333e80-fc6c-4f17-a688-dcacf44e7ca6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:14.087102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cd333e80-fc6c-4f17-a688-dcacf44e7ca6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:14.206004 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648cefc-458f-4587-9aa7-edf724d8a711 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:14.232100 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3f611-3b3a-401d-a9d7-8cc140a061d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:14.233234 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3f611-3b3a-401d-a9d7-8cc140a061d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:14.234523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3f611-3b3a-401d-a9d7-8cc140a061d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:14.234830 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3f611-3b3a-401d-a9d7-8cc140a061d5 admin admin] PATH_INFO: `/v3/users/8c94c83a225e4e42afb846a2c8f8a552` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:14.240292 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3f611-3b3a-401d-a9d7-8cc140a061d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c94c83a225e4e42afb846a2c8f8a552)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:14.244480 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3f611-3b3a-401d-a9d7-8cc140a061d5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:14.271851 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd333e80-fc6c-4f17-a688-dcacf44e7ca6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:14.274871 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd333e80-fc6c-4f17-a688-dcacf44e7ca6 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:14.289764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 921/1842] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:13 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:07:14.381654 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-02d3f611-3b3a-401d-a9d7-8cc140a061d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c94c83a225e4e42afb846a2c8f8a552'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:14.410647 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-02d3f611-3b3a-401d-a9d7-8cc140a061d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c94c83a225e4e42afb846a2c8f8a552'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:14.412186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-02d3f611-3b3a-401d-a9d7-8cc140a061d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c94c83a225e4e42afb846a2c8f8a552'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:14.449738 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-02d3f611-3b3a-401d-a9d7-8cc140a061d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c94c83a225e4e42afb846a2c8f8a552'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:14.451945 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:14.470922 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-02d3f611-3b3a-401d-a9d7-8cc140a061d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c94c83a225e4e42afb846a2c8f8a552'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:14.481880 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 922/1843] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:13 2022] DELETE /identity/v3/users/8c94c83a225e4e42afb846a2c8f8a552 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:07:15.043667 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd333e80-fc6c-4f17-a688-dcacf44e7ca6 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:15.045482 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cd333e80-fc6c-4f17-a688-dcacf44e7ca6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:15.072753 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd333e80-fc6c-4f17-a688-dcacf44e7ca6 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:15.202149 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:15.239160 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3f6d0-0e07-4299-898e-c9c88db566f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:15.240156 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3f6d0-0e07-4299-898e-c9c88db566f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:15.240573 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3f6d0-0e07-4299-898e-c9c88db566f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:15.241085 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3f6d0-0e07-4299-898e-c9c88db566f4 admin admin] PATH_INFO: `/v3/projects/a3c6ea95e985490d90eb518e51800619` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:15.244552 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3f6d0-0e07-4299-898e-c9c88db566f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3c6ea95e985490d90eb518e51800619)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:15.252980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3f6d0-0e07-4299-898e-c9c88db566f4 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:15.391869 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-31e3f6d0-0e07-4299-898e-c9c88db566f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3c6ea95e985490d90eb518e51800619', 'request_id': 'req-31e3f6d0-0e07-4299-898e-c9c88db566f4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:15.408842 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-31e3f6d0-0e07-4299-898e-c9c88db566f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3c6ea95e985490d90eb518e51800619', 'request_id': 'req-31e3f6d0-0e07-4299-898e-c9c88db566f4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:15.430987 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-31e3f6d0-0e07-4299-898e-c9c88db566f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3c6ea95e985490d90eb518e51800619', 'request_id': 'req-31e3f6d0-0e07-4299-898e-c9c88db566f4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:15.446088 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-31e3f6d0-0e07-4299-898e-c9c88db566f4 admin admin] The token cache is being invalidate because project a3c6ea95e985490d90eb518e51800619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:15.446754 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-31e3f6d0-0e07-4299-898e-c9c88db566f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:15.447820 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-31e3f6d0-0e07-4299-898e-c9c88db566f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:15.455441 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3f611-3b3a-401d-a9d7-8cc140a061d5 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:15.457258 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-02d3f611-3b3a-401d-a9d7-8cc140a061d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:15.458979 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 922/1844] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:15 2022] DELETE /identity/v3/projects/a3c6ea95e985490d90eb518e51800619 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:15.490134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3f611-3b3a-401d-a9d7-8cc140a061d5 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:15.639736 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc2b24-474a-425a-8b88-c68f44161f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:15.640957 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc2b24-474a-425a-8b88-c68f44161f6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:15.641241 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc2b24-474a-425a-8b88-c68f44161f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:15.642055 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc2b24-474a-425a-8b88-c68f44161f6b admin admin] PATH_INFO: `/v3/users/585ba6d42f3143b0b9b2ea74c1a3838d` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:15.645702 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc2b24-474a-425a-8b88-c68f44161f6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=585ba6d42f3143b0b9b2ea74c1a3838d)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:15.653066 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc2b24-474a-425a-8b88-c68f44161f6b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:15.812250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5bcc2b24-474a-425a-8b88-c68f44161f6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '585ba6d42f3143b0b9b2ea74c1a3838d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:15.822626 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5bcc2b24-474a-425a-8b88-c68f44161f6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '585ba6d42f3143b0b9b2ea74c1a3838d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:15.823982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5bcc2b24-474a-425a-8b88-c68f44161f6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '585ba6d42f3143b0b9b2ea74c1a3838d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:15.842112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5bcc2b24-474a-425a-8b88-c68f44161f6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '585ba6d42f3143b0b9b2ea74c1a3838d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:15.856127 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5bcc2b24-474a-425a-8b88-c68f44161f6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '585ba6d42f3143b0b9b2ea74c1a3838d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:15.871278 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 923/1845] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:15 2022] DELETE /identity/v3/users/585ba6d42f3143b0b9b2ea74c1a3838d => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:15.940248 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3f6d0-0e07-4299-898e-c9c88db566f4 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:15.941962 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-31e3f6d0-0e07-4299-898e-c9c88db566f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:16.021686 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3f6d0-0e07-4299-898e-c9c88db566f4 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:16.104535 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31bb80f-754d-44a8-9308-363d12d29fec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:16.105253 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bb80f-754d-44a8-9308-363d12d29fec service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:16.105628 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bb80f-754d-44a8-9308-363d12d29fec service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:16.106034 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bb80f-754d-44a8-9308-363d12d29fec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:16.118053 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d31bb80f-754d-44a8-9308-363d12d29fec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:16.147375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc2b24-474a-425a-8b88-c68f44161f6b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:16.148906 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5bcc2b24-474a-425a-8b88-c68f44161f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:16.232137 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:16.275427 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31bb80f-754d-44a8-9308-363d12d29fec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:16.277001 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31bb80f-754d-44a8-9308-363d12d29fec service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:16.278019 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc2b24-474a-425a-8b88-c68f44161f6b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:16.289615 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 923/1846] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:16.308563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00295f4b-9f4d-421e-905a-0bc56c77a4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:16.310319 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00295f4b-9f4d-421e-905a-0bc56c77a4ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:16.310840 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00295f4b-9f4d-421e-905a-0bc56c77a4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:16.311408 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00295f4b-9f4d-421e-905a-0bc56c77a4ef admin admin] PATH_INFO: `/v3/projects/fa121f4f2f7045a1acb7e3b4770b9396` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:16.319812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00295f4b-9f4d-421e-905a-0bc56c77a4ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa121f4f2f7045a1acb7e3b4770b9396)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:16.321334 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf367215-c0b9-477b-bf46-af48612199e4 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:16.321730 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf367215-c0b9-477b-bf46-af48612199e4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:16.321877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf367215-c0b9-477b-bf46-af48612199e4 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:16.322213 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00295f4b-9f4d-421e-905a-0bc56c77a4ef admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:16.323561 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 924/1847] 10.222.0.35 () {54 vars in 921 bytes} [Thu May 19 22:07:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 22:07:16.343542 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:16.382977 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6c960-8b5f-45cf-8311-4d34cf29e92d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:16.383275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6c960-8b5f-45cf-8311-4d34cf29e92d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:16.383522 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6c960-8b5f-45cf-8311-4d34cf29e92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:16.403283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-00295f4b-9f4d-421e-905a-0bc56c77a4ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa121f4f2f7045a1acb7e3b4770b9396', 'request_id': 'req-00295f4b-9f4d-421e-905a-0bc56c77a4ef'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:16.427862 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-00295f4b-9f4d-421e-905a-0bc56c77a4ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa121f4f2f7045a1acb7e3b4770b9396', 'request_id': 'req-00295f4b-9f4d-421e-905a-0bc56c77a4ef'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:16.428265 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-30d6c960-8b5f-45cf-8311-4d34cf29e92d None None] MFA Rules not processed for user `902ca8f1d59547a0ab187b4748311f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:16.428265 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-30d6c960-8b5f-45cf-8311-4d34cf29e92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:16.428785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-00295f4b-9f4d-421e-905a-0bc56c77a4ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa121f4f2f7045a1acb7e3b4770b9396', 'request_id': 'req-00295f4b-9f4d-421e-905a-0bc56c77a4ef'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:16.442069 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-00295f4b-9f4d-421e-905a-0bc56c77a4ef admin admin] The token cache is being invalidate because project fa121f4f2f7045a1acb7e3b4770b9396 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:16.442983 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-00295f4b-9f4d-421e-905a-0bc56c77a4ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:16.443513 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-00295f4b-9f4d-421e-905a-0bc56c77a4ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:16.448455 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 924/1848] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:16 2022] DELETE /identity/v3/projects/fa121f4f2f7045a1acb7e3b4770b9396 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:07:16.452245 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244cc99-11d9-49c8-86e9-86ad2de51995 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:16.452578 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244cc99-11d9-49c8-86e9-86ad2de51995 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:16.452916 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244cc99-11d9-49c8-86e9-86ad2de51995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:16.478204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-f244cc99-11d9-49c8-86e9-86ad2de51995 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:16.479456 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f244cc99-11d9-49c8-86e9-86ad2de51995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:16.600782 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 925/1849] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:16.610149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edeef7-71a8-49d4-a1f1-7121ad4f1cc8 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:16.610842 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edeef7-71a8-49d4-a1f1-7121ad4f1cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:16.611265 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edeef7-71a8-49d4-a1f1-7121ad4f1cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:16.640064 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 925/1850] 10.222.0.35 () {58 vars in 1018 bytes} [Thu May 19 22:07:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:07:16.659223 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-32edeef7-71a8-49d4-a1f1-7121ad4f1cc8 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:16.660859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-32edeef7-71a8-49d4-a1f1-7121ad4f1cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:16.672475 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 926/1851] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:16.677559 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6c960-8b5f-45cf-8311-4d34cf29e92d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:16.692994 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6c960-8b5f-45cf-8311-4d34cf29e92d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:16.702760 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e28b39-1d9c-4762-9ace-ffa2d7654bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:16.704783 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e28b39-1d9c-4762-9ace-ffa2d7654bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:16.705297 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e28b39-1d9c-4762-9ace-ffa2d7654bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:16.705736 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e28b39-1d9c-4762-9ace-ffa2d7654bd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:16.707183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e28b39-1d9c-4762-9ace-ffa2d7654bd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:07:16.707983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e28b39-1d9c-4762-9ace-ffa2d7654bd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:16.710242 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e28b39-1d9c-4762-9ace-ffa2d7654bd1 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:16.729219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 926/1852] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:07:16.733677 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edeef7-71a8-49d4-a1f1-7121ad4f1cc8 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:16.752801 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edeef7-71a8-49d4-a1f1-7121ad4f1cc8 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:16.760516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e83e8a-c115-44ce-88e2-68d68cee2677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:16.761779 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e83e8a-c115-44ce-88e2-68d68cee2677 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:16.762138 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e83e8a-c115-44ce-88e2-68d68cee2677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:16.762422 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e83e8a-c115-44ce-88e2-68d68cee2677 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:16.763968 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e83e8a-c115-44ce-88e2-68d68cee2677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:16.767491 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e83e8a-c115-44ce-88e2-68d68cee2677 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:16.827076 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 927/1853] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:16 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:16.833129 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e28b39-1d9c-4762-9ace-ffa2d7654bd1 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:16.852004 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e28b39-1d9c-4762-9ace-ffa2d7654bd1 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:16.904185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e83e8a-c115-44ce-88e2-68d68cee2677 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:16.906212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-24e83e8a-c115-44ce-88e2-68d68cee2677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:17.056168 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131eac39-f611-4b59-84f3-133e3d0970be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:17.056935 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131eac39-f611-4b59-84f3-133e3d0970be admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:17.057266 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131eac39-f611-4b59-84f3-133e3d0970be admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:17.057549 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131eac39-f611-4b59-84f3-133e3d0970be admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:17.059866 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131eac39-f611-4b59-84f3-133e3d0970be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:17.080670 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131eac39-f611-4b59-84f3-133e3d0970be admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:17.152698 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 927/1854] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:16 2022] POST /identity/v3/users => generated 289 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:07:17.158550 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131eac39-f611-4b59-84f3-133e3d0970be admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:17.169800 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e83e8a-c115-44ce-88e2-68d68cee2677 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:17.190188 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131eac39-f611-4b59-84f3-133e3d0970be admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:17.195823 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371c1bc-a74c-40fe-ac04-9c790c7d2156 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:17.196663 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371c1bc-a74c-40fe-ac04-9c790c7d2156 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:17.197034 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371c1bc-a74c-40fe-ac04-9c790c7d2156 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:17.197216 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371c1bc-a74c-40fe-ac04-9c790c7d2156 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:17.218399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2a494-2244-4002-bd50-1fb6377801e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:17.219183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2a494-2244-4002-bd50-1fb6377801e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:17.220523 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2a494-2244-4002-bd50-1fb6377801e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:17.222458 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2a494-2244-4002-bd50-1fb6377801e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:17.223446 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2a494-2244-4002-bd50-1fb6377801e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:17.226146 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2a494-2244-4002-bd50-1fb6377801e1 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:17.230138 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371c1bc-a74c-40fe-ac04-9c790c7d2156 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:17.232993 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371c1bc-a74c-40fe-ac04-9c790c7d2156 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:17.244241 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:17.258629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 928/1855] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:17.263513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2a494-2244-4002-bd50-1fb6377801e1 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:17.265525 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 928/1856] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:07:17.279219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2a494-2244-4002-bd50-1fb6377801e1 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:17.288672 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141255d3-79d0-4e9f-a13a-4223b020fd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:17.289527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141255d3-79d0-4e9f-a13a-4223b020fd7d admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:17.289753 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141255d3-79d0-4e9f-a13a-4223b020fd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:17.290053 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141255d3-79d0-4e9f-a13a-4223b020fd7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:17.293753 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141255d3-79d0-4e9f-a13a-4223b020fd7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:17.301071 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141255d3-79d0-4e9f-a13a-4223b020fd7d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:17.330784 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 929/1857] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:17.331950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371c1bc-a74c-40fe-ac04-9c790c7d2156 service nova] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:17.368663 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371c1bc-a74c-40fe-ac04-9c790c7d2156 service nova] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:17.383510 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd196b-e1f6-4ff3-9653-e655b003aabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:17.385273 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd196b-e1f6-4ff3-9653-e655b003aabc admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:17.386156 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd196b-e1f6-4ff3-9653-e655b003aabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:17.386474 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd196b-e1f6-4ff3-9653-e655b003aabc admin admin] PATH_INFO: `/v3/projects/01ca46912d514e04986bb84d37869941/users/6c3e7c82061c4a108e28be6a51f39bc6/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:17.429951 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd196b-e1f6-4ff3-9653-e655b003aabc admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ca46912d514e04986bb84d37869941, user_id=6c3e7c82061c4a108e28be6a51f39bc6, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:17.433071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd196b-e1f6-4ff3-9653-e655b003aabc admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:17.473277 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 929/1858] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:17 2022] PUT /identity/v3/projects/01ca46912d514e04986bb84d37869941/users/6c3e7c82061c4a108e28be6a51f39bc6/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:17.485588 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afa01a-566c-491c-b033-d502d39413fa None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:17.487388 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afa01a-566c-491c-b033-d502d39413fa None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:17.487872 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afa01a-566c-491c-b033-d502d39413fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:17.540135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-72afa01a-566c-491c-b033-d502d39413fa None None] MFA Rules not processed for user `6c3e7c82061c4a108e28be6a51f39bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:17.542598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-72afa01a-566c-491c-b033-d502d39413fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:17.611108 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:17.719914 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 930/1859] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:17.723241 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd196b-e1f6-4ff3-9653-e655b003aabc admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:17.831416 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd196b-e1f6-4ff3-9653-e655b003aabc admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:17.846814 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153be95-a812-4462-a712-bc47c50f47e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:17.847678 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153be95-a812-4462-a712-bc47c50f47e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:17.848102 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153be95-a812-4462-a712-bc47c50f47e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:17.848567 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153be95-a812-4462-a712-bc47c50f47e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:17.849761 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153be95-a812-4462-a712-bc47c50f47e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:17.853376 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153be95-a812-4462-a712-bc47c50f47e3 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:17.899708 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 930/1860] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:17 2022] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:17.903531 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afa01a-566c-491c-b033-d502d39413fa None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:17.920424 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afa01a-566c-491c-b033-d502d39413fa None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:17.992921 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153be95-a812-4462-a712-bc47c50f47e3 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:17.995359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a153be95-a812-4462-a712-bc47c50f47e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:18.067304 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55491517-394f-4453-b7b1-ec5ab8841610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:18.069066 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55491517-394f-4453-b7b1-ec5ab8841610 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:18.072116 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55491517-394f-4453-b7b1-ec5ab8841610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:18.072504 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55491517-394f-4453-b7b1-ec5ab8841610 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:18.073522 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55491517-394f-4453-b7b1-ec5ab8841610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:18.080155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55491517-394f-4453-b7b1-ec5ab8841610 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:18.097498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153be95-a812-4462-a712-bc47c50f47e3 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:18.105412 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4761a-23be-48dd-8388-110ddfe719e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:18.106519 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4761a-23be-48dd-8388-110ddfe719e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:18.106874 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4761a-23be-48dd-8388-110ddfe719e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:18.113356 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4761a-23be-48dd-8388-110ddfe719e2 admin admin] PATH_INFO: `/v3/projects/b1e6704fe36c46418341eb4eb1dea1be` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:18.116645 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4761a-23be-48dd-8388-110ddfe719e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1e6704fe36c46418341eb4eb1dea1be)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:18.120743 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4761a-23be-48dd-8388-110ddfe719e2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:18.149139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 931/1861] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:17 2022] POST /identity/v3/users => generated 294 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:18.153369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55491517-394f-4453-b7b1-ec5ab8841610 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:18.172224 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55491517-394f-4453-b7b1-ec5ab8841610 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:18.180255 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e2eba-c6d3-461c-be90-f38772e794f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:18.181300 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e2eba-c6d3-461c-be90-f38772e794f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:18.181833 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e2eba-c6d3-461c-be90-f38772e794f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:18.182184 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e2eba-c6d3-461c-be90-f38772e794f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:18.183233 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e2eba-c6d3-461c-be90-f38772e794f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:18.187706 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e2eba-c6d3-461c-be90-f38772e794f7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:18.215528 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 932/1862] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:07:18.217046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e2eba-c6d3-461c-be90-f38772e794f7 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:18.246087 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e2e4761a-23be-48dd-8388-110ddfe719e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1e6704fe36c46418341eb4eb1dea1be', 'request_id': 'req-e2e4761a-23be-48dd-8388-110ddfe719e2'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:18.248668 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e2eba-c6d3-461c-be90-f38772e794f7 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:18.266979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e2e4761a-23be-48dd-8388-110ddfe719e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1e6704fe36c46418341eb4eb1dea1be', 'request_id': 'req-e2e4761a-23be-48dd-8388-110ddfe719e2'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:18.275859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:18.279746 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e2e4761a-23be-48dd-8388-110ddfe719e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1e6704fe36c46418341eb4eb1dea1be', 'request_id': 'req-e2e4761a-23be-48dd-8388-110ddfe719e2'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:18.306601 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e2e4761a-23be-48dd-8388-110ddfe719e2 admin admin] The token cache is being invalidate because project b1e6704fe36c46418341eb4eb1dea1be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:18.307001 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e2e4761a-23be-48dd-8388-110ddfe719e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:18.308342 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e2e4761a-23be-48dd-8388-110ddfe719e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:18.312168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 931/1863] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:17 2022] DELETE /identity/v3/projects/b1e6704fe36c46418341eb4eb1dea1be => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:07:18.318423 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2022814-9230-476a-bb3a-35bd5af0a997 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:18.318747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2022814-9230-476a-bb3a-35bd5af0a997 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:18.318991 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2022814-9230-476a-bb3a-35bd5af0a997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:18.364046 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d2022814-9230-476a-bb3a-35bd5af0a997 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:18.365337 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d2022814-9230-476a-bb3a-35bd5af0a997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:18.392012 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b4328-a756-4508-8c91-a11aec59b5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:18.393426 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b4328-a756-4508-8c91-a11aec59b5bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:18.393934 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b4328-a756-4508-8c91-a11aec59b5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:18.395107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b4328-a756-4508-8c91-a11aec59b5bd admin admin] PATH_INFO: `/v3/projects/6930a630d6e849dd8b921434ad9cd458/users/d12a022ac8fa48ddac5ddb6fae84d4eb/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:18.439371 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b4328-a756-4508-8c91-a11aec59b5bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6930a630d6e849dd8b921434ad9cd458, user_id=d12a022ac8fa48ddac5ddb6fae84d4eb, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:18.442501 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b4328-a756-4508-8c91-a11aec59b5bd admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:18.467701 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 933/1864] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:18 2022] PUT /identity/v3/projects/6930a630d6e849dd8b921434ad9cd458/users/d12a022ac8fa48ddac5ddb6fae84d4eb/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:18.473870 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b4328-a756-4508-8c91-a11aec59b5bd admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:18.493610 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-577b4328-a756-4508-8c91-a11aec59b5bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:18.500032 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 932/1865] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:18.510513 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6ceb9-691e-47f8-8da3-50e820389737 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:18.510826 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6ceb9-691e-47f8-8da3-50e820389737 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:18.512092 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6ceb9-691e-47f8-8da3-50e820389737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:18.554526 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-73e6ceb9-691e-47f8-8da3-50e820389737 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:18.555964 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-73e6ceb9-691e-47f8-8da3-50e820389737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:18.577654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:18.649813 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b4328-a756-4508-8c91-a11aec59b5bd admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:18.665308 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a0bd7-ef4b-4cc2-bb49-70abbb10b04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:18.666088 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a0bd7-ef4b-4cc2-bb49-70abbb10b04d admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:18.666371 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a0bd7-ef4b-4cc2-bb49-70abbb10b04d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:18.666751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a0bd7-ef4b-4cc2-bb49-70abbb10b04d admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:18.667500 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a0bd7-ef4b-4cc2-bb49-70abbb10b04d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:18.669173 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a0bd7-ef4b-4cc2-bb49-70abbb10b04d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:18.670446 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 933/1866] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:18.676669 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6ceb9-691e-47f8-8da3-50e820389737 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:18.690612 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 934/1867] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:18.691245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a0bd7-ef4b-4cc2-bb49-70abbb10b04d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:18.691378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6ceb9-691e-47f8-8da3-50e820389737 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:18.697181 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ef4ab-59c9-45ac-9317-3fe0d254611b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:18.698001 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ef4ab-59c9-45ac-9317-3fe0d254611b admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:18.698267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ef4ab-59c9-45ac-9317-3fe0d254611b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:18.698593 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ef4ab-59c9-45ac-9317-3fe0d254611b admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:18.699343 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ef4ab-59c9-45ac-9317-3fe0d254611b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:07:18.700335 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ef4ab-59c9-45ac-9317-3fe0d254611b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:18.703297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ef4ab-59c9-45ac-9317-3fe0d254611b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:18.705636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a0bd7-ef4b-4cc2-bb49-70abbb10b04d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:18.713296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee12c6-74f6-4443-84c3-aaa2c6e519dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:18.717429 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee12c6-74f6-4443-84c3-aaa2c6e519dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:18.717947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee12c6-74f6-4443-84c3-aaa2c6e519dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:18.718296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee12c6-74f6-4443-84c3-aaa2c6e519dc admin admin] PATH_INFO: `/v3/projects/6930a630d6e849dd8b921434ad9cd458/users/d12a022ac8fa48ddac5ddb6fae84d4eb/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:18.721812 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee12c6-74f6-4443-84c3-aaa2c6e519dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6930a630d6e849dd8b921434ad9cd458, user_id=d12a022ac8fa48ddac5ddb6fae84d4eb, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:18.724855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee12c6-74f6-4443-84c3-aaa2c6e519dc admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:18.725196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 934/1868] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 22:07:18.726191 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ef4ab-59c9-45ac-9317-3fe0d254611b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:18.739160 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 935/1869] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:18 2022] PUT /identity/v3/projects/6930a630d6e849dd8b921434ad9cd458/users/d12a022ac8fa48ddac5ddb6fae84d4eb/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:07:18.747256 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ef4ab-59c9-45ac-9317-3fe0d254611b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:18.751161 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3573f1-8941-4d6c-b991-656922bd3cd5 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:18.751466 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3573f1-8941-4d6c-b991-656922bd3cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:18.751744 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3573f1-8941-4d6c-b991-656922bd3cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:18.787138 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1d3573f1-8941-4d6c-b991-656922bd3cd5 None None] MFA Rules not processed for user `d12a022ac8fa48ddac5ddb6fae84d4eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:18.788369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1d3573f1-8941-4d6c-b991-656922bd3cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:18.832329 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa450f-5e65-4676-b6d2-074b412f3039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:18.833149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa450f-5e65-4676-b6d2-074b412f3039 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:18.833536 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa450f-5e65-4676-b6d2-074b412f3039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:18.834054 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa450f-5e65-4676-b6d2-074b412f3039 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:18.834769 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa450f-5e65-4676-b6d2-074b412f3039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:18.836828 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa450f-5e65-4676-b6d2-074b412f3039 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:18.870094 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 935/1870] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:18 2022] POST /identity/v3/projects => generated 391 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:18.875292 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa450f-5e65-4676-b6d2-074b412f3039 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:18.892091 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:18.913928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 936/1871] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:07:18.945690 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3573f1-8941-4d6c-b991-656922bd3cd5 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:18.947190 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1d3573f1-8941-4d6c-b991-656922bd3cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:18.989039 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa450f-5e65-4676-b6d2-074b412f3039 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:18.998117 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d561705-a6f0-4d33-ad00-054b83f91d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:18.998996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d561705-a6f0-4d33-ad00-054b83f91d8e admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:18.999411 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d561705-a6f0-4d33-ad00-054b83f91d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:18.999784 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d561705-a6f0-4d33-ad00-054b83f91d8e admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:19.000807 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d561705-a6f0-4d33-ad00-054b83f91d8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:19.003492 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d561705-a6f0-4d33-ad00-054b83f91d8e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:19.035011 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 936/1872] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:18 2022] POST /identity/v3/users => generated 296 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:07:19.041095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3573f1-8941-4d6c-b991-656922bd3cd5 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:19.041254 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d561705-a6f0-4d33-ad00-054b83f91d8e admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:19.054105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d561705-a6f0-4d33-ad00-054b83f91d8e admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:19.059830 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbea9ec-0cb7-4389-8edc-8aeefb5795eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:19.060712 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbea9ec-0cb7-4389-8edc-8aeefb5795eb admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:19.061065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbea9ec-0cb7-4389-8edc-8aeefb5795eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:19.061316 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbea9ec-0cb7-4389-8edc-8aeefb5795eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:19.062104 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbea9ec-0cb7-4389-8edc-8aeefb5795eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:19.064545 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbea9ec-0cb7-4389-8edc-8aeefb5795eb admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:19.076254 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 937/1873] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:19.081145 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbea9ec-0cb7-4389-8edc-8aeefb5795eb admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:19.091855 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbea9ec-0cb7-4389-8edc-8aeefb5795eb admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:19.097978 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c94927-4d81-409e-aa47-1426b5d1458d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:19.098724 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c94927-4d81-409e-aa47-1426b5d1458d admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:19.098950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c94927-4d81-409e-aa47-1426b5d1458d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:19.101196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c94927-4d81-409e-aa47-1426b5d1458d admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:19.102397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c94927-4d81-409e-aa47-1426b5d1458d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:19.105297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c94927-4d81-409e-aa47-1426b5d1458d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:19.105398 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17727c11-9737-4693-81b2-40a5b55e4ec6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:19.106000 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17727c11-9737-4693-81b2-40a5b55e4ec6 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:19.106286 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17727c11-9737-4693-81b2-40a5b55e4ec6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:19.106564 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17727c11-9737-4693-81b2-40a5b55e4ec6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:19.108574 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-17727c11-9737-4693-81b2-40a5b55e4ec6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:19.114273 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:19.120568 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 938/1874] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:19.123354 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c94927-4d81-409e-aa47-1426b5d1458d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:19.139691 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c94927-4d81-409e-aa47-1426b5d1458d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:19.146685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a323bfe-dbd8-4e55-8300-8054a1f32eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:19.147635 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a323bfe-dbd8-4e55-8300-8054a1f32eff admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:19.148330 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a323bfe-dbd8-4e55-8300-8054a1f32eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:19.148668 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a323bfe-dbd8-4e55-8300-8054a1f32eff admin admin] PATH_INFO: `/v3/projects/b6745bf47c01490b9e71122ada42ac25/users/c2476f70364e41e786bfb3e472e192d9/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:19.164771 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a323bfe-dbd8-4e55-8300-8054a1f32eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6745bf47c01490b9e71122ada42ac25, user_id=c2476f70364e41e786bfb3e472e192d9, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:19.167438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a323bfe-dbd8-4e55-8300-8054a1f32eff admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:19.184255 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17727c11-9737-4693-81b2-40a5b55e4ec6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:19.185958 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17727c11-9737-4693-81b2-40a5b55e4ec6 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:19.188493 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 939/1875] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:19 2022] PUT /identity/v3/projects/b6745bf47c01490b9e71122ada42ac25/users/c2476f70364e41e786bfb3e472e192d9/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:19.196159 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 937/1876] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:07:19.198462 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4feb65e-d1fe-4d94-85f7-aaa106b8d4b8 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:19.198763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4feb65e-d1fe-4d94-85f7-aaa106b8d4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:19.199076 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4feb65e-d1fe-4d94-85f7-aaa106b8d4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:19.231520 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e4feb65e-d1fe-4d94-85f7-aaa106b8d4b8 None None] MFA Rules not processed for user `c2476f70364e41e786bfb3e472e192d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:19.233390 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e4feb65e-d1fe-4d94-85f7-aaa106b8d4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:19.353797 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 940/1877] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:07:19.354948 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17727c11-9737-4693-81b2-40a5b55e4ec6 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:19.373180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17727c11-9737-4693-81b2-40a5b55e4ec6 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:19.469366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3acd54-99d6-43ba-89ad-5a75ca8823b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:19.471272 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3acd54-99d6-43ba-89ad-5a75ca8823b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:19.471565 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3acd54-99d6-43ba-89ad-5a75ca8823b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:19.471847 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3acd54-99d6-43ba-89ad-5a75ca8823b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:19.472593 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3acd54-99d6-43ba-89ad-5a75ca8823b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:19.474537 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3acd54-99d6-43ba-89ad-5a75ca8823b8 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:19.507527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 938/1878] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:19 2022] POST /identity/v3/projects => generated 391 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:19.512639 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4feb65e-d1fe-4d94-85f7-aaa106b8d4b8 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:19.530908 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4feb65e-d1fe-4d94-85f7-aaa106b8d4b8 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:19.618042 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:19.650511 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351ab77-3ebf-4174-95db-68747d95f063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:19.650833 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351ab77-3ebf-4174-95db-68747d95f063 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:19.651121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351ab77-3ebf-4174-95db-68747d95f063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:19.651396 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351ab77-3ebf-4174-95db-68747d95f063 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:19.652090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351ab77-3ebf-4174-95db-68747d95f063 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:19.654709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351ab77-3ebf-4174-95db-68747d95f063 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:19.694451 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 941/1879] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:19 2022] POST /identity/v3/users => generated 302 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:19.698553 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3acd54-99d6-43ba-89ad-5a75ca8823b8 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:19.714566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3acd54-99d6-43ba-89ad-5a75ca8823b8 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:19.726798 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2443c-3237-4105-a9c4-283b44ef9e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:19.727638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2443c-3237-4105-a9c4-283b44ef9e01 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:19.727927 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2443c-3237-4105-a9c4-283b44ef9e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:19.728203 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2443c-3237-4105-a9c4-283b44ef9e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:19.729068 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2443c-3237-4105-a9c4-283b44ef9e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:19.735102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2443c-3237-4105-a9c4-283b44ef9e01 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:19.780546 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 939/1880] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:19.780733 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351ab77-3ebf-4174-95db-68747d95f063 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:19.799019 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351ab77-3ebf-4174-95db-68747d95f063 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:19.810269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07425a-2bd3-41fb-9a8b-d45b1dbcca4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:19.811185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07425a-2bd3-41fb-9a8b-d45b1dbcca4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:19.811471 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07425a-2bd3-41fb-9a8b-d45b1dbcca4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:19.811744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07425a-2bd3-41fb-9a8b-d45b1dbcca4d admin admin] PATH_INFO: `/v3/projects/4474dada2993403683823616ae3fd512/users/19721f152a9547908adc4cf5ddb7d885/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:19.841835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07425a-2bd3-41fb-9a8b-d45b1dbcca4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4474dada2993403683823616ae3fd512, user_id=19721f152a9547908adc4cf5ddb7d885, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:19.846843 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07425a-2bd3-41fb-9a8b-d45b1dbcca4d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:19.876801 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 942/1881] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:19 2022] PUT /identity/v3/projects/4474dada2993403683823616ae3fd512/users/19721f152a9547908adc4cf5ddb7d885/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:19.880835 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2443c-3237-4105-a9c4-283b44ef9e01 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:19.893512 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2443c-3237-4105-a9c4-283b44ef9e01 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:20.007189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6469c4-a267-42eb-925f-96922a47af09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:20.008187 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6469c4-a267-42eb-925f-96922a47af09 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:20.009151 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6469c4-a267-42eb-925f-96922a47af09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:20.009704 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6469c4-a267-42eb-925f-96922a47af09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:20.010902 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6469c4-a267-42eb-925f-96922a47af09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:20.014366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6469c4-a267-42eb-925f-96922a47af09 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:20.028145 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 940/1882] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:07:20.033892 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07425a-2bd3-41fb-9a8b-d45b1dbcca4d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:20.059989 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07425a-2bd3-41fb-9a8b-d45b1dbcca4d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:20.074868 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821dc0c2-125b-4d0c-9183-233c0e9bd9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:20.075514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821dc0c2-125b-4d0c-9183-233c0e9bd9f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:20.075970 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821dc0c2-125b-4d0c-9183-233c0e9bd9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:20.077106 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821dc0c2-125b-4d0c-9183-233c0e9bd9f7 admin admin] PATH_INFO: `/v3/projects/4474dada2993403683823616ae3fd512/users/19721f152a9547908adc4cf5ddb7d885/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:20.081892 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821dc0c2-125b-4d0c-9183-233c0e9bd9f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4474dada2993403683823616ae3fd512, user_id=19721f152a9547908adc4cf5ddb7d885, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:20.086032 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821dc0c2-125b-4d0c-9183-233c0e9bd9f7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:20.123333 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efc64a-090f-4760-846d-994639419547 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:20.127397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efc64a-090f-4760-846d-994639419547 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:20.127397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efc64a-090f-4760-846d-994639419547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:20.127568 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 943/1883] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:20 2022] PUT /identity/v3/projects/4474dada2993403683823616ae3fd512/users/19721f152a9547908adc4cf5ddb7d885/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:07:20.128557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821dc0c2-125b-4d0c-9183-233c0e9bd9f7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:20.130636 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-821dc0c2-125b-4d0c-9183-233c0e9bd9f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:20.201721 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-88efc64a-090f-4760-846d-994639419547 None None] MFA Rules not processed for user `19721f152a9547908adc4cf5ddb7d885`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:20.203076 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-88efc64a-090f-4760-846d-994639419547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:20.216206 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:20.232901 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821dc0c2-125b-4d0c-9183-233c0e9bd9f7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:20.241143 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed5631-2767-4d47-91d6-fb2c0f4d43e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:20.242202 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed5631-2767-4d47-91d6-fb2c0f4d43e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:20.242580 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed5631-2767-4d47-91d6-fb2c0f4d43e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:20.243114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed5631-2767-4d47-91d6-fb2c0f4d43e0 admin admin] PATH_INFO: `/v3/users/aa38637798a7459dbbc84d798ae06316` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:20.244704 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed5631-2767-4d47-91d6-fb2c0f4d43e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa38637798a7459dbbc84d798ae06316)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:20.247551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed5631-2767-4d47-91d6-fb2c0f4d43e0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:20.340426 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 941/1884] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:20 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:20.352674 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b5ed5631-2767-4d47-91d6-fb2c0f4d43e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa38637798a7459dbbc84d798ae06316'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:20.354969 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efc64a-090f-4760-846d-994639419547 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:20.357813 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-88efc64a-090f-4760-846d-994639419547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:20.366888 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b5ed5631-2767-4d47-91d6-fb2c0f4d43e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa38637798a7459dbbc84d798ae06316'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:20.368101 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b5ed5631-2767-4d47-91d6-fb2c0f4d43e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa38637798a7459dbbc84d798ae06316'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:20.411287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b5ed5631-2767-4d47-91d6-fb2c0f4d43e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa38637798a7459dbbc84d798ae06316'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:20.439309 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b5ed5631-2767-4d47-91d6-fb2c0f4d43e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa38637798a7459dbbc84d798ae06316'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:20.458277 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 944/1885] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:20 2022] DELETE /identity/v3/users/aa38637798a7459dbbc84d798ae06316 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:20.463028 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2939ca-e766-47f8-9809-9a994dac9da2 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:20.463315 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2939ca-e766-47f8-9809-9a994dac9da2 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:20.463602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2939ca-e766-47f8-9809-9a994dac9da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:20.495414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:20.515045 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efc64a-090f-4760-846d-994639419547 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:20.518107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8c2939ca-e766-47f8-9809-9a994dac9da2 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:20.520830 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8c2939ca-e766-47f8-9809-9a994dac9da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:20.590855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309c2dd-457b-4c40-ad37-21155ce39577 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:20.591540 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309c2dd-457b-4c40-ad37-21155ce39577 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:20.591827 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309c2dd-457b-4c40-ad37-21155ce39577 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:20.592158 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309c2dd-457b-4c40-ad37-21155ce39577 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:20.596241 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0309c2dd-457b-4c40-ad37-21155ce39577 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:20.700287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 945/1886] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:20.729307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2939ca-e766-47f8-9809-9a994dac9da2 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:20.730603 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8c2939ca-e766-47f8-9809-9a994dac9da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:20.744770 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0309c2dd-457b-4c40-ad37-21155ce39577 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:20.746871 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0309c2dd-457b-4c40-ad37-21155ce39577 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:20.761836 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 942/1887] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:20 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:20.842352 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2939ca-e766-47f8-9809-9a994dac9da2 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:20.851687 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4c376-c738-4be7-ae2e-2ea8bd4cfb38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:20.853712 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4c376-c738-4be7-ae2e-2ea8bd4cfb38 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:20.854660 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4c376-c738-4be7-ae2e-2ea8bd4cfb38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:20.856106 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4c376-c738-4be7-ae2e-2ea8bd4cfb38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:20.879890 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4c376-c738-4be7-ae2e-2ea8bd4cfb38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:20.881572 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4c376-c738-4be7-ae2e-2ea8bd4cfb38 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:20.897201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 946/1888] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:07:20.912721 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309c2dd-457b-4c40-ad37-21155ce39577 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:20.912721 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0309c2dd-457b-4c40-ad37-21155ce39577 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:20.950251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309c2dd-457b-4c40-ad37-21155ce39577 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:20.965168 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d21aba-6eee-4c64-8a07-17cf563bda28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:20.966846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d21aba-6eee-4c64-8a07-17cf563bda28 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:20.967142 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d21aba-6eee-4c64-8a07-17cf563bda28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:20.972194 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d21aba-6eee-4c64-8a07-17cf563bda28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:20.975548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4c376-c738-4be7-ae2e-2ea8bd4cfb38 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:20.977102 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8dd4c376-c738-4be7-ae2e-2ea8bd4cfb38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:20.979525 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-43d21aba-6eee-4c64-8a07-17cf563bda28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:20.999723 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:21.014940 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4c376-c738-4be7-ae2e-2ea8bd4cfb38 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:21.025539 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e41dc-8a3f-4570-8119-864948a40808 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:21.026219 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e41dc-8a3f-4570-8119-864948a40808 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:21.032735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e41dc-8a3f-4570-8119-864948a40808 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:21.033860 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e41dc-8a3f-4570-8119-864948a40808 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:21.036326 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-726e41dc-8a3f-4570-8119-864948a40808 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:21.152699 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e41dc-8a3f-4570-8119-864948a40808 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:21.154267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e41dc-8a3f-4570-8119-864948a40808 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:21.178477 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 947/1889] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:20 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:21.186551 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d21aba-6eee-4c64-8a07-17cf563bda28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:21.189151 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d21aba-6eee-4c64-8a07-17cf563bda28 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:21.219987 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 943/1890] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:21.497317 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e41dc-8a3f-4570-8119-864948a40808 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:21.502602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-726e41dc-8a3f-4570-8119-864948a40808 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:21.544849 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e41dc-8a3f-4570-8119-864948a40808 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:21.554632 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213183f-5f72-4522-8977-092e1b3fab72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:21.557269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213183f-5f72-4522-8977-092e1b3fab72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:21.557915 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213183f-5f72-4522-8977-092e1b3fab72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:21.558672 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213183f-5f72-4522-8977-092e1b3fab72 admin admin] PATH_INFO: `/v3/projects/dbd24e8860e44b19871c0dd7f3ddaf65` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:21.560719 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213183f-5f72-4522-8977-092e1b3fab72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbd24e8860e44b19871c0dd7f3ddaf65)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:21.578342 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213183f-5f72-4522-8977-092e1b3fab72 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:21.686437 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:21.701504 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9213183f-5f72-4522-8977-092e1b3fab72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbd24e8860e44b19871c0dd7f3ddaf65', 'request_id': 'req-9213183f-5f72-4522-8977-092e1b3fab72'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:21.724278 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9213183f-5f72-4522-8977-092e1b3fab72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbd24e8860e44b19871c0dd7f3ddaf65', 'request_id': 'req-9213183f-5f72-4522-8977-092e1b3fab72'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:21.756394 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9213183f-5f72-4522-8977-092e1b3fab72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbd24e8860e44b19871c0dd7f3ddaf65', 'request_id': 'req-9213183f-5f72-4522-8977-092e1b3fab72'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:21.792342 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9213183f-5f72-4522-8977-092e1b3fab72 admin admin] The token cache is being invalidate because project dbd24e8860e44b19871c0dd7f3ddaf65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:21.792892 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9213183f-5f72-4522-8977-092e1b3fab72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:21.794466 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9213183f-5f72-4522-8977-092e1b3fab72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:21.797180 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 948/1891] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:21 2022] DELETE /identity/v3/projects/dbd24e8860e44b19871c0dd7f3ddaf65 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:21.802139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d21aba-6eee-4c64-8a07-17cf563bda28 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:21.828134 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d21aba-6eee-4c64-8a07-17cf563bda28 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:21.994840 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a136a-3352-4fa6-8341-05d2143fe2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:21.996350 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a136a-3352-4fa6-8341-05d2143fe2ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:21.996679 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a136a-3352-4fa6-8341-05d2143fe2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:21.996956 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a136a-3352-4fa6-8341-05d2143fe2ee admin admin] PATH_INFO: `/v3/users/55c3133d2d984921955a41056788e87d` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:21.999066 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a136a-3352-4fa6-8341-05d2143fe2ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=55c3133d2d984921955a41056788e87d)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:22.002644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a136a-3352-4fa6-8341-05d2143fe2ee admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:22.077714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-863a136a-3352-4fa6-8341-05d2143fe2ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55c3133d2d984921955a41056788e87d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:22.103501 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-863a136a-3352-4fa6-8341-05d2143fe2ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55c3133d2d984921955a41056788e87d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:22.126709 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-863a136a-3352-4fa6-8341-05d2143fe2ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55c3133d2d984921955a41056788e87d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:22.128123 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-863a136a-3352-4fa6-8341-05d2143fe2ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55c3133d2d984921955a41056788e87d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:22.128945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-863a136a-3352-4fa6-8341-05d2143fe2ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55c3133d2d984921955a41056788e87d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:22.162985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 944/1892] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:21 2022] DELETE /identity/v3/users/55c3133d2d984921955a41056788e87d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:22.552115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213183f-5f72-4522-8977-092e1b3fab72 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:22.553585 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9213183f-5f72-4522-8977-092e1b3fab72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:22.572179 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213183f-5f72-4522-8977-092e1b3fab72 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:22.638134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d07cd-ea92-451e-ac0b-1d8bdc347382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:22.639165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d07cd-ea92-451e-ac0b-1d8bdc347382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:22.639290 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d07cd-ea92-451e-ac0b-1d8bdc347382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:22.639533 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d07cd-ea92-451e-ac0b-1d8bdc347382 admin admin] PATH_INFO: `/v3/projects/31337418bf384126a682b85da6650da0` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:22.642210 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d07cd-ea92-451e-ac0b-1d8bdc347382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31337418bf384126a682b85da6650da0)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:22.644163 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d07cd-ea92-451e-ac0b-1d8bdc347382 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:22.697449 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f67d07cd-ea92-451e-ac0b-1d8bdc347382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31337418bf384126a682b85da6650da0', 'request_id': 'req-f67d07cd-ea92-451e-ac0b-1d8bdc347382'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:22.711115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f67d07cd-ea92-451e-ac0b-1d8bdc347382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31337418bf384126a682b85da6650da0', 'request_id': 'req-f67d07cd-ea92-451e-ac0b-1d8bdc347382'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:22.715027 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f67d07cd-ea92-451e-ac0b-1d8bdc347382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31337418bf384126a682b85da6650da0', 'request_id': 'req-f67d07cd-ea92-451e-ac0b-1d8bdc347382'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:22.731729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f67d07cd-ea92-451e-ac0b-1d8bdc347382 admin admin] The token cache is being invalidate because project 31337418bf384126a682b85da6650da0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:22.731729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f67d07cd-ea92-451e-ac0b-1d8bdc347382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:22.731729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f67d07cd-ea92-451e-ac0b-1d8bdc347382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:22.733068 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 949/1893] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:22 2022] DELETE /identity/v3/projects/31337418bf384126a682b85da6650da0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:22.737460 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a136a-3352-4fa6-8341-05d2143fe2ee admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:22.741632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-863a136a-3352-4fa6-8341-05d2143fe2ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:22.755925 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a136a-3352-4fa6-8341-05d2143fe2ee admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:22.784469 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:22.846889 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210a363-b47c-4c29-ac0c-2009252300e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:22.847800 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210a363-b47c-4c29-ac0c-2009252300e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:22.848081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210a363-b47c-4c29-ac0c-2009252300e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:22.848357 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210a363-b47c-4c29-ac0c-2009252300e4 admin admin] PATH_INFO: `/v3/users/529402d779104aa0bcbdd35880e93fb7` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:22.849653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210a363-b47c-4c29-ac0c-2009252300e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=529402d779104aa0bcbdd35880e93fb7)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:22.851749 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210a363-b47c-4c29-ac0c-2009252300e4 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:22.947838 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3210a363-b47c-4c29-ac0c-2009252300e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '529402d779104aa0bcbdd35880e93fb7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:22.971509 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3210a363-b47c-4c29-ac0c-2009252300e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '529402d779104aa0bcbdd35880e93fb7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:23.012445 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3210a363-b47c-4c29-ac0c-2009252300e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '529402d779104aa0bcbdd35880e93fb7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:23.017095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3210a363-b47c-4c29-ac0c-2009252300e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '529402d779104aa0bcbdd35880e93fb7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:23.018132 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3210a363-b47c-4c29-ac0c-2009252300e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '529402d779104aa0bcbdd35880e93fb7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:23.065001 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 945/1894] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:22 2022] DELETE /identity/v3/users/529402d779104aa0bcbdd35880e93fb7 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:07:24.356258 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d07cd-ea92-451e-ac0b-1d8bdc347382 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:24.357899 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f67d07cd-ea92-451e-ac0b-1d8bdc347382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:24.386228 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d07cd-ea92-451e-ac0b-1d8bdc347382 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:24.498219 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:24.508151 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49b4cc-ad28-44e2-8ab9-6b363aa3622c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:24.509882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49b4cc-ad28-44e2-8ab9-6b363aa3622c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:24.510459 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49b4cc-ad28-44e2-8ab9-6b363aa3622c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:24.511114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49b4cc-ad28-44e2-8ab9-6b363aa3622c admin admin] PATH_INFO: `/v3/users/6c3e7c82061c4a108e28be6a51f39bc6` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:24.513224 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49b4cc-ad28-44e2-8ab9-6b363aa3622c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c3e7c82061c4a108e28be6a51f39bc6)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:24.516078 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49b4cc-ad28-44e2-8ab9-6b363aa3622c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:24.557704 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210a363-b47c-4c29-ac0c-2009252300e4 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:24.559973 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3210a363-b47c-4c29-ac0c-2009252300e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:24.578460 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210a363-b47c-4c29-ac0c-2009252300e4 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:24.584628 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484647b8-5a54-4fdd-afed-6957624e9d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:24.585571 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484647b8-5a54-4fdd-afed-6957624e9d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:24.585895 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484647b8-5a54-4fdd-afed-6957624e9d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:24.586341 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484647b8-5a54-4fdd-afed-6957624e9d3a admin admin] PATH_INFO: `/v3/projects/09b3e2630a254db4a083cbbbf666dc04` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:24.588225 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484647b8-5a54-4fdd-afed-6957624e9d3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=09b3e2630a254db4a083cbbbf666dc04)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:24.594808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484647b8-5a54-4fdd-afed-6957624e9d3a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:24.606696 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ea49b4cc-ad28-44e2-8ab9-6b363aa3622c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c3e7c82061c4a108e28be6a51f39bc6'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:24.616047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ea49b4cc-ad28-44e2-8ab9-6b363aa3622c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c3e7c82061c4a108e28be6a51f39bc6'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:24.616899 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ea49b4cc-ad28-44e2-8ab9-6b363aa3622c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c3e7c82061c4a108e28be6a51f39bc6'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:24.638590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ea49b4cc-ad28-44e2-8ab9-6b363aa3622c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c3e7c82061c4a108e28be6a51f39bc6'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:24.652891 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ea49b4cc-ad28-44e2-8ab9-6b363aa3622c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c3e7c82061c4a108e28be6a51f39bc6'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:24.660751 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 950/1895] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:24 2022] DELETE /identity/v3/users/6c3e7c82061c4a108e28be6a51f39bc6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:07:24.665605 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41899d1f-0382-4021-bdef-c24c411f35a0 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:24.666025 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41899d1f-0382-4021-bdef-c24c411f35a0 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:24.666429 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41899d1f-0382-4021-bdef-c24c411f35a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:24.669585 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-484647b8-5a54-4fdd-afed-6957624e9d3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09b3e2630a254db4a083cbbbf666dc04', 'request_id': 'req-484647b8-5a54-4fdd-afed-6957624e9d3a'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:24.680936 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-484647b8-5a54-4fdd-afed-6957624e9d3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09b3e2630a254db4a083cbbbf666dc04', 'request_id': 'req-484647b8-5a54-4fdd-afed-6957624e9d3a'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:24.689334 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-41899d1f-0382-4021-bdef-c24c411f35a0 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:24.690769 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-41899d1f-0382-4021-bdef-c24c411f35a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:24.691428 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-484647b8-5a54-4fdd-afed-6957624e9d3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09b3e2630a254db4a083cbbbf666dc04', 'request_id': 'req-484647b8-5a54-4fdd-afed-6957624e9d3a'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:24.711781 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-484647b8-5a54-4fdd-afed-6957624e9d3a admin admin] The token cache is being invalidate because project 09b3e2630a254db4a083cbbbf666dc04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:24.712890 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-484647b8-5a54-4fdd-afed-6957624e9d3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:24.714343 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-484647b8-5a54-4fdd-afed-6957624e9d3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:24.716473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 946/1896] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:24 2022] DELETE /identity/v3/projects/09b3e2630a254db4a083cbbbf666dc04 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:24.723991 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3b2eb-ff84-401d-a6dd-a0be6c266fb1 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:24.724557 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3b2eb-ff84-401d-a6dd-a0be6c266fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:24.725029 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3b2eb-ff84-401d-a6dd-a0be6c266fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:24.767823 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-f0a3b2eb-ff84-401d-a6dd-a0be6c266fb1 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:24.772166 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f0a3b2eb-ff84-401d-a6dd-a0be6c266fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:24.791984 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 951/1897] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:07:24.806780 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41899d1f-0382-4021-bdef-c24c411f35a0 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:24.809405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-41899d1f-0382-4021-bdef-c24c411f35a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:24.812654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:24.879830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 947/1898] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:24.890391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca41e7-ad39-404c-bf68-fa8001f6993a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:24.890686 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca41e7-ad39-404c-bf68-fa8001f6993a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:24.890968 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca41e7-ad39-404c-bf68-fa8001f6993a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:24.920786 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-83ca41e7-ad39-404c-bf68-fa8001f6993a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:24.922843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-83ca41e7-ad39-404c-bf68-fa8001f6993a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:24.929573 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41899d1f-0382-4021-bdef-c24c411f35a0 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:24.934905 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46ffd3-a00c-41a8-b061-e1d9dba19600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:24.935905 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46ffd3-a00c-41a8-b061-e1d9dba19600 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:24.940105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46ffd3-a00c-41a8-b061-e1d9dba19600 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:24.940241 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 948/1899] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:07:24.940321 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46ffd3-a00c-41a8-b061-e1d9dba19600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:24.948494 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca41e7-ad39-404c-bf68-fa8001f6993a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:24.950932 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46ffd3-a00c-41a8-b061-e1d9dba19600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:24.952869 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46ffd3-a00c-41a8-b061-e1d9dba19600 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:24.962508 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca41e7-ad39-404c-bf68-fa8001f6993a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:24.970066 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 952/1900] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:24.974088 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdd03f-8888-4621-ae98-782d7e779ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:24.974820 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdd03f-8888-4621-ae98-782d7e779ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:24.975095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdd03f-8888-4621-ae98-782d7e779ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:24.975370 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdd03f-8888-4621-ae98-782d7e779ae9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:24.979396 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcdd03f-8888-4621-ae98-782d7e779ae9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:07:24.980188 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcdd03f-8888-4621-ae98-782d7e779ae9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:24.981916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcdd03f-8888-4621-ae98-782d7e779ae9 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:25.007793 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 949/1901] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:07:25.009150 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46ffd3-a00c-41a8-b061-e1d9dba19600 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:25.026279 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46ffd3-a00c-41a8-b061-e1d9dba19600 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:25.045199 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83161e85-1968-4c1c-9aac-c0af935f04c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:25.047005 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83161e85-1968-4c1c-9aac-c0af935f04c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:25.047761 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83161e85-1968-4c1c-9aac-c0af935f04c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:25.048191 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83161e85-1968-4c1c-9aac-c0af935f04c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:25.049791 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83161e85-1968-4c1c-9aac-c0af935f04c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:25.052893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83161e85-1968-4c1c-9aac-c0af935f04c4 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:25.101030 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:25.116662 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 953/1902] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:25 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:25.120896 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdd03f-8888-4621-ae98-782d7e779ae9 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:25.137539 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdd03f-8888-4621-ae98-782d7e779ae9 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:25.215672 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e48da-c029-4c58-a4b0-538153501d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:25.216425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e48da-c029-4c58-a4b0-538153501d71 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:25.216737 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e48da-c029-4c58-a4b0-538153501d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:25.217021 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e48da-c029-4c58-a4b0-538153501d71 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:25.217781 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e48da-c029-4c58-a4b0-538153501d71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:25.219854 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e48da-c029-4c58-a4b0-538153501d71 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:25.252533 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 950/1903] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:25 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:25.253758 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83161e85-1968-4c1c-9aac-c0af935f04c4 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:25.266983 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83161e85-1968-4c1c-9aac-c0af935f04c4 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:25.273010 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eaa769-1068-4443-b494-2b1fa15d58cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:25.273881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eaa769-1068-4443-b494-2b1fa15d58cc admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:25.274217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eaa769-1068-4443-b494-2b1fa15d58cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:25.274530 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eaa769-1068-4443-b494-2b1fa15d58cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:25.275261 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eaa769-1068-4443-b494-2b1fa15d58cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:25.276982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eaa769-1068-4443-b494-2b1fa15d58cc admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:25.290296 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 954/1904] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:25.295126 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e48da-c029-4c58-a4b0-538153501d71 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:25.306384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e48da-c029-4c58-a4b0-538153501d71 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:25.311357 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88905d-15e3-4699-a8ba-2b1cf6e561cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:25.312318 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88905d-15e3-4699-a8ba-2b1cf6e561cc admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:25.312318 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88905d-15e3-4699-a8ba-2b1cf6e561cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:25.312608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88905d-15e3-4699-a8ba-2b1cf6e561cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:25.312608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88905d-15e3-4699-a8ba-2b1cf6e561cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:25.315684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88905d-15e3-4699-a8ba-2b1cf6e561cc admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:25.332186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 951/1905] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:25.338081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eaa769-1068-4443-b494-2b1fa15d58cc admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:25.352630 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eaa769-1068-4443-b494-2b1fa15d58cc admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:25.359131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f1c72-f3a5-4a5e-b7fe-6f6d9ec94be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:25.362168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f1c72-f3a5-4a5e-b7fe-6f6d9ec94be1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:25.362448 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f1c72-f3a5-4a5e-b7fe-6f6d9ec94be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:25.362725 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f1c72-f3a5-4a5e-b7fe-6f6d9ec94be1 admin admin] PATH_INFO: `/v3/projects/f8fde6110c5e4623ab34b4f4cc4f410a/users/56be220b79e14b40beef176a65e553d2/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:25.389099 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f1c72-f3a5-4a5e-b7fe-6f6d9ec94be1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8fde6110c5e4623ab34b4f4cc4f410a, user_id=56be220b79e14b40beef176a65e553d2, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:25.391806 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f1c72-f3a5-4a5e-b7fe-6f6d9ec94be1 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:25.417242 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 955/1906] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:25 2022] PUT /identity/v3/projects/f8fde6110c5e4623ab34b4f4cc4f410a/users/56be220b79e14b40beef176a65e553d2/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:25.436329 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05d8ac-7951-4e9e-a17a-43041cee871b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:25.436650 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05d8ac-7951-4e9e-a17a-43041cee871b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:25.436936 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05d8ac-7951-4e9e-a17a-43041cee871b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:25.472706 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8a05d8ac-7951-4e9e-a17a-43041cee871b None None] MFA Rules not processed for user `56be220b79e14b40beef176a65e553d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:25.476131 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8a05d8ac-7951-4e9e-a17a-43041cee871b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:25.601353 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 952/1907] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:25.605955 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f1c72-f3a5-4a5e-b7fe-6f6d9ec94be1 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:25.704698 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f1c72-f3a5-4a5e-b7fe-6f6d9ec94be1 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:25.710895 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558a6dc-440e-453d-8241-b36e5ae87510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:25.712092 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558a6dc-440e-453d-8241-b36e5ae87510 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:25.712712 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558a6dc-440e-453d-8241-b36e5ae87510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:25.713291 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558a6dc-440e-453d-8241-b36e5ae87510 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:25.714449 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558a6dc-440e-453d-8241-b36e5ae87510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:25.716988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558a6dc-440e-453d-8241-b36e5ae87510 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:25.764663 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 956/1908] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:25 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:07:25.769475 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05d8ac-7951-4e9e-a17a-43041cee871b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:25.800574 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05d8ac-7951-4e9e-a17a-43041cee871b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:25.811185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558a6dc-440e-453d-8241-b36e5ae87510 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:25.813806 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8558a6dc-440e-453d-8241-b36e5ae87510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:25.863261 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:25.988463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558a6dc-440e-453d-8241-b36e5ae87510 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:25.988902 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77feb699-afe8-4aa6-9f2c-e239f3af8f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:25.989621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77feb699-afe8-4aa6-9f2c-e239f3af8f98 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:25.989911 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77feb699-afe8-4aa6-9f2c-e239f3af8f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:25.990284 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77feb699-afe8-4aa6-9f2c-e239f3af8f98 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:25.991453 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77feb699-afe8-4aa6-9f2c-e239f3af8f98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:25.996910 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39287e-89d7-4fbf-bd78-f5d5a8874b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:25.998038 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39287e-89d7-4fbf-bd78-f5d5a8874b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:25.998242 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77feb699-afe8-4aa6-9f2c-e239f3af8f98 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:25.998631 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39287e-89d7-4fbf-bd78-f5d5a8874b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:25.999129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39287e-89d7-4fbf-bd78-f5d5a8874b3b admin admin] PATH_INFO: `/v3/projects/01ca46912d514e04986bb84d37869941` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:26.001348 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39287e-89d7-4fbf-bd78-f5d5a8874b3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=01ca46912d514e04986bb84d37869941)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:26.004093 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39287e-89d7-4fbf-bd78-f5d5a8874b3b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:26.038509 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 953/1909] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:25 2022] POST /identity/v3/users => generated 298 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:26.042703 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77feb699-afe8-4aa6-9f2c-e239f3af8f98 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:26.055333 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77feb699-afe8-4aa6-9f2c-e239f3af8f98 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:26.062176 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b77c4-aadd-4350-a2c2-41804703dde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:26.063185 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b77c4-aadd-4350-a2c2-41804703dde3 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:26.063634 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b77c4-aadd-4350-a2c2-41804703dde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:26.065576 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b77c4-aadd-4350-a2c2-41804703dde3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:26.066719 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b77c4-aadd-4350-a2c2-41804703dde3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:26.068596 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b77c4-aadd-4350-a2c2-41804703dde3 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:26.082765 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 954/1910] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:26.087070 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b77c4-aadd-4350-a2c2-41804703dde3 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:26.103078 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3e39287e-89d7-4fbf-bd78-f5d5a8874b3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01ca46912d514e04986bb84d37869941', 'request_id': 'req-3e39287e-89d7-4fbf-bd78-f5d5a8874b3b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:26.107222 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:26.109545 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b77c4-aadd-4350-a2c2-41804703dde3 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:26.121701 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3e39287e-89d7-4fbf-bd78-f5d5a8874b3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01ca46912d514e04986bb84d37869941', 'request_id': 'req-3e39287e-89d7-4fbf-bd78-f5d5a8874b3b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:26.132734 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3e39287e-89d7-4fbf-bd78-f5d5a8874b3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01ca46912d514e04986bb84d37869941', 'request_id': 'req-3e39287e-89d7-4fbf-bd78-f5d5a8874b3b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:26.160144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3e39287e-89d7-4fbf-bd78-f5d5a8874b3b admin admin] The token cache is being invalidate because project 01ca46912d514e04986bb84d37869941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:26.160609 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3e39287e-89d7-4fbf-bd78-f5d5a8874b3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:26.162539 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3e39287e-89d7-4fbf-bd78-f5d5a8874b3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:26.167366 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 957/1911] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:25 2022] DELETE /identity/v3/projects/01ca46912d514e04986bb84d37869941 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:26.169151 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39287e-89d7-4fbf-bd78-f5d5a8874b3b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:26.170848 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3e39287e-89d7-4fbf-bd78-f5d5a8874b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:26.241944 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e966b-6e61-4705-9dc3-292aa34b8754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:26.242940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e966b-6e61-4705-9dc3-292aa34b8754 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:26.243297 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e966b-6e61-4705-9dc3-292aa34b8754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:26.243629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e966b-6e61-4705-9dc3-292aa34b8754 admin admin] PATH_INFO: `/v3/projects/41ee941dda314989a5052b8e550fe8dd/users/733d408f16c443af87cac269e9b5948d/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:26.264658 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e966b-6e61-4705-9dc3-292aa34b8754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ee941dda314989a5052b8e550fe8dd, user_id=733d408f16c443af87cac269e9b5948d, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:26.268312 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e966b-6e61-4705-9dc3-292aa34b8754 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:26.289655 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 955/1912] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:26 2022] PUT /identity/v3/projects/41ee941dda314989a5052b8e550fe8dd/users/733d408f16c443af87cac269e9b5948d/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:07:26.290646 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e966b-6e61-4705-9dc3-292aa34b8754 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:26.294131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39287e-89d7-4fbf-bd78-f5d5a8874b3b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:26.294631 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-972e966b-6e61-4705-9dc3-292aa34b8754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:26.397800 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e966b-6e61-4705-9dc3-292aa34b8754 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:26.400761 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50739be-d56e-4900-8028-dc110458e738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:26.401728 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50739be-d56e-4900-8028-dc110458e738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:26.402591 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50739be-d56e-4900-8028-dc110458e738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:26.402591 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50739be-d56e-4900-8028-dc110458e738 admin admin] PATH_INFO: `/v3/users/d12a022ac8fa48ddac5ddb6fae84d4eb` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:26.403945 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50739be-d56e-4900-8028-dc110458e738 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d12a022ac8fa48ddac5ddb6fae84d4eb)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:26.405231 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f4b21-f154-4358-8fb0-b23b0af130a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:26.405997 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50739be-d56e-4900-8028-dc110458e738 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:26.406609 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f4b21-f154-4358-8fb0-b23b0af130a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:26.408571 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f4b21-f154-4358-8fb0-b23b0af130a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:26.409084 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f4b21-f154-4358-8fb0-b23b0af130a0 admin admin] PATH_INFO: `/v3/users/c2476f70364e41e786bfb3e472e192d9` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:26.410702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f4b21-f154-4358-8fb0-b23b0af130a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2476f70364e41e786bfb3e472e192d9)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:26.413744 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f4b21-f154-4358-8fb0-b23b0af130a0 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:26.442481 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:26.483831 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e50739be-d56e-4900-8028-dc110458e738 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd12a022ac8fa48ddac5ddb6fae84d4eb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:26.492707 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-979f4b21-f154-4358-8fb0-b23b0af130a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2476f70364e41e786bfb3e472e192d9'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:26.499503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e50739be-d56e-4900-8028-dc110458e738 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd12a022ac8fa48ddac5ddb6fae84d4eb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:26.500252 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e50739be-d56e-4900-8028-dc110458e738 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd12a022ac8fa48ddac5ddb6fae84d4eb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:26.506626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-979f4b21-f154-4358-8fb0-b23b0af130a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2476f70364e41e786bfb3e472e192d9'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:26.530186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e50739be-d56e-4900-8028-dc110458e738 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd12a022ac8fa48ddac5ddb6fae84d4eb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:26.541775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e50739be-d56e-4900-8028-dc110458e738 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd12a022ac8fa48ddac5ddb6fae84d4eb'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:26.543004 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-979f4b21-f154-4358-8fb0-b23b0af130a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2476f70364e41e786bfb3e472e192d9'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:26.544040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-979f4b21-f154-4358-8fb0-b23b0af130a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2476f70364e41e786bfb3e472e192d9'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:26.545031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-979f4b21-f154-4358-8fb0-b23b0af130a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2476f70364e41e786bfb3e472e192d9'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:26.550223 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 958/1913] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:26 2022] DELETE /identity/v3/users/d12a022ac8fa48ddac5ddb6fae84d4eb => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:07:26.551153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50739be-d56e-4900-8028-dc110458e738 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:26.554386 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e50739be-d56e-4900-8028-dc110458e738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:26.562561 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:26.565630 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 956/1914] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:26 2022] DELETE /identity/v3/users/c2476f70364e41e786bfb3e472e192d9 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:26.572397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117a479-e52d-4820-93dd-640e61c2620b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:26.573068 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117a479-e52d-4820-93dd-640e61c2620b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:26.573068 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117a479-e52d-4820-93dd-640e61c2620b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:26.597064 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-2117a479-e52d-4820-93dd-640e61c2620b None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:26.598487 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2117a479-e52d-4820-93dd-640e61c2620b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:26.666775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50739be-d56e-4900-8028-dc110458e738 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:26.695380 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 957/1915] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:26.707482 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117a479-e52d-4820-93dd-640e61c2620b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:26.709131 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2117a479-e52d-4820-93dd-640e61c2620b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:26.746674 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49cbba-f6eb-475d-90c7-b12b056e52f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:26.747684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49cbba-f6eb-475d-90c7-b12b056e52f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:26.748094 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49cbba-f6eb-475d-90c7-b12b056e52f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:26.748553 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49cbba-f6eb-475d-90c7-b12b056e52f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:26.749357 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd49cbba-f6eb-475d-90c7-b12b056e52f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:26.751318 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd49cbba-f6eb-475d-90c7-b12b056e52f6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:26.764784 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 959/1916] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:26.769599 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49cbba-f6eb-475d-90c7-b12b056e52f6 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:26.771576 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-bd49cbba-f6eb-475d-90c7-b12b056e52f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:26.795394 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49cbba-f6eb-475d-90c7-b12b056e52f6 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:26.800168 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117a479-e52d-4820-93dd-640e61c2620b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:26.801472 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda3830-17a1-4549-91ff-ade64327ec7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:26.802556 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda3830-17a1-4549-91ff-ade64327ec7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:26.802843 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda3830-17a1-4549-91ff-ade64327ec7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:26.803123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda3830-17a1-4549-91ff-ade64327ec7f admin admin] PATH_INFO: `/v3/projects/41ee941dda314989a5052b8e550fe8dd/users/733d408f16c443af87cac269e9b5948d/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:26.805172 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda3830-17a1-4549-91ff-ade64327ec7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ee941dda314989a5052b8e550fe8dd, user_id=733d408f16c443af87cac269e9b5948d, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:26.805766 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc72968-f04c-4521-9130-34c8e00d76cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:26.806580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc72968-f04c-4521-9130-34c8e00d76cc service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:26.807005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc72968-f04c-4521-9130-34c8e00d76cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:26.807421 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc72968-f04c-4521-9130-34c8e00d76cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:26.807887 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda3830-17a1-4549-91ff-ade64327ec7f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:26.819024 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc72968-f04c-4521-9130-34c8e00d76cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:26.820828 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc72968-f04c-4521-9130-34c8e00d76cc service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:26.821045 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 960/1917] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:26 2022] PUT /identity/v3/projects/41ee941dda314989a5052b8e550fe8dd/users/733d408f16c443af87cac269e9b5948d/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:26.833630 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 958/1918] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:26.845789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687f371-af16-4b76-a4d3-02c87f2dd594 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:26.846141 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687f371-af16-4b76-a4d3-02c87f2dd594 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:26.846489 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687f371-af16-4b76-a4d3-02c87f2dd594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:26.876397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-9687f371-af16-4b76-a4d3-02c87f2dd594 None None] MFA Rules not processed for user `733d408f16c443af87cac269e9b5948d`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:26.878137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9687f371-af16-4b76-a4d3-02c87f2dd594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:26.974878 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 961/1919] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:26.983900 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc72968-f04c-4521-9130-34c8e00d76cc service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:26.986377 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3bc72968-f04c-4521-9130-34c8e00d76cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:27.031479 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687f371-af16-4b76-a4d3-02c87f2dd594 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:27.034456 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9687f371-af16-4b76-a4d3-02c87f2dd594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:27.077838 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:27.088330 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:27.116006 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc72968-f04c-4521-9130-34c8e00d76cc service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:27.170876 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687f371-af16-4b76-a4d3-02c87f2dd594 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:27.178873 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd437740-f34e-47cf-98a1-c22944b70d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:27.180881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd437740-f34e-47cf-98a1-c22944b70d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:27.181558 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd437740-f34e-47cf-98a1-c22944b70d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:27.182458 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd437740-f34e-47cf-98a1-c22944b70d57 admin admin] PATH_INFO: `/v3/projects/6930a630d6e849dd8b921434ad9cd458` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:27.184181 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd437740-f34e-47cf-98a1-c22944b70d57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6930a630d6e849dd8b921434ad9cd458)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:27.187264 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd437740-f34e-47cf-98a1-c22944b70d57 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:27.192386 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5890c-f71c-425b-a15f-535077c145b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:27.193615 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5890c-f71c-425b-a15f-535077c145b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:27.195183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5890c-f71c-425b-a15f-535077c145b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:27.195723 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5890c-f71c-425b-a15f-535077c145b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:27.217689 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5890c-f71c-425b-a15f-535077c145b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:27.219927 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5890c-f71c-425b-a15f-535077c145b7 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:27.237009 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 959/1920] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:27.238252 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5890c-f71c-425b-a15f-535077c145b7 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:27.239672 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-25e5890c-f71c-425b-a15f-535077c145b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:27.255476 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5890c-f71c-425b-a15f-535077c145b7 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:27.261173 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b4ff1-0a07-4171-b636-10eb4aaf8af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:27.262073 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b4ff1-0a07-4171-b636-10eb4aaf8af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:27.262356 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b4ff1-0a07-4171-b636-10eb4aaf8af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:27.262638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b4ff1-0a07-4171-b636-10eb4aaf8af7 admin admin] PATH_INFO: `/v3/projects/b6745bf47c01490b9e71122ada42ac25` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:27.263989 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b4ff1-0a07-4171-b636-10eb4aaf8af7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6745bf47c01490b9e71122ada42ac25)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:27.266295 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b4ff1-0a07-4171-b636-10eb4aaf8af7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:27.282886 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cd437740-f34e-47cf-98a1-c22944b70d57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6930a630d6e849dd8b921434ad9cd458', 'request_id': 'req-cd437740-f34e-47cf-98a1-c22944b70d57'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:27.297225 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cd437740-f34e-47cf-98a1-c22944b70d57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6930a630d6e849dd8b921434ad9cd458', 'request_id': 'req-cd437740-f34e-47cf-98a1-c22944b70d57'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:27.317401 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cd437740-f34e-47cf-98a1-c22944b70d57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6930a630d6e849dd8b921434ad9cd458', 'request_id': 'req-cd437740-f34e-47cf-98a1-c22944b70d57'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:27.337701 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cd437740-f34e-47cf-98a1-c22944b70d57 admin admin] The token cache is being invalidate because project 6930a630d6e849dd8b921434ad9cd458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:27.337701 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cd437740-f34e-47cf-98a1-c22944b70d57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:27.338681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cd437740-f34e-47cf-98a1-c22944b70d57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:27.343679 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 962/1921] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:27 2022] DELETE /identity/v3/projects/6930a630d6e849dd8b921434ad9cd458 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:27.346881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764cf50-fa80-435a-85b4-7484e70a98c2 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:27.347231 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764cf50-fa80-435a-85b4-7484e70a98c2 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:27.347515 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764cf50-fa80-435a-85b4-7484e70a98c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:27.376926 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-f764cf50-fa80-435a-85b4-7484e70a98c2 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:27.378330 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c70b4ff1-0a07-4171-b636-10eb4aaf8af7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6745bf47c01490b9e71122ada42ac25', 'request_id': 'req-c70b4ff1-0a07-4171-b636-10eb4aaf8af7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:27.378675 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f764cf50-fa80-435a-85b4-7484e70a98c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:27.386125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c70b4ff1-0a07-4171-b636-10eb4aaf8af7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6745bf47c01490b9e71122ada42ac25', 'request_id': 'req-c70b4ff1-0a07-4171-b636-10eb4aaf8af7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:27.396020 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c70b4ff1-0a07-4171-b636-10eb4aaf8af7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6745bf47c01490b9e71122ada42ac25', 'request_id': 'req-c70b4ff1-0a07-4171-b636-10eb4aaf8af7'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:27.410055 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c70b4ff1-0a07-4171-b636-10eb4aaf8af7 admin admin] The token cache is being invalidate because project b6745bf47c01490b9e71122ada42ac25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:27.410424 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c70b4ff1-0a07-4171-b636-10eb4aaf8af7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:27.411205 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c70b4ff1-0a07-4171-b636-10eb4aaf8af7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:27.417646 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 960/1922] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:27 2022] DELETE /identity/v3/projects/b6745bf47c01490b9e71122ada42ac25 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:27.421230 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b4ff1-0a07-4171-b636-10eb4aaf8af7 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:27.422882 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c70b4ff1-0a07-4171-b636-10eb4aaf8af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:27.445755 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 963/1923] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:27.449260 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764cf50-fa80-435a-85b4-7484e70a98c2 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:27.451021 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f764cf50-fa80-435a-85b4-7484e70a98c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:27.469114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764cf50-fa80-435a-85b4-7484e70a98c2 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:27.475423 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57275e-bd12-4f3e-b854-bb2725511c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:27.476323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57275e-bd12-4f3e-b854-bb2725511c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:27.476640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57275e-bd12-4f3e-b854-bb2725511c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:27.476929 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57275e-bd12-4f3e-b854-bb2725511c58 admin admin] PATH_INFO: `/v3/users/19721f152a9547908adc4cf5ddb7d885` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:27.478149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f57275e-bd12-4f3e-b854-bb2725511c58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19721f152a9547908adc4cf5ddb7d885)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:27.480100 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f57275e-bd12-4f3e-b854-bb2725511c58 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:27.489167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b4ff1-0a07-4171-b636-10eb4aaf8af7 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:27.493765 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c93c24-c57b-4876-b1a8-6540b7a3fe84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:27.494424 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c93c24-c57b-4876-b1a8-6540b7a3fe84 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:27.494699 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c93c24-c57b-4876-b1a8-6540b7a3fe84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:27.494971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c93c24-c57b-4876-b1a8-6540b7a3fe84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:27.497549 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b3c93c24-c57b-4876-b1a8-6540b7a3fe84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:27.546880 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:27.566565 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:27.572675 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5f57275e-bd12-4f3e-b854-bb2725511c58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19721f152a9547908adc4cf5ddb7d885'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:27.605414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5f57275e-bd12-4f3e-b854-bb2725511c58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19721f152a9547908adc4cf5ddb7d885'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:27.606201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5f57275e-bd12-4f3e-b854-bb2725511c58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19721f152a9547908adc4cf5ddb7d885'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:27.606951 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c93c24-c57b-4876-b1a8-6540b7a3fe84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:27.611934 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c93c24-c57b-4876-b1a8-6540b7a3fe84 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:27.642395 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 961/1924] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:27.644782 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fca63e-75d8-4825-851f-57cab6190c1a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:27.645305 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fca63e-75d8-4825-851f-57cab6190c1a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:27.645691 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fca63e-75d8-4825-851f-57cab6190c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:27.654624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5f57275e-bd12-4f3e-b854-bb2725511c58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19721f152a9547908adc4cf5ddb7d885'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:27.675460 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-10fca63e-75d8-4825-851f-57cab6190c1a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:27.678460 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-10fca63e-75d8-4825-851f-57cab6190c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:27.681023 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5f57275e-bd12-4f3e-b854-bb2725511c58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19721f152a9547908adc4cf5ddb7d885'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:27.697175 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 962/1925] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:27.698303 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 964/1926] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:27 2022] DELETE /identity/v3/users/19721f152a9547908adc4cf5ddb7d885 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:27.704139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fca63e-75d8-4825-851f-57cab6190c1a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:27.724450 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fca63e-75d8-4825-851f-57cab6190c1a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:27.897716 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0dff1-6029-46e7-8fc4-7f9e06351e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:27.898571 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0dff1-6029-46e7-8fc4-7f9e06351e61 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:27.898960 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0dff1-6029-46e7-8fc4-7f9e06351e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:27.899417 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0dff1-6029-46e7-8fc4-7f9e06351e61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:27.900566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0dff1-6029-46e7-8fc4-7f9e06351e61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:07:27.900881 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0dff1-6029-46e7-8fc4-7f9e06351e61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:27.908445 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0dff1-6029-46e7-8fc4-7f9e06351e61 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:27.950232 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 963/1927] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:07:27.955256 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57275e-bd12-4f3e-b854-bb2725511c58 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:27.969709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57275e-bd12-4f3e-b854-bb2725511c58 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:27.984462 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea421674-c861-49de-b519-d43307b20664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:27.985262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea421674-c861-49de-b519-d43307b20664 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:27.985633 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea421674-c861-49de-b519-d43307b20664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:27.985954 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea421674-c861-49de-b519-d43307b20664 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:27.986735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea421674-c861-49de-b519-d43307b20664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:27.988803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea421674-c861-49de-b519-d43307b20664 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:28.051279 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 965/1928] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:27 2022] POST /identity/v3/projects => generated 407 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:28.057422 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0dff1-6029-46e7-8fc4-7f9e06351e61 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:28.081614 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0dff1-6029-46e7-8fc4-7f9e06351e61 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:28.198136 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403854f3-29f2-4547-a565-162610dee2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:28.199267 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403854f3-29f2-4547-a565-162610dee2f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:28.199715 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403854f3-29f2-4547-a565-162610dee2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:28.200164 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403854f3-29f2-4547-a565-162610dee2f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:28.201107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403854f3-29f2-4547-a565-162610dee2f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:28.203354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403854f3-29f2-4547-a565-162610dee2f7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:28.246210 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 964/1929] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:28 2022] POST /identity/v3/users => generated 304 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:28.247805 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea421674-c861-49de-b519-d43307b20664 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:28.262924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea421674-c861-49de-b519-d43307b20664 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:28.269068 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b048b41-1397-48a2-9108-1f9ba7388fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:28.269936 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b048b41-1397-48a2-9108-1f9ba7388fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:28.270285 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b048b41-1397-48a2-9108-1f9ba7388fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:28.270726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b048b41-1397-48a2-9108-1f9ba7388fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:28.271425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b048b41-1397-48a2-9108-1f9ba7388fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:28.273304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b048b41-1397-48a2-9108-1f9ba7388fd7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:28.287505 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 966/1930] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:28.291542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403854f3-29f2-4547-a565-162610dee2f7 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:28.309819 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403854f3-29f2-4547-a565-162610dee2f7 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:28.320906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dac30-70d3-42b2-8982-987221749195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:28.321865 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dac30-70d3-42b2-8982-987221749195 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:28.322222 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dac30-70d3-42b2-8982-987221749195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:28.322672 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dac30-70d3-42b2-8982-987221749195 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:28.322902 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b048b41-1397-48a2-9108-1f9ba7388fd7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:28.323909 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0dac30-70d3-42b2-8982-987221749195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:28.324750 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8b048b41-1397-48a2-9108-1f9ba7388fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:28.327702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0dac30-70d3-42b2-8982-987221749195 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:28.343039 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b048b41-1397-48a2-9108-1f9ba7388fd7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:28.348489 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcb322-ad19-45f9-bd5f-ae3767400b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:28.349638 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcb322-ad19-45f9-bd5f-ae3767400b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:28.350002 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcb322-ad19-45f9-bd5f-ae3767400b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:28.350435 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcb322-ad19-45f9-bd5f-ae3767400b61 admin admin] PATH_INFO: `/v3/projects/4474dada2993403683823616ae3fd512` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:28.352474 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fcb322-ad19-45f9-bd5f-ae3767400b61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4474dada2993403683823616ae3fd512)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:28.354895 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fcb322-ad19-45f9-bd5f-ae3767400b61 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:28.359634 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 965/1931] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:28.361832 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dac30-70d3-42b2-8982-987221749195 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:28.380334 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dac30-70d3-42b2-8982-987221749195 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:28.386624 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4ca91-be63-4f65-9fbe-88471438b5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:28.387901 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4ca91-be63-4f65-9fbe-88471438b5e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:28.388551 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4ca91-be63-4f65-9fbe-88471438b5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:28.388960 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4ca91-be63-4f65-9fbe-88471438b5e4 admin admin] PATH_INFO: `/v3/projects/edf5f6c5844b4463b3a11ddb3fe9852c/users/1edaef403e88436a8d2fc1cefa956ff2/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:28.416608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4ca91-be63-4f65-9fbe-88471438b5e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edf5f6c5844b4463b3a11ddb3fe9852c, user_id=1edaef403e88436a8d2fc1cefa956ff2, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:28.420938 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4ca91-be63-4f65-9fbe-88471438b5e4 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:28.433326 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b2fcb322-ad19-45f9-bd5f-ae3767400b61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4474dada2993403683823616ae3fd512', 'request_id': 'req-b2fcb322-ad19-45f9-bd5f-ae3767400b61'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:28.462826 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b2fcb322-ad19-45f9-bd5f-ae3767400b61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4474dada2993403683823616ae3fd512', 'request_id': 'req-b2fcb322-ad19-45f9-bd5f-ae3767400b61'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:28.472976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b2fcb322-ad19-45f9-bd5f-ae3767400b61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4474dada2993403683823616ae3fd512', 'request_id': 'req-b2fcb322-ad19-45f9-bd5f-ae3767400b61'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:28.476982 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 966/1932] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:28 2022] PUT /identity/v3/projects/edf5f6c5844b4463b3a11ddb3fe9852c/users/1edaef403e88436a8d2fc1cefa956ff2/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:07:28.490121 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307abc0-2698-4e79-aa92-311c8be8bd5e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:28.490414 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307abc0-2698-4e79-aa92-311c8be8bd5e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:28.490890 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307abc0-2698-4e79-aa92-311c8be8bd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:28.509664 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b2fcb322-ad19-45f9-bd5f-ae3767400b61 admin admin] The token cache is being invalidate because project 4474dada2993403683823616ae3fd512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:28.510287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b2fcb322-ad19-45f9-bd5f-ae3767400b61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:28.511536 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b2fcb322-ad19-45f9-bd5f-ae3767400b61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:28.513747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 967/1933] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:28 2022] DELETE /identity/v3/projects/4474dada2993403683823616ae3fd512 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:07:28.519266 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47587fe5-9b1b-4bc8-91d3-29993858c72b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:28.519558 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47587fe5-9b1b-4bc8-91d3-29993858c72b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:28.519828 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47587fe5-9b1b-4bc8-91d3-29993858c72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:28.536621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-4307abc0-2698-4e79-aa92-311c8be8bd5e None None] MFA Rules not processed for user `1edaef403e88436a8d2fc1cefa956ff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:28.538688 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4307abc0-2698-4e79-aa92-311c8be8bd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:28.545710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-47587fe5-9b1b-4bc8-91d3-29993858c72b None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:28.546382 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:28.547185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-47587fe5-9b1b-4bc8-91d3-29993858c72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:28.643762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 968/1934] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:07:28.655214 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfac999-c1f8-4aa4-b3ea-83cb3b9424d1 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:28.655518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfac999-c1f8-4aa4-b3ea-83cb3b9424d1 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:28.655747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfac999-c1f8-4aa4-b3ea-83cb3b9424d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:28.670854 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 967/1935] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:28 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:28.676647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307abc0-2698-4e79-aa92-311c8be8bd5e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:28.678034 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4307abc0-2698-4e79-aa92-311c8be8bd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:28.680527 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-9bfac999-c1f8-4aa4-b3ea-83cb3b9424d1 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:28.681713 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9bfac999-c1f8-4aa4-b3ea-83cb3b9424d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:28.690029 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 969/1936] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:28.692584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307abc0-2698-4e79-aa92-311c8be8bd5e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:28.694182 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfac999-c1f8-4aa4-b3ea-83cb3b9424d1 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:28.697436 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5baba-631f-49a7-ab5e-28df3d354ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:28.698109 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5baba-631f-49a7-ab5e-28df3d354ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:28.698396 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5baba-631f-49a7-ab5e-28df3d354ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:28.698684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5baba-631f-49a7-ab5e-28df3d354ca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:28.699394 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5baba-631f-49a7-ab5e-28df3d354ca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:28.701442 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5baba-631f-49a7-ab5e-28df3d354ca2 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:28.705958 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfac999-c1f8-4aa4-b3ea-83cb3b9424d1 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:28.720628 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b8d83-b942-4ed4-9240-528fa0791551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:28.721487 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b8d83-b942-4ed4-9240-528fa0791551 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:28.721906 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b8d83-b942-4ed4-9240-528fa0791551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:28.722244 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b8d83-b942-4ed4-9240-528fa0791551 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:28.723089 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b8d83-b942-4ed4-9240-528fa0791551 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:07:28.723467 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b8d83-b942-4ed4-9240-528fa0791551 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:28.725281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b8d83-b942-4ed4-9240-528fa0791551 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:28.727192 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:28.730528 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 968/1937] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:28 2022] POST /identity/v3/projects => generated 407 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:07:28.734605 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5baba-631f-49a7-ab5e-28df3d354ca2 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:28.740394 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 970/1938] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 22:07:28.744409 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b8d83-b942-4ed4-9240-528fa0791551 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:28.755124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b8d83-b942-4ed4-9240-528fa0791551 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:28.811696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5baba-631f-49a7-ab5e-28df3d354ca2 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:28.821523 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b86308-5428-4d7d-83a2-d0de9ea2692c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:28.821523 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b86308-5428-4d7d-83a2-d0de9ea2692c admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:28.821523 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b86308-5428-4d7d-83a2-d0de9ea2692c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:28.821889 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b86308-5428-4d7d-83a2-d0de9ea2692c admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:28.823574 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b86308-5428-4d7d-83a2-d0de9ea2692c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:28.826044 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b86308-5428-4d7d-83a2-d0de9ea2692c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:28.838081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc601b46-e6b2-4c88-b052-c0f6feca2e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:28.838878 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc601b46-e6b2-4c88-b052-c0f6feca2e69 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:28.839202 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc601b46-e6b2-4c88-b052-c0f6feca2e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:28.839364 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc601b46-e6b2-4c88-b052-c0f6feca2e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:28.840171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc601b46-e6b2-4c88-b052-c0f6feca2e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:28.842171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc601b46-e6b2-4c88-b052-c0f6feca2e69 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:28.851925 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 969/1939] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:28 2022] POST /identity/v3/users => generated 310 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:07:28.856153 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b86308-5428-4d7d-83a2-d0de9ea2692c admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:28.872296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b86308-5428-4d7d-83a2-d0de9ea2692c admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:28.878558 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f5f2e-dca2-4779-8f41-1d7d77362d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:28.879245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f5f2e-dca2-4779-8f41-1d7d77362d73 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:28.879534 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f5f2e-dca2-4779-8f41-1d7d77362d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:28.879825 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f5f2e-dca2-4779-8f41-1d7d77362d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:28.883667 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f5f2e-dca2-4779-8f41-1d7d77362d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:28.883829 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 971/1940] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:28 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:07:28.883952 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f5f2e-dca2-4779-8f41-1d7d77362d73 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:28.885266 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc601b46-e6b2-4c88-b052-c0f6feca2e69 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:28.894739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 970/1941] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:28.899379 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f5f2e-dca2-4779-8f41-1d7d77362d73 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:28.912842 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f5f2e-dca2-4779-8f41-1d7d77362d73 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:28.971400 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc601b46-e6b2-4c88-b052-c0f6feca2e69 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:28.976354 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bad64-04a5-4fd0-a4fe-d986631f2527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:28.977176 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bad64-04a5-4fd0-a4fe-d986631f2527 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:28.977458 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bad64-04a5-4fd0-a4fe-d986631f2527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:28.977551 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a92180-77fd-44b3-8547-017c552024e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:28.977735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bad64-04a5-4fd0-a4fe-d986631f2527 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:28.978440 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bad64-04a5-4fd0-a4fe-d986631f2527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:28.978550 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a92180-77fd-44b3-8547-017c552024e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:28.978730 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a92180-77fd-44b3-8547-017c552024e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:28.979008 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a92180-77fd-44b3-8547-017c552024e3 admin admin] PATH_INFO: `/v3/projects/917051ba40a9452c9d6b8ea69b34f618/users/2fd46995d7fd409182ec153796d625ff/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:28.980378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bad64-04a5-4fd0-a4fe-d986631f2527 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:28.988907 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:28.997742 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a92180-77fd-44b3-8547-017c552024e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=917051ba40a9452c9d6b8ea69b34f618, user_id=2fd46995d7fd409182ec153796d625ff, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:29.001221 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a92180-77fd-44b3-8547-017c552024e3 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:29.002715 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 972/1942] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:28 2022] POST /identity/v3/users => generated 290 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:29.006670 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bad64-04a5-4fd0-a4fe-d986631f2527 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:29.017342 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bad64-04a5-4fd0-a4fe-d986631f2527 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:29.017533 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 971/1943] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:28 2022] PUT /identity/v3/projects/917051ba40a9452c9d6b8ea69b34f618/users/2fd46995d7fd409182ec153796d625ff/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:29.022918 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a92180-77fd-44b3-8547-017c552024e3 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:29.089467 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309281f-5d1e-4745-858d-09c1244afd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:29.090591 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309281f-5d1e-4745-858d-09c1244afd77 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:29.090974 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309281f-5d1e-4745-858d-09c1244afd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:29.091494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309281f-5d1e-4745-858d-09c1244afd77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:29.092204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309281f-5d1e-4745-858d-09c1244afd77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:29.093954 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309281f-5d1e-4745-858d-09c1244afd77 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:29.101417 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a92180-77fd-44b3-8547-017c552024e3 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:29.108309 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 973/1944] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:07:29.109362 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309281f-5d1e-4745-858d-09c1244afd77 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:29.109855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbbd6e-7ea7-4a70-9f08-10e98fbe6a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:29.111071 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbbd6e-7ea7-4a70-9f08-10e98fbe6a72 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:29.112153 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbbd6e-7ea7-4a70-9f08-10e98fbe6a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:29.112153 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbbd6e-7ea7-4a70-9f08-10e98fbe6a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:29.112516 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbbd6e-7ea7-4a70-9f08-10e98fbe6a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:29.114180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbbd6e-7ea7-4a70-9f08-10e98fbe6a72 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:29.117302 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:29.123865 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309281f-5d1e-4745-858d-09c1244afd77 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:29.127777 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 972/1945] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:07:29.131743 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a313f-8b54-4303-8822-ea9fdc1d69d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:29.132631 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbbd6e-7ea7-4a70-9f08-10e98fbe6a72 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:29.132764 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a313f-8b54-4303-8822-ea9fdc1d69d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:29.132992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a313f-8b54-4303-8822-ea9fdc1d69d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:29.133274 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a313f-8b54-4303-8822-ea9fdc1d69d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:29.134119 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a313f-8b54-4303-8822-ea9fdc1d69d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:29.136443 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a313f-8b54-4303-8822-ea9fdc1d69d2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:29.146012 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbbd6e-7ea7-4a70-9f08-10e98fbe6a72 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:29.148077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 974/1946] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:29.151991 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a313f-8b54-4303-8822-ea9fdc1d69d2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:29.152427 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a1eab-5bcf-47ce-b0e1-26f411689ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:29.154406 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a1eab-5bcf-47ce-b0e1-26f411689ade admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:29.154850 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a1eab-5bcf-47ce-b0e1-26f411689ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:29.155273 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a1eab-5bcf-47ce-b0e1-26f411689ade admin admin] PATH_INFO: `/v3/projects/917051ba40a9452c9d6b8ea69b34f618/users/2fd46995d7fd409182ec153796d625ff/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:29.159486 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a1eab-5bcf-47ce-b0e1-26f411689ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=917051ba40a9452c9d6b8ea69b34f618, user_id=2fd46995d7fd409182ec153796d625ff, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:29.162437 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a1eab-5bcf-47ce-b0e1-26f411689ade admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:29.162564 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a313f-8b54-4303-8822-ea9fdc1d69d2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:29.169354 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ace0a-6cfe-4f8e-8d1a-77467a5ad402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:29.170318 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ace0a-6cfe-4f8e-8d1a-77467a5ad402 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:29.170674 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ace0a-6cfe-4f8e-8d1a-77467a5ad402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:29.171020 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ace0a-6cfe-4f8e-8d1a-77467a5ad402 admin admin] PATH_INFO: `/v3/projects/296001c49f98428994d993301e708e38/users/ddef4bb1da8d40d5b355c9ed7e43f603/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:29.184090 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 973/1947] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:29 2022] PUT /identity/v3/projects/917051ba40a9452c9d6b8ea69b34f618/users/2fd46995d7fd409182ec153796d625ff/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:07:29.186065 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fe484-4929-43de-9cfc-fe6bd3ba533c None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:29.186357 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fe484-4929-43de-9cfc-fe6bd3ba533c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:29.186660 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fe484-4929-43de-9cfc-fe6bd3ba533c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:29.195288 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ace0a-6cfe-4f8e-8d1a-77467a5ad402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=296001c49f98428994d993301e708e38, user_id=ddef4bb1da8d40d5b355c9ed7e43f603, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:29.198692 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ace0a-6cfe-4f8e-8d1a-77467a5ad402 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:29.228435 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 975/1948] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:29 2022] PUT /identity/v3/projects/296001c49f98428994d993301e708e38/users/ddef4bb1da8d40d5b355c9ed7e43f603/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:29.228867 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-ea8fe484-4929-43de-9cfc-fe6bd3ba533c None None] MFA Rules not processed for user `2fd46995d7fd409182ec153796d625ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:29.228867 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ea8fe484-4929-43de-9cfc-fe6bd3ba533c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:29.254084 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135451c-3861-4ce6-95f1-6c1353cedb06 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:29.254388 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135451c-3861-4ce6-95f1-6c1353cedb06 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:29.254785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135451c-3861-4ce6-95f1-6c1353cedb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:29.294303 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8135451c-3861-4ce6-95f1-6c1353cedb06 None None] MFA Rules not processed for user `ddef4bb1da8d40d5b355c9ed7e43f603`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:29.296207 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8135451c-3861-4ce6-95f1-6c1353cedb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:29.318999 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 974/1949] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:29 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:07:29.339793 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fe484-4929-43de-9cfc-fe6bd3ba533c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:29.341354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ea8fe484-4929-43de-9cfc-fe6bd3ba533c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:29.419137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 976/1950] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:29.423806 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135451c-3861-4ce6-95f1-6c1353cedb06 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:29.429091 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fe484-4929-43de-9cfc-fe6bd3ba533c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:29.433130 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08b150-88e0-4c93-b06f-dab2140639dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:29.434101 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08b150-88e0-4c93-b06f-dab2140639dd service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:29.434486 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08b150-88e0-4c93-b06f-dab2140639dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:29.434864 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08b150-88e0-4c93-b06f-dab2140639dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:29.454977 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e08b150-88e0-4c93-b06f-dab2140639dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:29.457327 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e08b150-88e0-4c93-b06f-dab2140639dd service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:29.462497 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:29.471508 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 975/1951] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:29 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:07:29.517481 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135451c-3861-4ce6-95f1-6c1353cedb06 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:29.523690 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dda2c8-000f-4199-8deb-2959cfc2429f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:29.524362 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dda2c8-000f-4199-8deb-2959cfc2429f admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:29.524681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dda2c8-000f-4199-8deb-2959cfc2429f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:29.524955 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dda2c8-000f-4199-8deb-2959cfc2429f admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:29.525681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dda2c8-000f-4199-8deb-2959cfc2429f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:29.527605 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dda2c8-000f-4199-8deb-2959cfc2429f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:29.557451 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 977/1952] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:29 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:07:29.561713 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08b150-88e0-4c93-b06f-dab2140639dd service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:29.576532 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08b150-88e0-4c93-b06f-dab2140639dd service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:29.667702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345aced-8ba3-47e7-bdb7-37d2d7b84295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:29.668852 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345aced-8ba3-47e7-bdb7-37d2d7b84295 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:29.669148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345aced-8ba3-47e7-bdb7-37d2d7b84295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:29.669434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345aced-8ba3-47e7-bdb7-37d2d7b84295 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:29.670204 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345aced-8ba3-47e7-bdb7-37d2d7b84295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:29.673419 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345aced-8ba3-47e7-bdb7-37d2d7b84295 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:29.685128 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dda2c8-000f-4199-8deb-2959cfc2429f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:29.691253 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-98dda2c8-000f-4199-8deb-2959cfc2429f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:29.709285 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 976/1953] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:29 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:29.710681 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345aced-8ba3-47e7-bdb7-37d2d7b84295 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:29.725957 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345aced-8ba3-47e7-bdb7-37d2d7b84295 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:29.732160 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4c8f1-9118-4fde-bcff-d80e22eb0762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:29.733090 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4c8f1-9118-4fde-bcff-d80e22eb0762 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:29.733542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4c8f1-9118-4fde-bcff-d80e22eb0762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:29.733942 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4c8f1-9118-4fde-bcff-d80e22eb0762 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:29.734694 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4c8f1-9118-4fde-bcff-d80e22eb0762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:29.737841 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4c8f1-9118-4fde-bcff-d80e22eb0762 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:29.758804 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 977/1954] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:29.760364 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4c8f1-9118-4fde-bcff-d80e22eb0762 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:29.772885 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:29.774409 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4c8f1-9118-4fde-bcff-d80e22eb0762 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:29.781598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c120611-8d1b-40d0-ba1f-0c23f5e112bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:29.783595 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c120611-8d1b-40d0-ba1f-0c23f5e112bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:29.783777 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c120611-8d1b-40d0-ba1f-0c23f5e112bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:29.784187 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c120611-8d1b-40d0-ba1f-0c23f5e112bd admin admin] PATH_INFO: `/v3/projects/33a24b6482ec4b74b7bf0098d28a02ad/users/a21800a933f2495cae33cb6cc252197f/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:29.797876 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dda2c8-000f-4199-8deb-2959cfc2429f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:29.809996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49641a09-7dd9-47a8-a2cf-75354565d743 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:29.811315 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49641a09-7dd9-47a8-a2cf-75354565d743 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:29.811860 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49641a09-7dd9-47a8-a2cf-75354565d743 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:29.812262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49641a09-7dd9-47a8-a2cf-75354565d743 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:29.813281 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c120611-8d1b-40d0-ba1f-0c23f5e112bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a24b6482ec4b74b7bf0098d28a02ad, user_id=a21800a933f2495cae33cb6cc252197f, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:29.820851 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c120611-8d1b-40d0-ba1f-0c23f5e112bd admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:29.851566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 978/1955] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:29 2022] PUT /identity/v3/projects/33a24b6482ec4b74b7bf0098d28a02ad/users/a21800a933f2495cae33cb6cc252197f/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:29.857304 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c120611-8d1b-40d0-ba1f-0c23f5e112bd admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:29.906867 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49641a09-7dd9-47a8-a2cf-75354565d743 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:29.908620 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49641a09-7dd9-47a8-a2cf-75354565d743 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:29.919393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 978/1956] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:29 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:07:29.973211 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c120611-8d1b-40d0-ba1f-0c23f5e112bd admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:29.979316 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e56f1-680a-486b-9491-a46d4e93b97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:29.980225 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e56f1-680a-486b-9491-a46d4e93b97f admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:29.980681 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e56f1-680a-486b-9491-a46d4e93b97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:29.981063 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e56f1-680a-486b-9491-a46d4e93b97f admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:29.982037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e56f1-680a-486b-9491-a46d4e93b97f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:29.985722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e56f1-680a-486b-9491-a46d4e93b97f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:30.004941 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 979/1957] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:30.006179 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49641a09-7dd9-47a8-a2cf-75354565d743 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:30.024623 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49641a09-7dd9-47a8-a2cf-75354565d743 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:30.037574 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f60ef2-90bc-4d5f-bf43-b4d18a2fd873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:30.038499 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f60ef2-90bc-4d5f-bf43-b4d18a2fd873 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:30.038790 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f60ef2-90bc-4d5f-bf43-b4d18a2fd873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:30.039067 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f60ef2-90bc-4d5f-bf43-b4d18a2fd873 admin admin] PATH_INFO: `/v3/projects/33a24b6482ec4b74b7bf0098d28a02ad/users/a21800a933f2495cae33cb6cc252197f/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:30.044554 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f60ef2-90bc-4d5f-bf43-b4d18a2fd873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a24b6482ec4b74b7bf0098d28a02ad, user_id=a21800a933f2495cae33cb6cc252197f, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:30.049903 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f60ef2-90bc-4d5f-bf43-b4d18a2fd873 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:30.088838 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 979/1958] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:30 2022] PUT /identity/v3/projects/33a24b6482ec4b74b7bf0098d28a02ad/users/a21800a933f2495cae33cb6cc252197f/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:30.091574 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91223aa0-5e2a-4250-bccd-87ecc35125aa None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:30.091920 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91223aa0-5e2a-4250-bccd-87ecc35125aa None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:30.092210 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91223aa0-5e2a-4250-bccd-87ecc35125aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:30.144458 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-91223aa0-5e2a-4250-bccd-87ecc35125aa None None] MFA Rules not processed for user `a21800a933f2495cae33cb6cc252197f`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:30.146425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-91223aa0-5e2a-4250-bccd-87ecc35125aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:30.231678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:30.323795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 980/1959] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:30.398762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f60ef2-90bc-4d5f-bf43-b4d18a2fd873 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:30.488743 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f60ef2-90bc-4d5f-bf43-b4d18a2fd873 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:30.496328 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338b27d-2f11-42bf-af80-65363c980554 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:30.497200 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338b27d-2f11-42bf-af80-65363c980554 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:30.497565 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338b27d-2f11-42bf-af80-65363c980554 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:30.497923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338b27d-2f11-42bf-af80-65363c980554 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:30.510157 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338b27d-2f11-42bf-af80-65363c980554 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:30.513588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338b27d-2f11-42bf-af80-65363c980554 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:30.530332 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 980/1960] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:30.648808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91223aa0-5e2a-4250-bccd-87ecc35125aa None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:30.653654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-91223aa0-5e2a-4250-bccd-87ecc35125aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:30.766002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91223aa0-5e2a-4250-bccd-87ecc35125aa None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:30.774088 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38abb88-ba95-4efc-b45b-b8b7916efa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:30.774088 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38abb88-ba95-4efc-b45b-b8b7916efa2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:30.774088 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38abb88-ba95-4efc-b45b-b8b7916efa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:30.774345 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38abb88-ba95-4efc-b45b-b8b7916efa2d admin admin] PATH_INFO: `/v3/users/56be220b79e14b40beef176a65e553d2` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:30.776008 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38abb88-ba95-4efc-b45b-b8b7916efa2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=56be220b79e14b40beef176a65e553d2)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:30.778277 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38abb88-ba95-4efc-b45b-b8b7916efa2d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:30.852613 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f38abb88-ba95-4efc-b45b-b8b7916efa2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56be220b79e14b40beef176a65e553d2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:30.862645 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f38abb88-ba95-4efc-b45b-b8b7916efa2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56be220b79e14b40beef176a65e553d2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:30.883552 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f38abb88-ba95-4efc-b45b-b8b7916efa2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56be220b79e14b40beef176a65e553d2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:30.884940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f38abb88-ba95-4efc-b45b-b8b7916efa2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56be220b79e14b40beef176a65e553d2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:30.885886 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f38abb88-ba95-4efc-b45b-b8b7916efa2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56be220b79e14b40beef176a65e553d2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:30.910131 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 981/1961] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:30 2022] DELETE /identity/v3/users/56be220b79e14b40beef176a65e553d2 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:30.917006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1028df-5c09-47d2-84c3-7c2bcdf0229a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:30.917671 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1028df-5c09-47d2-84c3-7c2bcdf0229a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:30.918244 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1028df-5c09-47d2-84c3-7c2bcdf0229a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:30.960331 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-ea1028df-5c09-47d2-84c3-7c2bcdf0229a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:30.963982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ea1028df-5c09-47d2-84c3-7c2bcdf0229a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:31.063529 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 981/1962] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:31.073542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38abb88-ba95-4efc-b45b-b8b7916efa2d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:31.075360 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f38abb88-ba95-4efc-b45b-b8b7916efa2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:31.139893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1028df-5c09-47d2-84c3-7c2bcdf0229a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:31.141470 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ea1028df-5c09-47d2-84c3-7c2bcdf0229a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:31.150626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38abb88-ba95-4efc-b45b-b8b7916efa2d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:31.154277 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1028df-5c09-47d2-84c3-7c2bcdf0229a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:31.155323 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79640a9-0e70-4b65-a137-a050b1a0260c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:31.156556 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79640a9-0e70-4b65-a137-a050b1a0260c service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:31.157525 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79640a9-0e70-4b65-a137-a050b1a0260c service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:31.158005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79640a9-0e70-4b65-a137-a050b1a0260c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:31.162387 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb73b0e-370f-444a-bf47-5d891c829ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:31.164039 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb73b0e-370f-444a-bf47-5d891c829ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:31.164039 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb73b0e-370f-444a-bf47-5d891c829ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:31.164213 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb73b0e-370f-444a-bf47-5d891c829ceb admin admin] PATH_INFO: `/v3/users/ddef4bb1da8d40d5b355c9ed7e43f603` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:31.165812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb73b0e-370f-444a-bf47-5d891c829ceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddef4bb1da8d40d5b355c9ed7e43f603)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:31.168236 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb73b0e-370f-444a-bf47-5d891c829ceb admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:31.168981 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:31.176208 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79640a9-0e70-4b65-a137-a050b1a0260c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:31.177441 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79640a9-0e70-4b65-a137-a050b1a0260c service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:31.199288 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:31.201454 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 982/1963] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:31.235146 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-deb73b0e-370f-444a-bf47-5d891c829ceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddef4bb1da8d40d5b355c9ed7e43f603'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:31.245497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-deb73b0e-370f-444a-bf47-5d891c829ceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddef4bb1da8d40d5b355c9ed7e43f603'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:31.246215 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-deb73b0e-370f-444a-bf47-5d891c829ceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddef4bb1da8d40d5b355c9ed7e43f603'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:31.270631 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-deb73b0e-370f-444a-bf47-5d891c829ceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddef4bb1da8d40d5b355c9ed7e43f603'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:31.285164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-deb73b0e-370f-444a-bf47-5d891c829ceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddef4bb1da8d40d5b355c9ed7e43f603'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:31.303315 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 982/1964] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:31 2022] DELETE /identity/v3/users/ddef4bb1da8d40d5b355c9ed7e43f603 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:07:31.307693 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d882d-6284-4863-932e-37355821677f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:31.307987 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d882d-6284-4863-932e-37355821677f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:31.308267 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d882d-6284-4863-932e-37355821677f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:31.336469 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-324d882d-6284-4863-932e-37355821677f None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:31.337929 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-324d882d-6284-4863-932e-37355821677f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:31.419743 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 983/1965] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:31.456002 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb73b0e-370f-444a-bf47-5d891c829ceb admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:31.457479 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-deb73b0e-370f-444a-bf47-5d891c829ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:31.536441 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb73b0e-370f-444a-bf47-5d891c829ceb admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:31.540861 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b37494-59c1-4ca5-8dfe-08b55ea1356f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:31.541544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b37494-59c1-4ca5-8dfe-08b55ea1356f service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:31.541787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b37494-59c1-4ca5-8dfe-08b55ea1356f service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:31.542062 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b37494-59c1-4ca5-8dfe-08b55ea1356f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:31.553345 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b37494-59c1-4ca5-8dfe-08b55ea1356f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:31.554806 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b37494-59c1-4ca5-8dfe-08b55ea1356f service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:31.569056 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 983/1966] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:31.913781 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d882d-6284-4863-932e-37355821677f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:31.916110 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-324d882d-6284-4863-932e-37355821677f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:31.936206 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d882d-6284-4863-932e-37355821677f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:31.945548 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f243fe3-f825-4edc-9836-416bbeaa8f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:31.948101 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f243fe3-f825-4edc-9836-416bbeaa8f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:31.952205 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f243fe3-f825-4edc-9836-416bbeaa8f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:31.953270 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f243fe3-f825-4edc-9836-416bbeaa8f8e admin admin] PATH_INFO: `/v3/users/acf607bd3eb246d19f688e98f21351f4` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:31.956850 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f243fe3-f825-4edc-9836-416bbeaa8f8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=acf607bd3eb246d19f688e98f21351f4)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:31.962415 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f243fe3-f825-4edc-9836-416bbeaa8f8e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:32.063138 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9f243fe3-f825-4edc-9836-416bbeaa8f8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acf607bd3eb246d19f688e98f21351f4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:32.076664 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9f243fe3-f825-4edc-9836-416bbeaa8f8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acf607bd3eb246d19f688e98f21351f4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:32.102300 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9f243fe3-f825-4edc-9836-416bbeaa8f8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acf607bd3eb246d19f688e98f21351f4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:32.103068 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9f243fe3-f825-4edc-9836-416bbeaa8f8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acf607bd3eb246d19f688e98f21351f4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:32.103696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9f243fe3-f825-4edc-9836-416bbeaa8f8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acf607bd3eb246d19f688e98f21351f4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:32.120432 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 984/1967] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:31 2022] DELETE /identity/v3/users/acf607bd3eb246d19f688e98f21351f4 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:32.125103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d529c-a8fd-49f8-8484-566382dc3658 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:32.125391 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d529c-a8fd-49f8-8484-566382dc3658 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:32.125740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d529c-a8fd-49f8-8484-566382dc3658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:32.143827 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-ce1d529c-a8fd-49f8-8484-566382dc3658 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:32.145206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ce1d529c-a8fd-49f8-8484-566382dc3658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:32.214150 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 984/1968] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:32.225026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f243fe3-f825-4edc-9836-416bbeaa8f8e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:32.226936 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9f243fe3-f825-4edc-9836-416bbeaa8f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:32.302786 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f243fe3-f825-4edc-9836-416bbeaa8f8e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:32.307134 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5397a9-979e-4a6a-a17e-3948cfc846cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:32.307930 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5397a9-979e-4a6a-a17e-3948cfc846cf service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:32.308275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5397a9-979e-4a6a-a17e-3948cfc846cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:32.308693 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5397a9-979e-4a6a-a17e-3948cfc846cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:32.321364 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5397a9-979e-4a6a-a17e-3948cfc846cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:32.323529 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5397a9-979e-4a6a-a17e-3948cfc846cf service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:32.327068 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d529c-a8fd-49f8-8484-566382dc3658 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:32.330233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ce1d529c-a8fd-49f8-8484-566382dc3658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:32.346965 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 985/1969] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:32.372932 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d529c-a8fd-49f8-8484-566382dc3658 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:32.380102 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833f30a-759d-4ae3-8b33-680cc3e84e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:32.381588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833f30a-759d-4ae3-8b33-680cc3e84e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:32.382018 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833f30a-759d-4ae3-8b33-680cc3e84e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:32.382121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833f30a-759d-4ae3-8b33-680cc3e84e38 admin admin] PATH_INFO: `/v3/projects/f8fde6110c5e4623ab34b4f4cc4f410a` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:32.385294 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833f30a-759d-4ae3-8b33-680cc3e84e38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8fde6110c5e4623ab34b4f4cc4f410a)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:32.388121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833f30a-759d-4ae3-8b33-680cc3e84e38 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:32.475910 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:32.480363 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9833f30a-759d-4ae3-8b33-680cc3e84e38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8fde6110c5e4623ab34b4f4cc4f410a', 'request_id': 'req-9833f30a-759d-4ae3-8b33-680cc3e84e38'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:32.489919 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9833f30a-759d-4ae3-8b33-680cc3e84e38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8fde6110c5e4623ab34b4f4cc4f410a', 'request_id': 'req-9833f30a-759d-4ae3-8b33-680cc3e84e38'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:32.498376 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9833f30a-759d-4ae3-8b33-680cc3e84e38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8fde6110c5e4623ab34b4f4cc4f410a', 'request_id': 'req-9833f30a-759d-4ae3-8b33-680cc3e84e38'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:32.515578 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9833f30a-759d-4ae3-8b33-680cc3e84e38 admin admin] The token cache is being invalidate because project f8fde6110c5e4623ab34b4f4cc4f410a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:32.515985 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9833f30a-759d-4ae3-8b33-680cc3e84e38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:32.518095 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-9833f30a-759d-4ae3-8b33-680cc3e84e38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:32.523188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 985/1970] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:32 2022] DELETE /identity/v3/projects/f8fde6110c5e4623ab34b4f4cc4f410a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:32.524005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5397a9-979e-4a6a-a17e-3948cfc846cf service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:32.535238 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5397a9-979e-4a6a-a17e-3948cfc846cf service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:32.564591 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:32.657752 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74258c7d-b8b6-49d4-883c-808bf9f874f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:32.658807 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74258c7d-b8b6-49d4-883c-808bf9f874f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:32.659097 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74258c7d-b8b6-49d4-883c-808bf9f874f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:32.659385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74258c7d-b8b6-49d4-883c-808bf9f874f3 admin admin] PATH_INFO: `/v3/users/733d408f16c443af87cac269e9b5948d` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:32.660749 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74258c7d-b8b6-49d4-883c-808bf9f874f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=733d408f16c443af87cac269e9b5948d)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:32.662712 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74258c7d-b8b6-49d4-883c-808bf9f874f3 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:32.735569 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-74258c7d-b8b6-49d4-883c-808bf9f874f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '733d408f16c443af87cac269e9b5948d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:32.745396 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-74258c7d-b8b6-49d4-883c-808bf9f874f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '733d408f16c443af87cac269e9b5948d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:32.781497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833f30a-759d-4ae3-8b33-680cc3e84e38 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:32.783314 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9833f30a-759d-4ae3-8b33-680cc3e84e38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:32.784779 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-74258c7d-b8b6-49d4-883c-808bf9f874f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '733d408f16c443af87cac269e9b5948d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:32.785617 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-74258c7d-b8b6-49d4-883c-808bf9f874f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '733d408f16c443af87cac269e9b5948d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:32.786348 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-74258c7d-b8b6-49d4-883c-808bf9f874f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '733d408f16c443af87cac269e9b5948d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:32.804239 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833f30a-759d-4ae3-8b33-680cc3e84e38 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:32.806922 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 986/1971] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:32 2022] DELETE /identity/v3/users/733d408f16c443af87cac269e9b5948d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:32.816039 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6979b73-791f-4088-8bac-9ca29a7efa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:32.817108 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6979b73-791f-4088-8bac-9ca29a7efa79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:32.825608 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6979b73-791f-4088-8bac-9ca29a7efa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:32.826776 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6979b73-791f-4088-8bac-9ca29a7efa79 admin admin] PATH_INFO: `/v3/projects/4db7311081694a8b8481471e1e13efa1` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:32.831058 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6979b73-791f-4088-8bac-9ca29a7efa79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4db7311081694a8b8481471e1e13efa1)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:32.834692 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6979b73-791f-4088-8bac-9ca29a7efa79 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:32.866676 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74258c7d-b8b6-49d4-883c-808bf9f874f3 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:32.868458 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-74258c7d-b8b6-49d4-883c-808bf9f874f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:32.904894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a6979b73-791f-4088-8bac-9ca29a7efa79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4db7311081694a8b8481471e1e13efa1', 'request_id': 'req-a6979b73-791f-4088-8bac-9ca29a7efa79'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:32.916216 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a6979b73-791f-4088-8bac-9ca29a7efa79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4db7311081694a8b8481471e1e13efa1', 'request_id': 'req-a6979b73-791f-4088-8bac-9ca29a7efa79'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:32.940369 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a6979b73-791f-4088-8bac-9ca29a7efa79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4db7311081694a8b8481471e1e13efa1', 'request_id': 'req-a6979b73-791f-4088-8bac-9ca29a7efa79'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:32.957362 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a6979b73-791f-4088-8bac-9ca29a7efa79 admin admin] The token cache is being invalidate because project 4db7311081694a8b8481471e1e13efa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:32.957543 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a6979b73-791f-4088-8bac-9ca29a7efa79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:32.958775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a6979b73-791f-4088-8bac-9ca29a7efa79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:32.961291 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 986/1972] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:32 2022] DELETE /identity/v3/projects/4db7311081694a8b8481471e1e13efa1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:32.971450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6979b73-791f-4088-8bac-9ca29a7efa79 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:32.975715 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a6979b73-791f-4088-8bac-9ca29a7efa79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:32.998328 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74258c7d-b8b6-49d4-883c-808bf9f874f3 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:33.067382 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:33.111415 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6979b73-791f-4088-8bac-9ca29a7efa79 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:33.124366 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1888dc6-8941-403c-ba5f-017e1507bbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:33.125718 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1888dc6-8941-403c-ba5f-017e1507bbf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:33.126185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1888dc6-8941-403c-ba5f-017e1507bbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:33.126665 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1888dc6-8941-403c-ba5f-017e1507bbf9 admin admin] PATH_INFO: `/v3/users/cbdf3b0d41e24e3b9a3816e70ad73e7e` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:33.129384 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1888dc6-8941-403c-ba5f-017e1507bbf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbdf3b0d41e24e3b9a3816e70ad73e7e)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:33.132104 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1888dc6-8941-403c-ba5f-017e1507bbf9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:33.145790 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340b44c-bcc0-46cb-91f7-4a8d8b5a949e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:33.146986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340b44c-bcc0-46cb-91f7-4a8d8b5a949e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:33.147337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340b44c-bcc0-46cb-91f7-4a8d8b5a949e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:33.147530 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340b44c-bcc0-46cb-91f7-4a8d8b5a949e admin admin] PATH_INFO: `/v3/projects/296001c49f98428994d993301e708e38` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:33.153724 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340b44c-bcc0-46cb-91f7-4a8d8b5a949e admin admin] RBAC: Authorizing `identity:delete_project(project_id=296001c49f98428994d993301e708e38)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:33.157320 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340b44c-bcc0-46cb-91f7-4a8d8b5a949e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:33.227228 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e1888dc6-8941-403c-ba5f-017e1507bbf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbdf3b0d41e24e3b9a3816e70ad73e7e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:33.234453 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:33.240734 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e1888dc6-8941-403c-ba5f-017e1507bbf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbdf3b0d41e24e3b9a3816e70ad73e7e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:33.242279 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e1888dc6-8941-403c-ba5f-017e1507bbf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbdf3b0d41e24e3b9a3816e70ad73e7e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:33.269142 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1340b44c-bcc0-46cb-91f7-4a8d8b5a949e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '296001c49f98428994d993301e708e38', 'request_id': 'req-1340b44c-bcc0-46cb-91f7-4a8d8b5a949e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:33.272929 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e1888dc6-8941-403c-ba5f-017e1507bbf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbdf3b0d41e24e3b9a3816e70ad73e7e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:33.278044 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1340b44c-bcc0-46cb-91f7-4a8d8b5a949e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '296001c49f98428994d993301e708e38', 'request_id': 'req-1340b44c-bcc0-46cb-91f7-4a8d8b5a949e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:33.290126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e1888dc6-8941-403c-ba5f-017e1507bbf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbdf3b0d41e24e3b9a3816e70ad73e7e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:33.291270 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1340b44c-bcc0-46cb-91f7-4a8d8b5a949e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '296001c49f98428994d993301e708e38', 'request_id': 'req-1340b44c-bcc0-46cb-91f7-4a8d8b5a949e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:33.314163 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 987/1973] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:32 2022] DELETE /identity/v3/users/cbdf3b0d41e24e3b9a3816e70ad73e7e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:33.314163 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1888dc6-8941-403c-ba5f-017e1507bbf9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:33.314419 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1340b44c-bcc0-46cb-91f7-4a8d8b5a949e admin admin] The token cache is being invalidate because project 296001c49f98428994d993301e708e38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:33.314419 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1340b44c-bcc0-46cb-91f7-4a8d8b5a949e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:33.314419 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1340b44c-bcc0-46cb-91f7-4a8d8b5a949e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:33.315810 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 987/1974] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:32 2022] DELETE /identity/v3/projects/296001c49f98428994d993301e708e38 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:07:33.318186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e1888dc6-8941-403c-ba5f-017e1507bbf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:33.330370 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340b44c-bcc0-46cb-91f7-4a8d8b5a949e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:33.334423 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1340b44c-bcc0-46cb-91f7-4a8d8b5a949e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:33.463832 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1888dc6-8941-403c-ba5f-017e1507bbf9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:33.489228 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aad8d8-ddc0-4b83-87d3-858d5d9a6b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:33.490140 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aad8d8-ddc0-4b83-87d3-858d5d9a6b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:33.490456 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aad8d8-ddc0-4b83-87d3-858d5d9a6b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:33.490694 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aad8d8-ddc0-4b83-87d3-858d5d9a6b67 admin admin] PATH_INFO: `/v3/projects/41ee941dda314989a5052b8e550fe8dd` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:33.492024 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aad8d8-ddc0-4b83-87d3-858d5d9a6b67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41ee941dda314989a5052b8e550fe8dd)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:33.494019 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aad8d8-ddc0-4b83-87d3-858d5d9a6b67 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:33.530089 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340b44c-bcc0-46cb-91f7-4a8d8b5a949e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:33.544641 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ad742-8239-4f73-9d1f-5a9c571d0e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:33.545546 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ad742-8239-4f73-9d1f-5a9c571d0e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:33.545828 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ad742-8239-4f73-9d1f-5a9c571d0e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:33.549916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ad742-8239-4f73-9d1f-5a9c571d0e7e admin admin] PATH_INFO: `/v3/users/a21800a933f2495cae33cb6cc252197f` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:33.556971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ad742-8239-4f73-9d1f-5a9c571d0e7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a21800a933f2495cae33cb6cc252197f)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:33.560026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ad742-8239-4f73-9d1f-5a9c571d0e7e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:33.617806 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a9aad8d8-ddc0-4b83-87d3-858d5d9a6b67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41ee941dda314989a5052b8e550fe8dd', 'request_id': 'req-a9aad8d8-ddc0-4b83-87d3-858d5d9a6b67'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:33.631821 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a9aad8d8-ddc0-4b83-87d3-858d5d9a6b67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41ee941dda314989a5052b8e550fe8dd', 'request_id': 'req-a9aad8d8-ddc0-4b83-87d3-858d5d9a6b67'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:33.639998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a9aad8d8-ddc0-4b83-87d3-858d5d9a6b67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41ee941dda314989a5052b8e550fe8dd', 'request_id': 'req-a9aad8d8-ddc0-4b83-87d3-858d5d9a6b67'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:33.653206 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ef2ad742-8239-4f73-9d1f-5a9c571d0e7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a21800a933f2495cae33cb6cc252197f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:33.663207 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a9aad8d8-ddc0-4b83-87d3-858d5d9a6b67 admin admin] The token cache is being invalidate because project 41ee941dda314989a5052b8e550fe8dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:33.663539 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a9aad8d8-ddc0-4b83-87d3-858d5d9a6b67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:33.664447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a9aad8d8-ddc0-4b83-87d3-858d5d9a6b67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:33.668460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 988/1975] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:33 2022] DELETE /identity/v3/projects/41ee941dda314989a5052b8e550fe8dd => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:33.672574 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ef2ad742-8239-4f73-9d1f-5a9c571d0e7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a21800a933f2495cae33cb6cc252197f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:33.677357 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd2332-42f9-4d6a-9961-e43eca508d89 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:33.677969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd2332-42f9-4d6a-9961-e43eca508d89 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:33.678412 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd2332-42f9-4d6a-9961-e43eca508d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:33.693820 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:33.697770 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ef2ad742-8239-4f73-9d1f-5a9c571d0e7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a21800a933f2495cae33cb6cc252197f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:33.699930 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ef2ad742-8239-4f73-9d1f-5a9c571d0e7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a21800a933f2495cae33cb6cc252197f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:33.702284 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ef2ad742-8239-4f73-9d1f-5a9c571d0e7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a21800a933f2495cae33cb6cc252197f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:33.727604 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 988/1976] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:33 2022] DELETE /identity/v3/users/a21800a933f2495cae33cb6cc252197f => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:33.730550 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-cefd2332-42f9-4d6a-9961-e43eca508d89 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:33.733418 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-cefd2332-42f9-4d6a-9961-e43eca508d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:33.917514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:33.934039 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 989/1977] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:33.944541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73284768-17c4-466f-8628-c1b99e267751 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:33.944838 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73284768-17c4-466f-8628-c1b99e267751 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:33.945124 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73284768-17c4-466f-8628-c1b99e267751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:33.987554 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-73284768-17c4-466f-8628-c1b99e267751 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:33.990641 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-73284768-17c4-466f-8628-c1b99e267751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:34.010819 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 989/1978] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:34.014851 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd2332-42f9-4d6a-9961-e43eca508d89 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:34.036737 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd2332-42f9-4d6a-9961-e43eca508d89 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:34.041359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ca815-09d8-4294-a7ec-d77c32e62f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:34.042048 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ca815-09d8-4294-a7ec-d77c32e62f36 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:34.054176 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ca815-09d8-4294-a7ec-d77c32e62f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:34.054590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ca815-09d8-4294-a7ec-d77c32e62f36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:34.055938 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ca815-09d8-4294-a7ec-d77c32e62f36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:07:34.055938 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ca815-09d8-4294-a7ec-d77c32e62f36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:34.057389 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ca815-09d8-4294-a7ec-d77c32e62f36 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:34.097883 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 990/1979] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:07:34.102055 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73284768-17c4-466f-8628-c1b99e267751 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:34.125100 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73284768-17c4-466f-8628-c1b99e267751 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:34.131127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ea182-62d2-4a51-aa92-708fa70921ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:34.131919 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ea182-62d2-4a51-aa92-708fa70921ae admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:34.132368 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ea182-62d2-4a51-aa92-708fa70921ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:34.132705 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ea182-62d2-4a51-aa92-708fa70921ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:34.133680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ea182-62d2-4a51-aa92-708fa70921ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:34.135703 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ea182-62d2-4a51-aa92-708fa70921ae admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:34.181615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ca815-09d8-4294-a7ec-d77c32e62f36 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:34.191654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 990/1980] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:34 2022] POST /identity/v3/projects => generated 383 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:34.198275 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ca815-09d8-4294-a7ec-d77c32e62f36 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:34.275050 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2a5fd-b7cb-4dc0-92fe-69e3734a3f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:34.275850 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2a5fd-b7cb-4dc0-92fe-69e3734a3f3c admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:34.276461 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2a5fd-b7cb-4dc0-92fe-69e3734a3f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:34.276586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2a5fd-b7cb-4dc0-92fe-69e3734a3f3c admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:34.278029 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2a5fd-b7cb-4dc0-92fe-69e3734a3f3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:34.279451 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2a5fd-b7cb-4dc0-92fe-69e3734a3f3c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:34.311311 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 991/1981] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:34 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:34.313578 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ea182-62d2-4a51-aa92-708fa70921ae admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:34.328521 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ea182-62d2-4a51-aa92-708fa70921ae admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:34.343150 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcd21e-c582-4d08-8167-981d09e16ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:34.343917 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcd21e-c582-4d08-8167-981d09e16ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:34.344204 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcd21e-c582-4d08-8167-981d09e16ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:34.344529 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcd21e-c582-4d08-8167-981d09e16ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:34.347876 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefcd21e-c582-4d08-8167-981d09e16ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:34.349827 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefcd21e-c582-4d08-8167-981d09e16ae4 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:34.394029 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 991/1982] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:07:34.395418 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2a5fd-b7cb-4dc0-92fe-69e3734a3f3c admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:34.419238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2a5fd-b7cb-4dc0-92fe-69e3734a3f3c admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:34.420005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcd21e-c582-4d08-8167-981d09e16ae4 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:34.422759 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-eefcd21e-c582-4d08-8167-981d09e16ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:34.450853 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dac1bb-8ac6-453b-be51-e8e8de2cd9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:34.451749 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dac1bb-8ac6-453b-be51-e8e8de2cd9fc admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:34.452105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dac1bb-8ac6-453b-be51-e8e8de2cd9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:34.452476 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dac1bb-8ac6-453b-be51-e8e8de2cd9fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:34.452835 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcd21e-c582-4d08-8167-981d09e16ae4 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:34.453356 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dac1bb-8ac6-453b-be51-e8e8de2cd9fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:34.455245 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dac1bb-8ac6-453b-be51-e8e8de2cd9fc admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:34.460431 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5e086-9b24-405d-8ddf-9d2753d834c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:34.461867 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5e086-9b24-405d-8ddf-9d2753d834c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:34.462159 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5e086-9b24-405d-8ddf-9d2753d834c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:34.462443 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5e086-9b24-405d-8ddf-9d2753d834c6 admin admin] PATH_INFO: `/v3/projects/88ca4e008804492b9c2f4c43cc0cbe7f` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:34.466910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5e086-9b24-405d-8ddf-9d2753d834c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88ca4e008804492b9c2f4c43cc0cbe7f)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:34.469123 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5e086-9b24-405d-8ddf-9d2753d834c6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:34.492266 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 992/1983] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:34.497004 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dac1bb-8ac6-453b-be51-e8e8de2cd9fc admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:34.517499 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dac1bb-8ac6-453b-be51-e8e8de2cd9fc admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:34.530246 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62ca0f-6a60-48fc-83ab-cae22f038a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:34.533757 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62ca0f-6a60-48fc-83ab-cae22f038a89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:34.542477 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62ca0f-6a60-48fc-83ab-cae22f038a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:34.543017 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62ca0f-6a60-48fc-83ab-cae22f038a89 admin admin] PATH_INFO: `/v3/projects/b4250f023b3a4dde8310e0c151855fd2/users/5f82d8c086ee4118a830679f33dd88d3/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:34.574243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62ca0f-6a60-48fc-83ab-cae22f038a89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4250f023b3a4dde8310e0c151855fd2, user_id=5f82d8c086ee4118a830679f33dd88d3, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:34.579876 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62ca0f-6a60-48fc-83ab-cae22f038a89 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:34.620148 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 993/1984] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:34 2022] PUT /identity/v3/projects/b4250f023b3a4dde8310e0c151855fd2/users/5f82d8c086ee4118a830679f33dd88d3/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:07:34.622753 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208f0ef-2111-434d-bb1a-00bed891c009 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:34.623040 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208f0ef-2111-434d-bb1a-00bed891c009 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:34.623901 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208f0ef-2111-434d-bb1a-00bed891c009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:34.641691 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2eb5e086-9b24-405d-8ddf-9d2753d834c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88ca4e008804492b9c2f4c43cc0cbe7f', 'request_id': 'req-2eb5e086-9b24-405d-8ddf-9d2753d834c6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:34.653600 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2eb5e086-9b24-405d-8ddf-9d2753d834c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88ca4e008804492b9c2f4c43cc0cbe7f', 'request_id': 'req-2eb5e086-9b24-405d-8ddf-9d2753d834c6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:34.668297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a208f0ef-2111-434d-bb1a-00bed891c009 None None] MFA Rules not processed for user `5f82d8c086ee4118a830679f33dd88d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:34.669785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a208f0ef-2111-434d-bb1a-00bed891c009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:34.681083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2eb5e086-9b24-405d-8ddf-9d2753d834c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88ca4e008804492b9c2f4c43cc0cbe7f', 'request_id': 'req-2eb5e086-9b24-405d-8ddf-9d2753d834c6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:34.698647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2eb5e086-9b24-405d-8ddf-9d2753d834c6 admin admin] The token cache is being invalidate because project 88ca4e008804492b9c2f4c43cc0cbe7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:34.699908 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2eb5e086-9b24-405d-8ddf-9d2753d834c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:34.702153 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2eb5e086-9b24-405d-8ddf-9d2753d834c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:34.705772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 992/1985] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:34 2022] DELETE /identity/v3/projects/88ca4e008804492b9c2f4c43cc0cbe7f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:07:34.712855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953ecf7-97d5-496f-bee7-32e95fe8a9c5 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:34.713340 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953ecf7-97d5-496f-bee7-32e95fe8a9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:34.713726 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953ecf7-97d5-496f-bee7-32e95fe8a9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:34.756819 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0953ecf7-97d5-496f-bee7-32e95fe8a9c5 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:34.761028 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0953ecf7-97d5-496f-bee7-32e95fe8a9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:34.805958 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 994/1986] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:07:34.807242 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208f0ef-2111-434d-bb1a-00bed891c009 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:34.810476 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a208f0ef-2111-434d-bb1a-00bed891c009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:34.855933 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 993/1987] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:34.857480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953ecf7-97d5-496f-bee7-32e95fe8a9c5 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:34.859159 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0953ecf7-97d5-496f-bee7-32e95fe8a9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:34.865550 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:34.879763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953ecf7-97d5-496f-bee7-32e95fe8a9c5 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:34.885957 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c753b-55c2-4b68-905a-73c0142b941f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:34.886638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c753b-55c2-4b68-905a-73c0142b941f admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:34.886923 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c753b-55c2-4b68-905a-73c0142b941f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:34.887200 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c753b-55c2-4b68-905a-73c0142b941f admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:34.888019 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c753b-55c2-4b68-905a-73c0142b941f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:34.890129 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c753b-55c2-4b68-905a-73c0142b941f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:34.902843 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208f0ef-2111-434d-bb1a-00bed891c009 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:34.910166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a4630-7f70-41f3-ab94-1be939c438fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:34.911212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a4630-7f70-41f3-ab94-1be939c438fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:34.911334 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a4630-7f70-41f3-ab94-1be939c438fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:34.911616 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a4630-7f70-41f3-ab94-1be939c438fc admin admin] PATH_INFO: `/v3/projects/33a24b6482ec4b74b7bf0098d28a02ad` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:34.913725 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a4630-7f70-41f3-ab94-1be939c438fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=33a24b6482ec4b74b7bf0098d28a02ad)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:34.916132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a4630-7f70-41f3-ab94-1be939c438fc admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:34.930789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 994/1988] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:34 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:34.933966 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea30cd-b218-454a-8d83-332a0f67f6c1 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:34.933966 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea30cd-b218-454a-8d83-332a0f67f6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:34.933966 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea30cd-b218-454a-8d83-332a0f67f6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:34.967969 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-34ea30cd-b218-454a-8d83-332a0f67f6c1 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:34.969983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-34ea30cd-b218-454a-8d83-332a0f67f6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:34.976394 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:34.996894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3a4a4630-7f70-41f3-ab94-1be939c438fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33a24b6482ec4b74b7bf0098d28a02ad', 'request_id': 'req-3a4a4630-7f70-41f3-ab94-1be939c438fc'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:35.007923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3a4a4630-7f70-41f3-ab94-1be939c438fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33a24b6482ec4b74b7bf0098d28a02ad', 'request_id': 'req-3a4a4630-7f70-41f3-ab94-1be939c438fc'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:35.018605 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3a4a4630-7f70-41f3-ab94-1be939c438fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33a24b6482ec4b74b7bf0098d28a02ad', 'request_id': 'req-3a4a4630-7f70-41f3-ab94-1be939c438fc'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:35.036453 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3a4a4630-7f70-41f3-ab94-1be939c438fc admin admin] The token cache is being invalidate because project 33a24b6482ec4b74b7bf0098d28a02ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:35.036769 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3a4a4630-7f70-41f3-ab94-1be939c438fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:35.037897 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3a4a4630-7f70-41f3-ab94-1be939c438fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:35.039870 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 995/1989] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:34 2022] DELETE /identity/v3/projects/33a24b6482ec4b74b7bf0098d28a02ad => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:35.045082 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a4630-7f70-41f3-ab94-1be939c438fc admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:35.050565 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3a4a4630-7f70-41f3-ab94-1be939c438fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:35.123875 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 995/1990] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:35.125989 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8f820-e643-4e55-9ab5-99198f2cbd0b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:35.126493 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8f820-e643-4e55-9ab5-99198f2cbd0b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:35.126948 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8f820-e643-4e55-9ab5-99198f2cbd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:35.152483 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0da8f820-e643-4e55-9ab5-99198f2cbd0b None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:35.156081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0da8f820-e643-4e55-9ab5-99198f2cbd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:35.166770 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 996/1991] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:35.167796 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8f820-e643-4e55-9ab5-99198f2cbd0b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:35.187714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8f820-e643-4e55-9ab5-99198f2cbd0b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:35.194008 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20140850-741d-4a51-a4a2-94f034bf0d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:35.194830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20140850-741d-4a51-a4a2-94f034bf0d0a admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:35.195110 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20140850-741d-4a51-a4a2-94f034bf0d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:35.195387 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20140850-741d-4a51-a4a2-94f034bf0d0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:35.196163 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20140850-741d-4a51-a4a2-94f034bf0d0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:07:35.196623 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20140850-741d-4a51-a4a2-94f034bf0d0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:35.198639 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20140850-741d-4a51-a4a2-94f034bf0d0a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:35.203259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a4630-7f70-41f3-ab94-1be939c438fc admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:35.212278 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58818c-d694-4754-b8fa-89835342c1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:35.213316 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58818c-d694-4754-b8fa-89835342c1cf admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:35.213667 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58818c-d694-4754-b8fa-89835342c1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:35.213949 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58818c-d694-4754-b8fa-89835342c1cf admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:35.214878 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58818c-d694-4754-b8fa-89835342c1cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:35.215576 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 997/1992] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:07:35.217308 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58818c-d694-4754-b8fa-89835342c1cf admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:35.224463 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f24416-95be-4fc5-9843-885ab745a6eb None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:35.224766 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f24416-95be-4fc5-9843-885ab745a6eb None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:35.225002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f24416-95be-4fc5-9843-885ab745a6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:35.249627 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-57f24416-95be-4fc5-9843-885ab745a6eb None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:35.254201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-57f24416-95be-4fc5-9843-885ab745a6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:35.268379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 996/1993] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:35 2022] POST /identity/v3/users => generated 298 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:35.269101 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 998/1994] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:35.269993 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58818c-d694-4754-b8fa-89835342c1cf admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:35.270120 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f24416-95be-4fc5-9843-885ab745a6eb None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:35.283168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58818c-d694-4754-b8fa-89835342c1cf admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:35.285904 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f24416-95be-4fc5-9843-885ab745a6eb None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:35.291019 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a29de-ad94-4c2b-b240-9af9061b1c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:35.293414 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ccab6-baab-4a44-ba68-0186bc4e1f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:35.293715 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ccab6-baab-4a44-ba68-0186bc4e1f09 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:35.293975 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ccab6-baab-4a44-ba68-0186bc4e1f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:35.294313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ccab6-baab-4a44-ba68-0186bc4e1f09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:35.295085 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ccab6-baab-4a44-ba68-0186bc4e1f09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:07:35.295395 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ccab6-baab-4a44-ba68-0186bc4e1f09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:35.296205 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a29de-ad94-4c2b-b240-9af9061b1c36 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:35.296748 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a29de-ad94-4c2b-b240-9af9061b1c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:35.297239 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a29de-ad94-4c2b-b240-9af9061b1c36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:35.297376 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ccab6-baab-4a44-ba68-0186bc4e1f09 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:35.299038 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a29de-ad94-4c2b-b240-9af9061b1c36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:35.301986 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a29de-ad94-4c2b-b240-9af9061b1c36 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:35.323317 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 999/1995] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:07:35.324677 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ccab6-baab-4a44-ba68-0186bc4e1f09 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:35.346393 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ccab6-baab-4a44-ba68-0186bc4e1f09 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:35.351796 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f92716-b853-4505-894d-4cf9fbc296da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:35.353044 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f92716-b853-4505-894d-4cf9fbc296da admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:35.353653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f92716-b853-4505-894d-4cf9fbc296da admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:35.354092 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f92716-b853-4505-894d-4cf9fbc296da admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:35.355029 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 997/1996] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:35 2022] POST /identity/v3/projects => generated 365 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:35.355334 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f92716-b853-4505-894d-4cf9fbc296da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:35.357302 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f92716-b853-4505-894d-4cf9fbc296da admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:35.360995 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a29de-ad94-4c2b-b240-9af9061b1c36 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:35.384601 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1000/1997] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:35.385770 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f92716-b853-4505-894d-4cf9fbc296da admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:35.403320 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f92716-b853-4505-894d-4cf9fbc296da admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:35.425588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:35.489583 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a29de-ad94-4c2b-b240-9af9061b1c36 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:35.501223 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e25e4c-e6bb-4793-be5d-f6ab0f635c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:35.502819 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e25e4c-e6bb-4793-be5d-f6ab0f635c6d admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:35.503100 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e25e4c-e6bb-4793-be5d-f6ab0f635c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:35.504229 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e25e4c-e6bb-4793-be5d-f6ab0f635c6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:35.505454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e25e4c-e6bb-4793-be5d-f6ab0f635c6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:35.506952 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e25e4c-e6bb-4793-be5d-f6ab0f635c6d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:35.513786 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8af3b3-cb71-403b-8ead-b0434b24a5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:35.514498 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8af3b3-cb71-403b-8ead-b0434b24a5be admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:35.514780 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8af3b3-cb71-403b-8ead-b0434b24a5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:35.515058 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8af3b3-cb71-403b-8ead-b0434b24a5be admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:35.515789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8af3b3-cb71-403b-8ead-b0434b24a5be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:35.518440 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8af3b3-cb71-403b-8ead-b0434b24a5be admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:35.548770 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1001/1998] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:35 2022] POST /identity/v3/users => generated 283 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:35.549818 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8af3b3-cb71-403b-8ead-b0434b24a5be admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:35.563576 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8af3b3-cb71-403b-8ead-b0434b24a5be admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:35.565542 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 998/1999] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:35 2022] POST /identity/v3/projects => generated 383 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:35.566811 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e25e4c-e6bb-4793-be5d-f6ab0f635c6d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:35.658156 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:35.666556 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e25e4c-e6bb-4793-be5d-f6ab0f635c6d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:35.672775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096079a6-45ac-4a43-a1f4-ca2dfba201f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:35.673957 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096079a6-45ac-4a43-a1f4-ca2dfba201f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:35.674899 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096079a6-45ac-4a43-a1f4-ca2dfba201f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:35.675261 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096079a6-45ac-4a43-a1f4-ca2dfba201f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:35.676092 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096079a6-45ac-4a43-a1f4-ca2dfba201f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:35.677965 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096079a6-45ac-4a43-a1f4-ca2dfba201f7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:35.688321 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205ed01-0041-4dbb-b58b-d18babc3eda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:35.690098 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205ed01-0041-4dbb-b58b-d18babc3eda3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:35.690377 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205ed01-0041-4dbb-b58b-d18babc3eda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:35.690657 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205ed01-0041-4dbb-b58b-d18babc3eda3 admin admin] PATH_INFO: `/v3/projects/b933587a0269443fbe097972de789cc9/users/ec6731e03aa04e238d3e86925c1ab926/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:35.699389 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 999/2000] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:35.700828 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096079a6-45ac-4a43-a1f4-ca2dfba201f7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:35.708455 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205ed01-0041-4dbb-b58b-d18babc3eda3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b933587a0269443fbe097972de789cc9, user_id=ec6731e03aa04e238d3e86925c1ab926, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:35.711312 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205ed01-0041-4dbb-b58b-d18babc3eda3 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:35.712126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096079a6-45ac-4a43-a1f4-ca2dfba201f7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:35.718119 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f948fb-3e66-4c21-9967-7a66cf33560d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:35.718915 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f948fb-3e66-4c21-9967-7a66cf33560d admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:35.720048 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f948fb-3e66-4c21-9967-7a66cf33560d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:35.720624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f948fb-3e66-4c21-9967-7a66cf33560d admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:35.721380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f948fb-3e66-4c21-9967-7a66cf33560d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:35.723523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f948fb-3e66-4c21-9967-7a66cf33560d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:35.730965 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1002/2001] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:35 2022] PUT /identity/v3/projects/b933587a0269443fbe097972de789cc9/users/ec6731e03aa04e238d3e86925c1ab926/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:35.731915 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205ed01-0041-4dbb-b58b-d18babc3eda3 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:35.767419 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1000/2002] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:35 2022] POST /identity/v3/users => generated 292 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:35.768992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f948fb-3e66-4c21-9967-7a66cf33560d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:35.780609 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f948fb-3e66-4c21-9967-7a66cf33560d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:35.814019 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205ed01-0041-4dbb-b58b-d18babc3eda3 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:35.819223 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03233767-a72a-4c8e-8e96-5781e3e109fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:35.819827 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03233767-a72a-4c8e-8e96-5781e3e109fe admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:35.820135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03233767-a72a-4c8e-8e96-5781e3e109fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:35.820422 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03233767-a72a-4c8e-8e96-5781e3e109fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:35.821189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03233767-a72a-4c8e-8e96-5781e3e109fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:35.823094 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03233767-a72a-4c8e-8e96-5781e3e109fe admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:35.837804 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1003/2003] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:35.842499 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03233767-a72a-4c8e-8e96-5781e3e109fe admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:35.855415 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03233767-a72a-4c8e-8e96-5781e3e109fe admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:35.860392 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fd2ff-91cf-4228-b1c2-163abaaaa9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:35.861199 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fd2ff-91cf-4228-b1c2-163abaaaa9cb admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:35.861551 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fd2ff-91cf-4228-b1c2-163abaaaa9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:35.861898 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fd2ff-91cf-4228-b1c2-163abaaaa9cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:35.862735 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fd2ff-91cf-4228-b1c2-163abaaaa9cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:35.864628 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fd2ff-91cf-4228-b1c2-163abaaaa9cb admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:35.866190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17451e6-692b-4b28-84f1-050108fdc23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:35.867576 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17451e6-692b-4b28-84f1-050108fdc23b admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:35.867576 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17451e6-692b-4b28-84f1-050108fdc23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:35.867576 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17451e6-692b-4b28-84f1-050108fdc23b admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:35.868275 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17451e6-692b-4b28-84f1-050108fdc23b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:35.869945 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17451e6-692b-4b28-84f1-050108fdc23b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:35.876202 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1004/2004] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:35.876970 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fd2ff-91cf-4228-b1c2-163abaaaa9cb admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:35.881913 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1001/2005] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:35.883068 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17451e6-692b-4b28-84f1-050108fdc23b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:35.889855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fd2ff-91cf-4228-b1c2-163abaaaa9cb admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:35.896341 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca31e93-23ba-4b89-a88b-9386536f9011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:35.896858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17451e6-692b-4b28-84f1-050108fdc23b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:35.897792 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca31e93-23ba-4b89-a88b-9386536f9011 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:35.898288 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca31e93-23ba-4b89-a88b-9386536f9011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:35.898772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca31e93-23ba-4b89-a88b-9386536f9011 admin admin] PATH_INFO: `/v3/projects/db1f3f0507ed4fac8ba175b1ba10e7e2/users/c36204a20abb4579bea88980ce736dbe/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:35.904341 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa559915-63e2-4f61-b024-2b507b9683c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:35.905075 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa559915-63e2-4f61-b024-2b507b9683c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:35.905357 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa559915-63e2-4f61-b024-2b507b9683c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:35.905637 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa559915-63e2-4f61-b024-2b507b9683c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:35.906375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa559915-63e2-4f61-b024-2b507b9683c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:35.908657 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa559915-63e2-4f61-b024-2b507b9683c2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:35.918860 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca31e93-23ba-4b89-a88b-9386536f9011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db1f3f0507ed4fac8ba175b1ba10e7e2, user_id=c36204a20abb4579bea88980ce736dbe, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:35.922390 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1002/2006] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:35.922390 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa559915-63e2-4f61-b024-2b507b9683c2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:35.922724 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca31e93-23ba-4b89-a88b-9386536f9011 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:35.934041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa559915-63e2-4f61-b024-2b507b9683c2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:35.947202 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1005/2007] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:35 2022] PUT /identity/v3/projects/db1f3f0507ed4fac8ba175b1ba10e7e2/users/c36204a20abb4579bea88980ce736dbe/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:35.947202 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca31e93-23ba-4b89-a88b-9386536f9011 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:35.949625 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:36.025418 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73502cdf-6db5-46b6-8fb5-035a7226d3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:36.026290 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73502cdf-6db5-46b6-8fb5-035a7226d3a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:36.026574 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73502cdf-6db5-46b6-8fb5-035a7226d3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:36.026848 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73502cdf-6db5-46b6-8fb5-035a7226d3a1 admin admin] PATH_INFO: `/v3/projects/b933587a0269443fbe097972de789cc9/users/ec6731e03aa04e238d3e86925c1ab926/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:36.028986 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73502cdf-6db5-46b6-8fb5-035a7226d3a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b933587a0269443fbe097972de789cc9, user_id=ec6731e03aa04e238d3e86925c1ab926, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:36.031134 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca31e93-23ba-4b89-a88b-9386536f9011 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:36.032764 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73502cdf-6db5-46b6-8fb5-035a7226d3a1 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:36.037864 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80234b15-55d5-4073-a0bb-63b6aef3a1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:36.039465 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80234b15-55d5-4073-a0bb-63b6aef3a1f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:36.039859 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80234b15-55d5-4073-a0bb-63b6aef3a1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:36.040214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80234b15-55d5-4073-a0bb-63b6aef3a1f5 admin admin] PATH_INFO: `/v3/projects/7d97ebff29b24588b0fecc9a413408e7/users/d09e73a57b8440e88fba71f3b746e6ec/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:36.044067 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1003/2008] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:35 2022] PUT /identity/v3/projects/b933587a0269443fbe097972de789cc9/users/ec6731e03aa04e238d3e86925c1ab926/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:36.045197 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89589f-4cf5-4bc7-833a-5b24cd96b508 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:36.045470 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89589f-4cf5-4bc7-833a-5b24cd96b508 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:36.045746 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89589f-4cf5-4bc7-833a-5b24cd96b508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:36.062739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80234b15-55d5-4073-a0bb-63b6aef3a1f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d97ebff29b24588b0fecc9a413408e7, user_id=d09e73a57b8440e88fba71f3b746e6ec, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:36.066620 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80234b15-55d5-4073-a0bb-63b6aef3a1f5 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:36.082412 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-be89589f-4cf5-4bc7-833a-5b24cd96b508 None None] MFA Rules not processed for user `c36204a20abb4579bea88980ce736dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:36.083909 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-be89589f-4cf5-4bc7-833a-5b24cd96b508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:36.084206 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1006/2009] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:35 2022] PUT /identity/v3/projects/7d97ebff29b24588b0fecc9a413408e7/users/d09e73a57b8440e88fba71f3b746e6ec/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:36.085760 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8bef3-c41d-4b0c-8448-56c8a58f3830 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:36.086047 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8bef3-c41d-4b0c-8448-56c8a58f3830 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:36.086324 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8bef3-c41d-4b0c-8448-56c8a58f3830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:36.117455 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-bfe8bef3-c41d-4b0c-8448-56c8a58f3830 None None] MFA Rules not processed for user `ec6731e03aa04e238d3e86925c1ab926`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:36.118792 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-bfe8bef3-c41d-4b0c-8448-56c8a58f3830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:36.123182 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:36.179300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1004/2010] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:36.182377 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896d9a1-c655-40bc-a178-601d53d6aa5d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:36.182894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896d9a1-c655-40bc-a178-601d53d6aa5d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:36.183388 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896d9a1-c655-40bc-a178-601d53d6aa5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:36.223693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-b896d9a1-c655-40bc-a178-601d53d6aa5d None None] MFA Rules not processed for user `d09e73a57b8440e88fba71f3b746e6ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:36.224951 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b896d9a1-c655-40bc-a178-601d53d6aa5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:36.229369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1007/2011] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:36.237729 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8bef3-c41d-4b0c-8448-56c8a58f3830 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:36.304893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1005/2012] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:36.305971 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896d9a1-c655-40bc-a178-601d53d6aa5d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:36.307576 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b896d9a1-c655-40bc-a178-601d53d6aa5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:36.362265 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8bef3-c41d-4b0c-8448-56c8a58f3830 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:36.369633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334245c-b322-47c3-8979-62a8584f16ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:36.370545 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:36.374141 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334245c-b322-47c3-8979-62a8584f16ea admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:36.374493 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334245c-b322-47c3-8979-62a8584f16ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:36.374784 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334245c-b322-47c3-8979-62a8584f16ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:36.375748 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9334245c-b322-47c3-8979-62a8584f16ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:36.378208 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9334245c-b322-47c3-8979-62a8584f16ea admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:36.408498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896d9a1-c655-40bc-a178-601d53d6aa5d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:36.411359 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1008/2013] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:36 2022] POST /identity/v3/projects => generated 365 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:36.412565 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee97de-1652-4912-9f22-d720fedb7fe8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:36.412818 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334245c-b322-47c3-8979-62a8584f16ea admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:36.413295 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee97de-1652-4912-9f22-d720fedb7fe8 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:36.413741 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee97de-1652-4912-9f22-d720fedb7fe8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:36.414036 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee97de-1652-4912-9f22-d720fedb7fe8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:36.415998 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9334245c-b322-47c3-8979-62a8584f16ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:36.425551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee97de-1652-4912-9f22-d720fedb7fe8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:36.426949 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee97de-1652-4912-9f22-d720fedb7fe8 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:36.436785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1006/2014] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:36.437560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee97de-1652-4912-9f22-d720fedb7fe8 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:36.449149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee97de-1652-4912-9f22-d720fedb7fe8 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:36.490280 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334245c-b322-47c3-8979-62a8584f16ea admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:36.502526 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dff374-7787-41b1-b715-d206c93fb0d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:36.503335 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dff374-7787-41b1-b715-d206c93fb0d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:36.503618 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dff374-7787-41b1-b715-d206c93fb0d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:36.503888 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dff374-7787-41b1-b715-d206c93fb0d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:36.543610 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af747e-f8d3-424c-944a-36f1d1bcc117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:36.544838 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af747e-f8d3-424c-944a-36f1d1bcc117 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:36.545346 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af747e-f8d3-424c-944a-36f1d1bcc117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:36.545821 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af747e-f8d3-424c-944a-36f1d1bcc117 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:36.546874 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af747e-f8d3-424c-944a-36f1d1bcc117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:36.549805 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af747e-f8d3-424c-944a-36f1d1bcc117 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:36.561571 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:36.580664 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1007/2015] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:36 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:36.584606 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af747e-f8d3-424c-944a-36f1d1bcc117 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:36.596884 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af747e-f8d3-424c-944a-36f1d1bcc117 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:36.597218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dff374-7787-41b1-b715-d206c93fb0d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:36.599015 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dff374-7787-41b1-b715-d206c93fb0d7 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:36.603443 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d975f8-705c-402e-abcb-8b8dc83516b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:36.604723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d975f8-705c-402e-abcb-8b8dc83516b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:36.604874 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d975f8-705c-402e-abcb-8b8dc83516b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:36.605088 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d975f8-705c-402e-abcb-8b8dc83516b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:36.605875 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d975f8-705c-402e-abcb-8b8dc83516b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:36.607656 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d975f8-705c-402e-abcb-8b8dc83516b9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:36.611705 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1009/2016] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:36.640020 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1008/2017] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:07:36.644227 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dff374-7787-41b1-b715-d206c93fb0d7 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:36.663188 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dff374-7787-41b1-b715-d206c93fb0d7 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:36.668249 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d09b6-8193-4fe7-ae62-2d33a8178c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:36.669267 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d09b6-8193-4fe7-ae62-2d33a8178c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:36.669558 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d09b6-8193-4fe7-ae62-2d33a8178c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:36.669842 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d09b6-8193-4fe7-ae62-2d33a8178c0b admin admin] PATH_INFO: `/v3/projects/cbae1580ceaa47489ecdb0dca1c4a86c/users/c41197b159194858bd952bf012798542/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:36.710614 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d09b6-8193-4fe7-ae62-2d33a8178c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbae1580ceaa47489ecdb0dca1c4a86c, user_id=c41197b159194858bd952bf012798542, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:36.719352 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d09b6-8193-4fe7-ae62-2d33a8178c0b admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:36.742711 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1010/2018] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:36 2022] PUT /identity/v3/projects/cbae1580ceaa47489ecdb0dca1c4a86c/users/c41197b159194858bd952bf012798542/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:07:36.746538 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d975f8-705c-402e-abcb-8b8dc83516b9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:36.763920 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d975f8-705c-402e-abcb-8b8dc83516b9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:36.879150 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b6f57-f93a-499f-975d-641da3073982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:36.880249 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b6f57-f93a-499f-975d-641da3073982 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:36.880749 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b6f57-f93a-499f-975d-641da3073982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:36.881486 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b6f57-f93a-499f-975d-641da3073982 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:36.882736 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b6f57-f93a-499f-975d-641da3073982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:36.885533 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b6f57-f93a-499f-975d-641da3073982 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:36.895662 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d09b6-8193-4fe7-ae62-2d33a8178c0b admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:36.897521 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-427d09b6-8193-4fe7-ae62-2d33a8178c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:36.901166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1009/2019] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:36.906345 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b6f57-f93a-499f-975d-641da3073982 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:36.918664 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d09b6-8193-4fe7-ae62-2d33a8178c0b admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:36.930787 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7405e-288f-42a5-b86d-48b8b228620e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:36.931778 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7405e-288f-42a5-b86d-48b8b228620e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:36.932079 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7405e-288f-42a5-b86d-48b8b228620e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:36.932360 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7405e-288f-42a5-b86d-48b8b228620e admin admin] PATH_INFO: `/v3/users/1edaef403e88436a8d2fc1cefa956ff2` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:36.934239 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7405e-288f-42a5-b86d-48b8b228620e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1edaef403e88436a8d2fc1cefa956ff2)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:36.936395 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7405e-288f-42a5-b86d-48b8b228620e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:36.999064 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:37.012080 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b6f57-f93a-499f-975d-641da3073982 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:37.012831 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-14f7405e-288f-42a5-b86d-48b8b228620e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1edaef403e88436a8d2fc1cefa956ff2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:37.016331 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0848aa-98b4-44e2-a638-02c24275f3c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:37.017436 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0848aa-98b4-44e2-a638-02c24275f3c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:37.017909 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0848aa-98b4-44e2-a638-02c24275f3c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:37.018449 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0848aa-98b4-44e2-a638-02c24275f3c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:37.021430 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ff0848aa-98b4-44e2-a638-02c24275f3c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:37.030385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-14f7405e-288f-42a5-b86d-48b8b228620e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1edaef403e88436a8d2fc1cefa956ff2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:37.057251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-14f7405e-288f-42a5-b86d-48b8b228620e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1edaef403e88436a8d2fc1cefa956ff2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:37.058508 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-14f7405e-288f-42a5-b86d-48b8b228620e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1edaef403e88436a8d2fc1cefa956ff2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:37.059721 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-14f7405e-288f-42a5-b86d-48b8b228620e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1edaef403e88436a8d2fc1cefa956ff2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:37.084275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1011/2020] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:36 2022] DELETE /identity/v3/users/1edaef403e88436a8d2fc1cefa956ff2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:37.084275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7405e-288f-42a5-b86d-48b8b228620e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:37.084851 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-14f7405e-288f-42a5-b86d-48b8b228620e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:37.112696 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0848aa-98b4-44e2-a638-02c24275f3c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:37.115601 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0848aa-98b4-44e2-a638-02c24275f3c5 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:37.157332 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1010/2021] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:37.162116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3003b89-1f40-4a90-b171-befb8e897df2 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:37.162615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3003b89-1f40-4a90-b171-befb8e897df2 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:37.163387 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3003b89-1f40-4a90-b171-befb8e897df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:37.174507 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7405e-288f-42a5-b86d-48b8b228620e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:37.180253 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e74e80-1922-4f78-bbf7-71e96950e80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:37.181926 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e74e80-1922-4f78-bbf7-71e96950e80e admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:37.182909 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e74e80-1922-4f78-bbf7-71e96950e80e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:37.183203 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e74e80-1922-4f78-bbf7-71e96950e80e admin admin] PATH_INFO: `/v3/projects/cbae1580ceaa47489ecdb0dca1c4a86c/users/c41197b159194858bd952bf012798542/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:37.188974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e74e80-1922-4f78-bbf7-71e96950e80e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbae1580ceaa47489ecdb0dca1c4a86c, user_id=c41197b159194858bd952bf012798542, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:37.191927 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e74e80-1922-4f78-bbf7-71e96950e80e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:37.202523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-f3003b89-1f40-4a90-b171-befb8e897df2 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:37.204799 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f3003b89-1f40-4a90-b171-befb8e897df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:37.205915 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1012/2022] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:37 2022] PUT /identity/v3/projects/cbae1580ceaa47489ecdb0dca1c4a86c/users/c41197b159194858bd952bf012798542/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:37.218066 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3abc7e-3bd3-441d-8777-4a4ffcdc4a4c None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:37.218477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3abc7e-3bd3-441d-8777-4a4ffcdc4a4c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:37.218837 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3abc7e-3bd3-441d-8777-4a4ffcdc4a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:37.271067 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0e3abc7e-3bd3-441d-8777-4a4ffcdc4a4c None None] MFA Rules not processed for user `c41197b159194858bd952bf012798542`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:37.272514 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0e3abc7e-3bd3-441d-8777-4a4ffcdc4a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:37.309798 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:37.353728 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1011/2023] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:37.362472 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3003b89-1f40-4a90-b171-befb8e897df2 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:37.368647 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f3003b89-1f40-4a90-b171-befb8e897df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:37.441298 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1013/2024] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:37 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:37.459078 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3abc7e-3bd3-441d-8777-4a4ffcdc4a4c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:37.459078 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0e3abc7e-3bd3-441d-8777-4a4ffcdc4a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:37.463709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3003b89-1f40-4a90-b171-befb8e897df2 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:37.469379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023cb546-ce9c-4a3a-b9ec-d5fd4807d15f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:37.471170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023cb546-ce9c-4a3a-b9ec-d5fd4807d15f service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:37.471648 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023cb546-ce9c-4a3a-b9ec-d5fd4807d15f service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:37.471975 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023cb546-ce9c-4a3a-b9ec-d5fd4807d15f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:37.485460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023cb546-ce9c-4a3a-b9ec-d5fd4807d15f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:37.487014 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023cb546-ce9c-4a3a-b9ec-d5fd4807d15f service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:37.499255 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1012/2025] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:07:37.538022 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3abc7e-3bd3-441d-8777-4a4ffcdc4a4c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:37.542065 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63d060-b358-4eb8-9553-8906e968aa31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:37.545115 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63d060-b358-4eb8-9553-8906e968aa31 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:37.545514 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63d060-b358-4eb8-9553-8906e968aa31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:37.545893 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63d060-b358-4eb8-9553-8906e968aa31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:37.557003 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf63d060-b358-4eb8-9553-8906e968aa31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:37.559250 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf63d060-b358-4eb8-9553-8906e968aa31 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:37.584727 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1014/2026] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:37 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:07:37.632858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023cb546-ce9c-4a3a-b9ec-d5fd4807d15f service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:37.635248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-023cb546-ce9c-4a3a-b9ec-d5fd4807d15f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:37.659895 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023cb546-ce9c-4a3a-b9ec-d5fd4807d15f service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:37.669818 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3662e12-0d9b-4f0c-85cd-aa4057fc2d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:37.672437 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63d060-b358-4eb8-9553-8906e968aa31 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:37.672661 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3662e12-0d9b-4f0c-85cd-aa4057fc2d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:37.672661 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3662e12-0d9b-4f0c-85cd-aa4057fc2d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:37.673486 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3662e12-0d9b-4f0c-85cd-aa4057fc2d5f admin admin] PATH_INFO: `/v3/users/5f82d8c086ee4118a830679f33dd88d3` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:37.673820 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cf63d060-b358-4eb8-9553-8906e968aa31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:37.674970 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3662e12-0d9b-4f0c-85cd-aa4057fc2d5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f82d8c086ee4118a830679f33dd88d3)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:37.676979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3662e12-0d9b-4f0c-85cd-aa4057fc2d5f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:37.707375 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63d060-b358-4eb8-9553-8906e968aa31 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:37.715152 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c96cc-b0b2-44bb-bea1-ce26c222846e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:37.715837 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c96cc-b0b2-44bb-bea1-ce26c222846e service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:37.716218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c96cc-b0b2-44bb-bea1-ce26c222846e service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:37.716367 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c96cc-b0b2-44bb-bea1-ce26c222846e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:37.722377 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-707c96cc-b0b2-44bb-bea1-ce26c222846e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:37.754269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:37.789114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a3662e12-0d9b-4f0c-85cd-aa4057fc2d5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f82d8c086ee4118a830679f33dd88d3'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:37.803183 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a3662e12-0d9b-4f0c-85cd-aa4057fc2d5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f82d8c086ee4118a830679f33dd88d3'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:37.803905 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a3662e12-0d9b-4f0c-85cd-aa4057fc2d5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f82d8c086ee4118a830679f33dd88d3'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:37.835586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a3662e12-0d9b-4f0c-85cd-aa4057fc2d5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f82d8c086ee4118a830679f33dd88d3'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:37.848685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a3662e12-0d9b-4f0c-85cd-aa4057fc2d5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f82d8c086ee4118a830679f33dd88d3'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:37.861963 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c96cc-b0b2-44bb-bea1-ce26c222846e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:37.863579 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c96cc-b0b2-44bb-bea1-ce26c222846e service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:37.866330 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1013/2027] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:37 2022] DELETE /identity/v3/users/5f82d8c086ee4118a830679f33dd88d3 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:37.871520 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8604f-d6f7-4b03-b08a-58c15dba59ff None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:37.882266 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8604f-d6f7-4b03-b08a-58c15dba59ff None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:37.882460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8604f-d6f7-4b03-b08a-58c15dba59ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:37.895468 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1015/2028] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:37.917003 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8df8604f-d6f7-4b03-b08a-58c15dba59ff None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:37.918380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8df8604f-d6f7-4b03-b08a-58c15dba59ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:38.063646 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1014/2029] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:38.081814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c96cc-b0b2-44bb-bea1-ce26c222846e service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:38.083653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-707c96cc-b0b2-44bb-bea1-ce26c222846e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:38.108883 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c96cc-b0b2-44bb-bea1-ce26c222846e service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:38.271992 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:38.278056 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a730664-8ca2-454a-9a4b-626d099544f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:38.280242 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a730664-8ca2-454a-9a4b-626d099544f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:38.281232 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a730664-8ca2-454a-9a4b-626d099544f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:38.283555 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a730664-8ca2-454a-9a4b-626d099544f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:38.313991 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a730664-8ca2-454a-9a4b-626d099544f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:38.315599 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a730664-8ca2-454a-9a4b-626d099544f4 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:38.348228 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1016/2030] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:38.873347 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8604f-d6f7-4b03-b08a-58c15dba59ff None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:38.875148 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8df8604f-d6f7-4b03-b08a-58c15dba59ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:38.922756 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8604f-d6f7-4b03-b08a-58c15dba59ff None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:38.929582 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f88ce-f71c-4469-94c7-280cf85e696d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:38.930677 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f88ce-f71c-4469-94c7-280cf85e696d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:38.931032 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f88ce-f71c-4469-94c7-280cf85e696d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:38.931380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f88ce-f71c-4469-94c7-280cf85e696d admin admin] PATH_INFO: `/v3/projects/edf5f6c5844b4463b3a11ddb3fe9852c` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:38.932906 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f88ce-f71c-4469-94c7-280cf85e696d admin admin] RBAC: Authorizing `identity:delete_project(project_id=edf5f6c5844b4463b3a11ddb3fe9852c)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:38.936309 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f88ce-f71c-4469-94c7-280cf85e696d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:39.008993 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-272f88ce-f71c-4469-94c7-280cf85e696d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edf5f6c5844b4463b3a11ddb3fe9852c', 'request_id': 'req-272f88ce-f71c-4469-94c7-280cf85e696d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:39.017907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-272f88ce-f71c-4469-94c7-280cf85e696d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edf5f6c5844b4463b3a11ddb3fe9852c', 'request_id': 'req-272f88ce-f71c-4469-94c7-280cf85e696d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:39.027148 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-272f88ce-f71c-4469-94c7-280cf85e696d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edf5f6c5844b4463b3a11ddb3fe9852c', 'request_id': 'req-272f88ce-f71c-4469-94c7-280cf85e696d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:39.046764 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-272f88ce-f71c-4469-94c7-280cf85e696d admin admin] The token cache is being invalidate because project edf5f6c5844b4463b3a11ddb3fe9852c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:39.048428 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-272f88ce-f71c-4469-94c7-280cf85e696d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:39.049433 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-272f88ce-f71c-4469-94c7-280cf85e696d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:39.052128 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1015/2031] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:38 2022] DELETE /identity/v3/projects/edf5f6c5844b4463b3a11ddb3fe9852c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:39.057276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a730664-8ca2-454a-9a4b-626d099544f4 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:39.072790 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a730664-8ca2-454a-9a4b-626d099544f4 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:39.152213 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb748ff-6c65-4436-a4c6-2c36b5939ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:39.153210 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb748ff-6c65-4436-a4c6-2c36b5939ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:39.153491 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb748ff-6c65-4436-a4c6-2c36b5939ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:39.153807 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb748ff-6c65-4436-a4c6-2c36b5939ab0 admin admin] PATH_INFO: `/v3/users/2fd46995d7fd409182ec153796d625ff` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:39.155128 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb748ff-6c65-4436-a4c6-2c36b5939ab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fd46995d7fd409182ec153796d625ff)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:39.157946 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb748ff-6c65-4436-a4c6-2c36b5939ab0 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:39.170182 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f88ce-f71c-4469-94c7-280cf85e696d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:39.172368 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-272f88ce-f71c-4469-94c7-280cf85e696d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:39.190603 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f88ce-f71c-4469-94c7-280cf85e696d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:39.196278 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78641ab1-f1b6-432a-b710-03aa522282a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:39.197337 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78641ab1-f1b6-432a-b710-03aa522282a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:39.197628 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78641ab1-f1b6-432a-b710-03aa522282a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:39.198519 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78641ab1-f1b6-432a-b710-03aa522282a6 admin admin] PATH_INFO: `/v3/projects/b4250f023b3a4dde8310e0c151855fd2` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:39.200650 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78641ab1-f1b6-432a-b710-03aa522282a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4250f023b3a4dde8310e0c151855fd2)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:39.203360 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78641ab1-f1b6-432a-b710-03aa522282a6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:39.231488 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6fb748ff-6c65-4436-a4c6-2c36b5939ab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fd46995d7fd409182ec153796d625ff'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:39.244571 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6fb748ff-6c65-4436-a4c6-2c36b5939ab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fd46995d7fd409182ec153796d625ff'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:39.259867 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:39.274923 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6fb748ff-6c65-4436-a4c6-2c36b5939ab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fd46995d7fd409182ec153796d625ff'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:39.277751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6fb748ff-6c65-4436-a4c6-2c36b5939ab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fd46995d7fd409182ec153796d625ff'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:39.278301 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-78641ab1-f1b6-432a-b710-03aa522282a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4250f023b3a4dde8310e0c151855fd2', 'request_id': 'req-78641ab1-f1b6-432a-b710-03aa522282a6'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:39.278710 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6fb748ff-6c65-4436-a4c6-2c36b5939ab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fd46995d7fd409182ec153796d625ff'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:39.294640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-78641ab1-f1b6-432a-b710-03aa522282a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4250f023b3a4dde8310e0c151855fd2', 'request_id': 'req-78641ab1-f1b6-432a-b710-03aa522282a6'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:39.303246 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1017/2032] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:39 2022] DELETE /identity/v3/users/2fd46995d7fd409182ec153796d625ff => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:39.309720 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-78641ab1-f1b6-432a-b710-03aa522282a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4250f023b3a4dde8310e0c151855fd2', 'request_id': 'req-78641ab1-f1b6-432a-b710-03aa522282a6'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:39.326546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-78641ab1-f1b6-432a-b710-03aa522282a6 admin admin] The token cache is being invalidate because project b4250f023b3a4dde8310e0c151855fd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:39.326982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-78641ab1-f1b6-432a-b710-03aa522282a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:39.328050 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-78641ab1-f1b6-432a-b710-03aa522282a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:39.332073 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1016/2033] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:39 2022] DELETE /identity/v3/projects/b4250f023b3a4dde8310e0c151855fd2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:07:39.340753 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb748ff-6c65-4436-a4c6-2c36b5939ab0 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:39.344284 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6fb748ff-6c65-4436-a4c6-2c36b5939ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:39.496657 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb748ff-6c65-4436-a4c6-2c36b5939ab0 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:39.504130 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5311e49-3baf-468f-8d6c-3401f8bf88c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:39.506943 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5311e49-3baf-468f-8d6c-3401f8bf88c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:39.507681 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5311e49-3baf-468f-8d6c-3401f8bf88c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:39.507893 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5311e49-3baf-468f-8d6c-3401f8bf88c6 admin admin] PATH_INFO: `/v3/users/ec6731e03aa04e238d3e86925c1ab926` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:39.510144 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5311e49-3baf-468f-8d6c-3401f8bf88c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec6731e03aa04e238d3e86925c1ab926)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:39.513672 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5311e49-3baf-468f-8d6c-3401f8bf88c6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:39.559302 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:39.585481 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78641ab1-f1b6-432a-b710-03aa522282a6 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:39.587554 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-78641ab1-f1b6-432a-b710-03aa522282a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:39.645631 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a5311e49-3baf-468f-8d6c-3401f8bf88c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec6731e03aa04e238d3e86925c1ab926'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:39.669274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a5311e49-3baf-468f-8d6c-3401f8bf88c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec6731e03aa04e238d3e86925c1ab926'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:39.730271 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a5311e49-3baf-468f-8d6c-3401f8bf88c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec6731e03aa04e238d3e86925c1ab926'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:39.732004 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a5311e49-3baf-468f-8d6c-3401f8bf88c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec6731e03aa04e238d3e86925c1ab926'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:39.732688 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a5311e49-3baf-468f-8d6c-3401f8bf88c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec6731e03aa04e238d3e86925c1ab926'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:39.764135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1018/2034] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:39 2022] DELETE /identity/v3/users/ec6731e03aa04e238d3e86925c1ab926 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:39.867810 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78641ab1-f1b6-432a-b710-03aa522282a6 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:39.961980 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a0158-1371-4206-a87e-c145cc5ccac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:39.964268 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a0158-1371-4206-a87e-c145cc5ccac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:39.964718 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a0158-1371-4206-a87e-c145cc5ccac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:39.965175 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a0158-1371-4206-a87e-c145cc5ccac5 admin admin] PATH_INFO: `/v3/users/d09e73a57b8440e88fba71f3b746e6ec` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:39.967060 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a0158-1371-4206-a87e-c145cc5ccac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d09e73a57b8440e88fba71f3b746e6ec)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:39.969980 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a0158-1371-4206-a87e-c145cc5ccac5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:40.055472 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-883a0158-1371-4206-a87e-c145cc5ccac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd09e73a57b8440e88fba71f3b746e6ec'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:40.076714 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-883a0158-1371-4206-a87e-c145cc5ccac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd09e73a57b8440e88fba71f3b746e6ec'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:40.077478 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-883a0158-1371-4206-a87e-c145cc5ccac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd09e73a57b8440e88fba71f3b746e6ec'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:40.093317 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-883a0158-1371-4206-a87e-c145cc5ccac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd09e73a57b8440e88fba71f3b746e6ec'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:40.096268 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:40.105690 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-883a0158-1371-4206-a87e-c145cc5ccac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd09e73a57b8440e88fba71f3b746e6ec'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:40.113302 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1017/2035] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:39 2022] DELETE /identity/v3/users/d09e73a57b8440e88fba71f3b746e6ec => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:40.118189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f737b-596f-4214-af57-6035c8594d5c None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:40.118355 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f737b-596f-4214-af57-6035c8594d5c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:40.118699 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f737b-596f-4214-af57-6035c8594d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:40.139195 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-003f737b-596f-4214-af57-6035c8594d5c None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:40.140881 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-003f737b-596f-4214-af57-6035c8594d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:40.224447 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1019/2036] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:40.236334 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a0158-1371-4206-a87e-c145cc5ccac5 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:40.239880 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-883a0158-1371-4206-a87e-c145cc5ccac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:40.285562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f737b-596f-4214-af57-6035c8594d5c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:40.287285 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-003f737b-596f-4214-af57-6035c8594d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:40.323829 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f737b-596f-4214-af57-6035c8594d5c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:40.337666 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc765bbc-ccd5-40e7-adbf-bfd3cb62a02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:40.338274 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a0158-1371-4206-a87e-c145cc5ccac5 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:40.339070 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc765bbc-ccd5-40e7-adbf-bfd3cb62a02e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:40.339428 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc765bbc-ccd5-40e7-adbf-bfd3cb62a02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:40.339716 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc765bbc-ccd5-40e7-adbf-bfd3cb62a02e admin admin] PATH_INFO: `/v3/projects/917051ba40a9452c9d6b8ea69b34f618` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:40.341831 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc765bbc-ccd5-40e7-adbf-bfd3cb62a02e admin admin] RBAC: Authorizing `identity:delete_project(project_id=917051ba40a9452c9d6b8ea69b34f618)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:40.343851 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc765bbc-ccd5-40e7-adbf-bfd3cb62a02e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:40.353162 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72c98c-cd84-44b7-a41e-c26306ec965b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:40.354050 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72c98c-cd84-44b7-a41e-c26306ec965b service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:40.354414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72c98c-cd84-44b7-a41e-c26306ec965b service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:40.354761 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72c98c-cd84-44b7-a41e-c26306ec965b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:40.375560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72c98c-cd84-44b7-a41e-c26306ec965b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:40.378867 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72c98c-cd84-44b7-a41e-c26306ec965b service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:40.392727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1018/2037] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:40.414405 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-fc765bbc-ccd5-40e7-adbf-bfd3cb62a02e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '917051ba40a9452c9d6b8ea69b34f618', 'request_id': 'req-fc765bbc-ccd5-40e7-adbf-bfd3cb62a02e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:40.420592 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-fc765bbc-ccd5-40e7-adbf-bfd3cb62a02e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '917051ba40a9452c9d6b8ea69b34f618', 'request_id': 'req-fc765bbc-ccd5-40e7-adbf-bfd3cb62a02e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:40.431270 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-fc765bbc-ccd5-40e7-adbf-bfd3cb62a02e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '917051ba40a9452c9d6b8ea69b34f618', 'request_id': 'req-fc765bbc-ccd5-40e7-adbf-bfd3cb62a02e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:40.444903 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-fc765bbc-ccd5-40e7-adbf-bfd3cb62a02e admin admin] The token cache is being invalidate because project 917051ba40a9452c9d6b8ea69b34f618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:40.445197 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-fc765bbc-ccd5-40e7-adbf-bfd3cb62a02e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:40.445879 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-fc765bbc-ccd5-40e7-adbf-bfd3cb62a02e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:40.447684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1020/2038] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:40 2022] DELETE /identity/v3/projects/917051ba40a9452c9d6b8ea69b34f618 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:40.452944 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e54eaf-aa5f-4e5a-915a-212d779bf0a3 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:40.453241 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e54eaf-aa5f-4e5a-915a-212d779bf0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:40.453569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e54eaf-aa5f-4e5a-915a-212d779bf0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:40.472246 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-51e54eaf-aa5f-4e5a-915a-212d779bf0a3 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:40.473542 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-51e54eaf-aa5f-4e5a-915a-212d779bf0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:40.524041 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc765bbc-ccd5-40e7-adbf-bfd3cb62a02e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:40.525620 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-fc765bbc-ccd5-40e7-adbf-bfd3cb62a02e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:40.548597 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:40.576043 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1019/2039] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:40.578932 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8890a6-cb52-42f6-ad87-69be3c793ce1 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:40.579305 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8890a6-cb52-42f6-ad87-69be3c793ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:40.579599 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8890a6-cb52-42f6-ad87-69be3c793ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:40.605828 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-5b8890a6-cb52-42f6-ad87-69be3c793ce1 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:40.607663 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5b8890a6-cb52-42f6-ad87-69be3c793ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:40.621197 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1020/2040] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:40.625603 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8890a6-cb52-42f6-ad87-69be3c793ce1 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:40.628095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc765bbc-ccd5-40e7-adbf-bfd3cb62a02e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:40.633353 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8156d-b40c-4f85-882e-3d33037d49fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:40.634202 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8156d-b40c-4f85-882e-3d33037d49fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:40.634486 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8156d-b40c-4f85-882e-3d33037d49fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:40.634915 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8156d-b40c-4f85-882e-3d33037d49fe admin admin] PATH_INFO: `/v3/projects/b933587a0269443fbe097972de789cc9` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:40.635942 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8156d-b40c-4f85-882e-3d33037d49fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b933587a0269443fbe097972de789cc9)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:40.636048 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8890a6-cb52-42f6-ad87-69be3c793ce1 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:40.640453 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8156d-b40c-4f85-882e-3d33037d49fe admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:40.646082 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688f660-2458-4f9d-9e46-4d076cfe22d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:40.647224 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688f660-2458-4f9d-9e46-4d076cfe22d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:40.647657 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688f660-2458-4f9d-9e46-4d076cfe22d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:40.648042 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688f660-2458-4f9d-9e46-4d076cfe22d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:40.649169 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688f660-2458-4f9d-9e46-4d076cfe22d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:07:40.649169 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688f660-2458-4f9d-9e46-4d076cfe22d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:40.651054 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688f660-2458-4f9d-9e46-4d076cfe22d9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:40.668619 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1021/2041] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:07:40.670414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688f660-2458-4f9d-9e46-4d076cfe22d9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:40.684980 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688f660-2458-4f9d-9e46-4d076cfe22d9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:40.691729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86448ef2-88af-49ad-8742-5ed3bba143a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:40.692794 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86448ef2-88af-49ad-8742-5ed3bba143a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:40.693081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86448ef2-88af-49ad-8742-5ed3bba143a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:40.693397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86448ef2-88af-49ad-8742-5ed3bba143a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:40.694813 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86448ef2-88af-49ad-8742-5ed3bba143a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:40.696869 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86448ef2-88af-49ad-8742-5ed3bba143a9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:40.717428 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d4b8156d-b40c-4f85-882e-3d33037d49fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b933587a0269443fbe097972de789cc9', 'request_id': 'req-d4b8156d-b40c-4f85-882e-3d33037d49fe'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:40.730071 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d4b8156d-b40c-4f85-882e-3d33037d49fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b933587a0269443fbe097972de789cc9', 'request_id': 'req-d4b8156d-b40c-4f85-882e-3d33037d49fe'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:40.743362 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d4b8156d-b40c-4f85-882e-3d33037d49fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b933587a0269443fbe097972de789cc9', 'request_id': 'req-d4b8156d-b40c-4f85-882e-3d33037d49fe'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:40.756583 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1022/2042] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:40 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:07:40.757822 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86448ef2-88af-49ad-8742-5ed3bba143a9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:40.772657 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d4b8156d-b40c-4f85-882e-3d33037d49fe admin admin] The token cache is being invalidate because project b933587a0269443fbe097972de789cc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:40.772967 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d4b8156d-b40c-4f85-882e-3d33037d49fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:40.774322 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d4b8156d-b40c-4f85-882e-3d33037d49fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:40.780573 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1021/2043] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:40 2022] DELETE /identity/v3/projects/b933587a0269443fbe097972de789cc9 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:07:40.783615 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cef8c-d83b-4845-9581-0eafbfc8eda3 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:40.783977 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cef8c-d83b-4845-9581-0eafbfc8eda3 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:40.785050 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cef8c-d83b-4845-9581-0eafbfc8eda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:40.809945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-628cef8c-d83b-4845-9581-0eafbfc8eda3 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:40.811494 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-628cef8c-d83b-4845-9581-0eafbfc8eda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:40.848643 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:40.870495 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86448ef2-88af-49ad-8742-5ed3bba143a9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:40.877852 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ff49b-e298-4892-9dbf-6d6613e8ecee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:40.878531 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ff49b-e298-4892-9dbf-6d6613e8ecee admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:40.878816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ff49b-e298-4892-9dbf-6d6613e8ecee admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:40.879245 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ff49b-e298-4892-9dbf-6d6613e8ecee admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:40.879946 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ff49b-e298-4892-9dbf-6d6613e8ecee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:40.881925 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ff49b-e298-4892-9dbf-6d6613e8ecee admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:40.903652 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1022/2044] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:40.904343 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628cef8c-d83b-4845-9581-0eafbfc8eda3 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:40.906135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-628cef8c-d83b-4845-9581-0eafbfc8eda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:40.910497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1023/2045] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:40 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:40.914699 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9716ebe-d21d-4e65-83ac-125f14f1c8a9 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:40.915175 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9716ebe-d21d-4e65-83ac-125f14f1c8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:40.915519 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9716ebe-d21d-4e65-83ac-125f14f1c8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:40.933659 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628cef8c-d83b-4845-9581-0eafbfc8eda3 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:40.939551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a9716ebe-d21d-4e65-83ac-125f14f1c8a9 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:40.940841 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a9716ebe-d21d-4e65-83ac-125f14f1c8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:40.941104 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e0972-d72b-4036-8c35-e268082f9342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:40.942171 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e0972-d72b-4036-8c35-e268082f9342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:40.942862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e0972-d72b-4036-8c35-e268082f9342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:40.943177 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e0972-d72b-4036-8c35-e268082f9342 admin admin] PATH_INFO: `/v3/projects/7d97ebff29b24588b0fecc9a413408e7` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:40.945579 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e0972-d72b-4036-8c35-e268082f9342 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d97ebff29b24588b0fecc9a413408e7)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:40.949012 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e0972-d72b-4036-8c35-e268082f9342 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:40.951199 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1024/2046] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:40.952579 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9716ebe-d21d-4e65-83ac-125f14f1c8a9 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:40.955045 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a9716ebe-d21d-4e65-83ac-125f14f1c8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:40.967607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9716ebe-d21d-4e65-83ac-125f14f1c8a9 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:40.972876 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5b9c3-5ace-414c-82b1-0b7572acf720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:40.973569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5b9c3-5ace-414c-82b1-0b7572acf720 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:40.973974 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5b9c3-5ace-414c-82b1-0b7572acf720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:40.974257 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5b9c3-5ace-414c-82b1-0b7572acf720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:40.974989 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5b9c3-5ace-414c-82b1-0b7572acf720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:40.976690 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5b9c3-5ace-414c-82b1-0b7572acf720 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:40.989120 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1025/2047] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:40.990403 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5b9c3-5ace-414c-82b1-0b7572acf720 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:41.003286 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5b9c3-5ace-414c-82b1-0b7572acf720 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:41.008326 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:41.018249 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-802e0972-d72b-4036-8c35-e268082f9342 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d97ebff29b24588b0fecc9a413408e7', 'request_id': 'req-802e0972-d72b-4036-8c35-e268082f9342'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:41.028493 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-802e0972-d72b-4036-8c35-e268082f9342 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d97ebff29b24588b0fecc9a413408e7', 'request_id': 'req-802e0972-d72b-4036-8c35-e268082f9342'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:41.039792 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-802e0972-d72b-4036-8c35-e268082f9342 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d97ebff29b24588b0fecc9a413408e7', 'request_id': 'req-802e0972-d72b-4036-8c35-e268082f9342'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:41.064112 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-802e0972-d72b-4036-8c35-e268082f9342 admin admin] The token cache is being invalidate because project 7d97ebff29b24588b0fecc9a413408e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:41.064112 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-802e0972-d72b-4036-8c35-e268082f9342 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:41.066733 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-802e0972-d72b-4036-8c35-e268082f9342 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:41.072954 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1023/2048] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:40 2022] DELETE /identity/v3/projects/7d97ebff29b24588b0fecc9a413408e7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:41.075391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e0972-d72b-4036-8c35-e268082f9342 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:41.076910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-802e0972-d72b-4036-8c35-e268082f9342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:41.105952 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3560ce-abb4-4596-9e07-96518697bf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:41.109199 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3560ce-abb4-4596-9e07-96518697bf25 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:41.110866 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3560ce-abb4-4596-9e07-96518697bf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:41.111332 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3560ce-abb4-4596-9e07-96518697bf25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:41.112732 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3560ce-abb4-4596-9e07-96518697bf25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:07:41.113438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3560ce-abb4-4596-9e07-96518697bf25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:41.115770 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3560ce-abb4-4596-9e07-96518697bf25 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:41.136739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1026/2049] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:07:41.141666 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37d142-b929-4652-a230-6059b828799a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:41.144235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37d142-b929-4652-a230-6059b828799a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:41.144722 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37d142-b929-4652-a230-6059b828799a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:41.191634 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e0972-d72b-4036-8c35-e268082f9342 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:41.194935 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4d37d142-b929-4652-a230-6059b828799a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:41.196256 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4d37d142-b929-4652-a230-6059b828799a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:41.197992 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e3a88-3a0f-4043-a357-d74b33b53ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:41.199142 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e3a88-3a0f-4043-a357-d74b33b53ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:41.199488 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e3a88-3a0f-4043-a357-d74b33b53ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:41.199699 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e3a88-3a0f-4043-a357-d74b33b53ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:41.201295 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e3a88-3a0f-4043-a357-d74b33b53ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:41.202979 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e3a88-3a0f-4043-a357-d74b33b53ab1 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:41.206016 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1027/2050] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:41.206851 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37d142-b929-4652-a230-6059b828799a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:41.208183 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4d37d142-b929-4652-a230-6059b828799a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:41.224792 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37d142-b929-4652-a230-6059b828799a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:41.229910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1024/2051] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:41.230908 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43941c28-bd16-46aa-92cb-b64e16e8785b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:41.231588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43941c28-bd16-46aa-92cb-b64e16e8785b admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:41.231937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43941c28-bd16-46aa-92cb-b64e16e8785b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:41.232220 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43941c28-bd16-46aa-92cb-b64e16e8785b admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:41.233894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43941c28-bd16-46aa-92cb-b64e16e8785b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:41.234355 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8f6e5-94ad-47af-a3d1-3bf3e40500ec None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:41.234653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8f6e5-94ad-47af-a3d1-3bf3e40500ec None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:41.235084 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8f6e5-94ad-47af-a3d1-3bf3e40500ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:41.236568 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43941c28-bd16-46aa-92cb-b64e16e8785b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:41.285413 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1fd8f6e5-94ad-47af-a3d1-3bf3e40500ec None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:41.288660 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1fd8f6e5-94ad-47af-a3d1-3bf3e40500ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:41.300324 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1025/2052] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:41.304489 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8f6e5-94ad-47af-a3d1-3bf3e40500ec None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:41.316056 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8f6e5-94ad-47af-a3d1-3bf3e40500ec None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:41.318292 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1028/2053] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:41 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:41.323269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43941c28-bd16-46aa-92cb-b64e16e8785b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:41.395491 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d2204-b1fe-4b3c-a415-ea061249fa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:41.398048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d2204-b1fe-4b3c-a415-ea061249fa39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:41.399202 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d2204-b1fe-4b3c-a415-ea061249fa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:41.399202 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d2204-b1fe-4b3c-a415-ea061249fa39 admin admin] PATH_INFO: `/v3/projects/989ebdbbd6114bb2998a6c31aa9579bd/users/18dad23d295e4d2797889a99114373e4/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:41.418075 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d2204-b1fe-4b3c-a415-ea061249fa39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=989ebdbbd6114bb2998a6c31aa9579bd, user_id=18dad23d295e4d2797889a99114373e4, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:41.419897 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43941c28-bd16-46aa-92cb-b64e16e8785b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:41.421316 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d2204-b1fe-4b3c-a415-ea061249fa39 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:41.433735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17715e-840f-42a3-b26c-13c1c97ced4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:41.434681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17715e-840f-42a3-b26c-13c1c97ced4b admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:41.435078 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17715e-840f-42a3-b26c-13c1c97ced4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:41.435385 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17715e-840f-42a3-b26c-13c1c97ced4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:41.436237 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17715e-840f-42a3-b26c-13c1c97ced4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:07:41.436622 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17715e-840f-42a3-b26c-13c1c97ced4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:41.438669 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17715e-840f-42a3-b26c-13c1c97ced4b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:41.449229 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1026/2054] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:41 2022] PUT /identity/v3/projects/989ebdbbd6114bb2998a6c31aa9579bd/users/18dad23d295e4d2797889a99114373e4/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:41.453046 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1029/2055] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:07:41.454309 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17715e-840f-42a3-b26c-13c1c97ced4b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:41.456565 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5e17715e-840f-42a3-b26c-13c1c97ced4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:41.456694 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d2204-b1fe-4b3c-a415-ea061249fa39 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:41.472825 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17715e-840f-42a3-b26c-13c1c97ced4b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:41.501920 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:41.519614 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:41.548214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d2204-b1fe-4b3c-a415-ea061249fa39 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:41.554012 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42968c07-e87f-47dc-a3b7-8b91434329c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:41.554692 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42968c07-e87f-47dc-a3b7-8b91434329c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:41.554979 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42968c07-e87f-47dc-a3b7-8b91434329c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:41.555261 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42968c07-e87f-47dc-a3b7-8b91434329c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:41.555965 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42968c07-e87f-47dc-a3b7-8b91434329c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:41.558086 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42968c07-e87f-47dc-a3b7-8b91434329c9 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:41.575375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afce0ed-b697-4060-8d8e-4058ea178638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:41.576215 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afce0ed-b697-4060-8d8e-4058ea178638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:41.576528 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afce0ed-b697-4060-8d8e-4058ea178638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:41.576819 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afce0ed-b697-4060-8d8e-4058ea178638 admin admin] PATH_INFO: `/v3/users/c36204a20abb4579bea88980ce736dbe` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:41.578214 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afce0ed-b697-4060-8d8e-4058ea178638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c36204a20abb4579bea88980ce736dbe)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:41.581639 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afce0ed-b697-4060-8d8e-4058ea178638 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:41.598989 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1027/2056] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:41 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:41.601226 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b703c1-8f29-4c36-ae72-ee10b7cf4da2 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:41.601594 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b703c1-8f29-4c36-ae72-ee10b7cf4da2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:41.601943 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b703c1-8f29-4c36-ae72-ee10b7cf4da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:41.627938 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-47b703c1-8f29-4c36-ae72-ee10b7cf4da2 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:41.629022 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-47b703c1-8f29-4c36-ae72-ee10b7cf4da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:41.640747 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1028/2057] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:41.642306 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b703c1-8f29-4c36-ae72-ee10b7cf4da2 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:41.659055 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1afce0ed-b697-4060-8d8e-4058ea178638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c36204a20abb4579bea88980ce736dbe'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:41.663157 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b703c1-8f29-4c36-ae72-ee10b7cf4da2 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:41.673425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38725b20-76cf-4966-8990-add00282f097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:41.674209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38725b20-76cf-4966-8990-add00282f097 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:41.674490 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38725b20-76cf-4966-8990-add00282f097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:41.675506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38725b20-76cf-4966-8990-add00282f097 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:41.675506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38725b20-76cf-4966-8990-add00282f097 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:41.677425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38725b20-76cf-4966-8990-add00282f097 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:41.678144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1afce0ed-b697-4060-8d8e-4058ea178638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c36204a20abb4579bea88980ce736dbe'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:41.679282 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1afce0ed-b697-4060-8d8e-4058ea178638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c36204a20abb4579bea88980ce736dbe'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:41.707240 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1afce0ed-b697-4060-8d8e-4058ea178638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c36204a20abb4579bea88980ce736dbe'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:41.718606 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1afce0ed-b697-4060-8d8e-4058ea178638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c36204a20abb4579bea88980ce736dbe'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:41.724768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1029/2058] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:41 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:41.724768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38725b20-76cf-4966-8990-add00282f097 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:41.724768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-38725b20-76cf-4966-8990-add00282f097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:41.726963 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1030/2059] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:41 2022] DELETE /identity/v3/users/c36204a20abb4579bea88980ce736dbe => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:41.727856 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afce0ed-b697-4060-8d8e-4058ea178638 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:41.729767 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1afce0ed-b697-4060-8d8e-4058ea178638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:41.802871 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38725b20-76cf-4966-8990-add00282f097 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:41.810044 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afce0ed-b697-4060-8d8e-4058ea178638 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:41.818160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059ffff-4d93-43e3-8d66-db8a559bcc66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:41.818923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059ffff-4d93-43e3-8d66-db8a559bcc66 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:41.819283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059ffff-4d93-43e3-8d66-db8a559bcc66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:41.819739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059ffff-4d93-43e3-8d66-db8a559bcc66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:41.821910 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0059ffff-4d93-43e3-8d66-db8a559bcc66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:41.872634 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397cfaa-8352-4d7a-bdc5-7ef82b74bb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:41.873269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397cfaa-8352-4d7a-bdc5-7ef82b74bb91 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:41.873615 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397cfaa-8352-4d7a-bdc5-7ef82b74bb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:41.874197 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397cfaa-8352-4d7a-bdc5-7ef82b74bb91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:41.875022 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397cfaa-8352-4d7a-bdc5-7ef82b74bb91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:41.877087 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397cfaa-8352-4d7a-bdc5-7ef82b74bb91 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:41.888937 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1030/2060] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:41.890928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397cfaa-8352-4d7a-bdc5-7ef82b74bb91 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:41.894150 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6397cfaa-8352-4d7a-bdc5-7ef82b74bb91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:41.911178 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:41.914800 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397cfaa-8352-4d7a-bdc5-7ef82b74bb91 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:41.917726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059ffff-4d93-43e3-8d66-db8a559bcc66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:41.920301 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643e958-55de-435e-8888-fddd9ae26cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:41.920739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059ffff-4d93-43e3-8d66-db8a559bcc66 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:41.921023 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643e958-55de-435e-8888-fddd9ae26cc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:41.921307 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643e958-55de-435e-8888-fddd9ae26cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:41.921582 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643e958-55de-435e-8888-fddd9ae26cc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:41.922820 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643e958-55de-435e-8888-fddd9ae26cc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:41.925185 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643e958-55de-435e-8888-fddd9ae26cc1 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:41.937587 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1031/2061] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:41.940727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2a9ae-97bd-4532-a43a-369246c3f663 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:41.941081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2a9ae-97bd-4532-a43a-369246c3f663 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:41.941426 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2a9ae-97bd-4532-a43a-369246c3f663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:41.956976 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1031/2062] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:41 2022] POST /identity/v3/users => generated 286 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:41.958061 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643e958-55de-435e-8888-fddd9ae26cc1 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:41.960020 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8643e958-55de-435e-8888-fddd9ae26cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:41.965863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-19b2a9ae-97bd-4532-a43a-369246c3f663 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:41.967423 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-19b2a9ae-97bd-4532-a43a-369246c3f663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:41.974384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643e958-55de-435e-8888-fddd9ae26cc1 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:41.980152 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1032/2063] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:41.980152 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2a9ae-97bd-4532-a43a-369246c3f663 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:41.980776 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c76be3-a0d7-48b1-bc4f-c856580d6bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:41.980776 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c76be3-a0d7-48b1-bc4f-c856580d6bf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:41.980926 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c76be3-a0d7-48b1-bc4f-c856580d6bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:41.981170 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c76be3-a0d7-48b1-bc4f-c856580d6bf0 admin admin] PATH_INFO: `/v3/users/f2da574d2af04217967bfd90be946b29` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:41.982473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c76be3-a0d7-48b1-bc4f-c856580d6bf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2da574d2af04217967bfd90be946b29)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:41.984675 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c76be3-a0d7-48b1-bc4f-c856580d6bf0 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:41.990873 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2a9ae-97bd-4532-a43a-369246c3f663 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:41.995664 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468f704-6209-4a04-b957-00ae0abd3795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:41.996500 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468f704-6209-4a04-b957-00ae0abd3795 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:41.996888 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468f704-6209-4a04-b957-00ae0abd3795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:41.997262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468f704-6209-4a04-b957-00ae0abd3795 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:41.998300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468f704-6209-4a04-b957-00ae0abd3795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:42.000063 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468f704-6209-4a04-b957-00ae0abd3795 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:42.013360 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1033/2064] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:42.014498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468f704-6209-4a04-b957-00ae0abd3795 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:42.026160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468f704-6209-4a04-b957-00ae0abd3795 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:42.030757 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=90,keystone:INSERT=7,keystone:DELETE=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:42.033867 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54ea93-aecc-4f03-a240-cd9d4bba7d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:42.034216 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54ea93-aecc-4f03-a240-cd9d4bba7d22 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:42.034523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54ea93-aecc-4f03-a240-cd9d4bba7d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:42.034880 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54ea93-aecc-4f03-a240-cd9d4bba7d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:42.035611 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac54ea93-aecc-4f03-a240-cd9d4bba7d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:42.037464 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac54ea93-aecc-4f03-a240-cd9d4bba7d22 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:42.056605 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1034/2065] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:42.058642 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54ea93-aecc-4f03-a240-cd9d4bba7d22 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:42.071653 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54ea93-aecc-4f03-a240-cd9d4bba7d22 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:42.076775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef4a1c-316a-47ff-a179-be8edeffd5f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:42.077825 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef4a1c-316a-47ff-a179-be8edeffd5f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:42.078026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-82c76be3-a0d7-48b1-bc4f-c856580d6bf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2da574d2af04217967bfd90be946b29'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:42.078646 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef4a1c-316a-47ff-a179-be8edeffd5f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:42.079661 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef4a1c-316a-47ff-a179-be8edeffd5f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:42.091088 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-82c76be3-a0d7-48b1-bc4f-c856580d6bf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2da574d2af04217967bfd90be946b29'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:42.091952 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef4a1c-316a-47ff-a179-be8edeffd5f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:42.094384 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef4a1c-316a-47ff-a179-be8edeffd5f9 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:42.107099 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-82c76be3-a0d7-48b1-bc4f-c856580d6bf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2da574d2af04217967bfd90be946b29'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:42.108083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-82c76be3-a0d7-48b1-bc4f-c856580d6bf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2da574d2af04217967bfd90be946b29'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:42.108502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-82c76be3-a0d7-48b1-bc4f-c856580d6bf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2da574d2af04217967bfd90be946b29'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:42.119562 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1035/2066] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:42.120510 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef4a1c-316a-47ff-a179-be8edeffd5f9 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:42.133372 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef4a1c-316a-47ff-a179-be8edeffd5f9 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:42.137117 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1032/2067] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:41 2022] DELETE /identity/v3/users/f2da574d2af04217967bfd90be946b29 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:42.138388 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c76be3-a0d7-48b1-bc4f-c856580d6bf0 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:42.143702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-82c76be3-a0d7-48b1-bc4f-c856580d6bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:42.232816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3443d7-2cc9-4d89-9d0c-26fe926991ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:42.234163 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3443d7-2cc9-4d89-9d0c-26fe926991ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:42.234623 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3443d7-2cc9-4d89-9d0c-26fe926991ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:42.235765 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3443d7-2cc9-4d89-9d0c-26fe926991ca admin admin] PATH_INFO: `/v3/projects/c5dae97ba944458da46dc38dfdd1a896/users/ce60c23f589a4079b986e6a07d5461a1/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:42.244313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c76be3-a0d7-48b1-bc4f-c856580d6bf0 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:42.249811 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5a605-b906-4832-8120-7deb650f7d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:42.251223 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5a605-b906-4832-8120-7deb650f7d86 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:42.251526 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5a605-b906-4832-8120-7deb650f7d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:42.251791 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5a605-b906-4832-8120-7deb650f7d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:42.254396 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f5a605-b906-4832-8120-7deb650f7d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:42.256105 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f5a605-b906-4832-8120-7deb650f7d86 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:42.256829 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3443d7-2cc9-4d89-9d0c-26fe926991ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5dae97ba944458da46dc38dfdd1a896, user_id=ce60c23f589a4079b986e6a07d5461a1, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:42.272694 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3443d7-2cc9-4d89-9d0c-26fe926991ca admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:42.275939 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1033/2068] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:42.281493 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5a605-b906-4832-8120-7deb650f7d86 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:42.300454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1036/2069] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:42 2022] PUT /identity/v3/projects/c5dae97ba944458da46dc38dfdd1a896/users/ce60c23f589a4079b986e6a07d5461a1/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:42.306039 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5a605-b906-4832-8120-7deb650f7d86 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:42.310925 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e50e0-432f-4772-938c-84a278b2952b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:42.311793 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e50e0-432f-4772-938c-84a278b2952b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:42.312206 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e50e0-432f-4772-938c-84a278b2952b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:42.378571 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a56e50e0-432f-4772-938c-84a278b2952b None None] MFA Rules not processed for user `ce60c23f589a4079b986e6a07d5461a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:42.380009 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a56e50e0-432f-4772-938c-84a278b2952b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:42.402975 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665118e-4229-4d79-86f3-7d7ec500d8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:42.405107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665118e-4229-4d79-86f3-7d7ec500d8bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:42.405107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665118e-4229-4d79-86f3-7d7ec500d8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:42.405611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665118e-4229-4d79-86f3-7d7ec500d8bc admin admin] PATH_INFO: `/v3/projects/605aa1b486a8401a90578877b1ad6503/users/b91314c3d14d4811b22e966abbdc6b95/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:42.458070 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665118e-4229-4d79-86f3-7d7ec500d8bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=605aa1b486a8401a90578877b1ad6503, user_id=b91314c3d14d4811b22e966abbdc6b95, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:42.461215 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665118e-4229-4d79-86f3-7d7ec500d8bc admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:42.492089 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1034/2070] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:42 2022] PUT /identity/v3/projects/605aa1b486a8401a90578877b1ad6503/users/b91314c3d14d4811b22e966abbdc6b95/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:42.504221 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585dbcc-96da-4aba-877f-d6baac17d00a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:42.505168 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585dbcc-96da-4aba-877f-d6baac17d00a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:42.505846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585dbcc-96da-4aba-877f-d6baac17d00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:42.531237 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1037/2071] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:42.535996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e50e0-432f-4772-938c-84a278b2952b None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:42.539245 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a56e50e0-432f-4772-938c-84a278b2952b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:42.575117 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-9585dbcc-96da-4aba-877f-d6baac17d00a None None] MFA Rules not processed for user `b91314c3d14d4811b22e966abbdc6b95`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:42.581971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9585dbcc-96da-4aba-877f-d6baac17d00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:42.601006 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:42.616226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:42.670869 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e50e0-432f-4772-938c-84a278b2952b None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:42.703321 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1035/2072] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:07:42.716930 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585dbcc-96da-4aba-877f-d6baac17d00a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:42.718861 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9585dbcc-96da-4aba-877f-d6baac17d00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:42.761975 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37235b-c010-4a09-a2b9-b4edd2b2130e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:42.762977 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37235b-c010-4a09-a2b9-b4edd2b2130e service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:42.763918 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37235b-c010-4a09-a2b9-b4edd2b2130e service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:42.764371 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37235b-c010-4a09-a2b9-b4edd2b2130e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:42.818494 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585dbcc-96da-4aba-877f-d6baac17d00a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:42.828269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1143938-c71b-4a88-ac5c-6d2f366da862 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:42.830118 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1143938-c71b-4a88-ac5c-6d2f366da862 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:42.830536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1143938-c71b-4a88-ac5c-6d2f366da862 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:42.831300 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1143938-c71b-4a88-ac5c-6d2f366da862 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:42.848581 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1143938-c71b-4a88-ac5c-6d2f366da862 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:42.858285 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1143938-c71b-4a88-ac5c-6d2f366da862 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:42.859544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37235b-c010-4a09-a2b9-b4edd2b2130e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:42.864704 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37235b-c010-4a09-a2b9-b4edd2b2130e service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:42.879272 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1038/2073] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:42.884579 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1036/2074] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:07:42.915807 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37235b-c010-4a09-a2b9-b4edd2b2130e service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:42.917389 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-bd37235b-c010-4a09-a2b9-b4edd2b2130e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:42.928894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1143938-c71b-4a88-ac5c-6d2f366da862 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:43.097948 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1143938-c71b-4a88-ac5c-6d2f366da862 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:43.100296 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37235b-c010-4a09-a2b9-b4edd2b2130e service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:43.110560 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce503f-582c-4a7b-83b2-6e077eb102f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:43.111952 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce503f-582c-4a7b-83b2-6e077eb102f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:43.112502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce503f-582c-4a7b-83b2-6e077eb102f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:43.112885 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce503f-582c-4a7b-83b2-6e077eb102f9 admin admin] PATH_INFO: `/v3/users/b91314c3d14d4811b22e966abbdc6b95` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:43.114599 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375d91e-dc2e-4938-acaa-94c0de583e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:43.119384 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375d91e-dc2e-4938-acaa-94c0de583e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:43.119688 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce503f-582c-4a7b-83b2-6e077eb102f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b91314c3d14d4811b22e966abbdc6b95)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:43.121244 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375d91e-dc2e-4938-acaa-94c0de583e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:43.121244 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375d91e-dc2e-4938-acaa-94c0de583e44 admin admin] PATH_INFO: `/v3/users/ce60c23f589a4079b986e6a07d5461a1` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:43.124500 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce503f-582c-4a7b-83b2-6e077eb102f9 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:43.126822 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375d91e-dc2e-4938-acaa-94c0de583e44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce60c23f589a4079b986e6a07d5461a1)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:43.132693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375d91e-dc2e-4938-acaa-94c0de583e44 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:43.217502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:43.234529 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f375d91e-dc2e-4938-acaa-94c0de583e44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce60c23f589a4079b986e6a07d5461a1'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:43.238464 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b3ce503f-582c-4a7b-83b2-6e077eb102f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b91314c3d14d4811b22e966abbdc6b95'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:43.260742 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:43.265641 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f375d91e-dc2e-4938-acaa-94c0de583e44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce60c23f589a4079b986e6a07d5461a1'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:43.267463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f375d91e-dc2e-4938-acaa-94c0de583e44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce60c23f589a4079b986e6a07d5461a1'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:43.272739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b3ce503f-582c-4a7b-83b2-6e077eb102f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b91314c3d14d4811b22e966abbdc6b95'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:43.286701 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f375d91e-dc2e-4938-acaa-94c0de583e44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce60c23f589a4079b986e6a07d5461a1'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:43.295118 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b3ce503f-582c-4a7b-83b2-6e077eb102f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b91314c3d14d4811b22e966abbdc6b95'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:43.296105 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b3ce503f-582c-4a7b-83b2-6e077eb102f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b91314c3d14d4811b22e966abbdc6b95'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:43.296985 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f375d91e-dc2e-4938-acaa-94c0de583e44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce60c23f589a4079b986e6a07d5461a1'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:43.297102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b3ce503f-582c-4a7b-83b2-6e077eb102f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b91314c3d14d4811b22e966abbdc6b95'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:43.311140 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1039/2075] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:42 2022] DELETE /identity/v3/users/ce60c23f589a4079b986e6a07d5461a1 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:43.311140 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4583a-a1a7-4b37-a5e1-cdc77652ea64 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:43.311140 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4583a-a1a7-4b37-a5e1-cdc77652ea64 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:43.311140 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4583a-a1a7-4b37-a5e1-cdc77652ea64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:43.318457 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1037/2076] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:42 2022] DELETE /identity/v3/users/b91314c3d14d4811b22e966abbdc6b95 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:43.322415 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce503f-582c-4a7b-83b2-6e077eb102f9 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:43.323104 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b3ce503f-582c-4a7b-83b2-6e077eb102f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:43.356853 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-dec4583a-a1a7-4b37-a5e1-cdc77652ea64 None None] MFA Rules not processed for user `18dad23d295e4d2797889a99114373e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:43.358374 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-dec4583a-a1a7-4b37-a5e1-cdc77652ea64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:43.433220 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce503f-582c-4a7b-83b2-6e077eb102f9 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:43.439084 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d274a27-26a1-490a-8686-240bc58ce9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:43.440070 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d274a27-26a1-490a-8686-240bc58ce9ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:43.440449 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d274a27-26a1-490a-8686-240bc58ce9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:43.440806 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d274a27-26a1-490a-8686-240bc58ce9ca admin admin] PATH_INFO: `/v3/projects/6d85f6335e524a77b97227875fb1f7bd` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:43.442100 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d274a27-26a1-490a-8686-240bc58ce9ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d85f6335e524a77b97227875fb1f7bd)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:43.444219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d274a27-26a1-490a-8686-240bc58ce9ca admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:43.448236 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1040/2077] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:43.449153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4583a-a1a7-4b37-a5e1-cdc77652ea64 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:43.450704 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-dec4583a-a1a7-4b37-a5e1-cdc77652ea64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:43.466845 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4583a-a1a7-4b37-a5e1-cdc77652ea64 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:43.471967 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83892b-e2d4-4ed1-b938-c95e2389c6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:43.472892 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83892b-e2d4-4ed1-b938-c95e2389c6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:43.473184 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83892b-e2d4-4ed1-b938-c95e2389c6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:43.473465 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83892b-e2d4-4ed1-b938-c95e2389c6ed admin admin] PATH_INFO: `/v3/projects/db1f3f0507ed4fac8ba175b1ba10e7e2` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:43.475045 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83892b-e2d4-4ed1-b938-c95e2389c6ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=db1f3f0507ed4fac8ba175b1ba10e7e2)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:43.477089 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83892b-e2d4-4ed1-b938-c95e2389c6ed admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:43.511842 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9d274a27-26a1-490a-8686-240bc58ce9ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d85f6335e524a77b97227875fb1f7bd', 'request_id': 'req-9d274a27-26a1-490a-8686-240bc58ce9ca'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:43.530623 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9d274a27-26a1-490a-8686-240bc58ce9ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d85f6335e524a77b97227875fb1f7bd', 'request_id': 'req-9d274a27-26a1-490a-8686-240bc58ce9ca'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:43.540914 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9d274a27-26a1-490a-8686-240bc58ce9ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d85f6335e524a77b97227875fb1f7bd', 'request_id': 'req-9d274a27-26a1-490a-8686-240bc58ce9ca'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:43.543627 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-db83892b-e2d4-4ed1-b938-c95e2389c6ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db1f3f0507ed4fac8ba175b1ba10e7e2', 'request_id': 'req-db83892b-e2d4-4ed1-b938-c95e2389c6ed'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:43.553208 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9d274a27-26a1-490a-8686-240bc58ce9ca admin admin] The token cache is being invalidate because project 6d85f6335e524a77b97227875fb1f7bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:43.553525 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9d274a27-26a1-490a-8686-240bc58ce9ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:43.554031 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-db83892b-e2d4-4ed1-b938-c95e2389c6ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db1f3f0507ed4fac8ba175b1ba10e7e2', 'request_id': 'req-db83892b-e2d4-4ed1-b938-c95e2389c6ed'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:43.554179 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9d274a27-26a1-490a-8686-240bc58ce9ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:43.556272 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1038/2078] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:43 2022] DELETE /identity/v3/projects/6d85f6335e524a77b97227875fb1f7bd => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:43.557503 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dbf01-2de8-4913-9f02-ce1cefc86418 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:43.557904 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dbf01-2de8-4913-9f02-ce1cefc86418 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:43.558079 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dbf01-2de8-4913-9f02-ce1cefc86418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:43.562271 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-db83892b-e2d4-4ed1-b938-c95e2389c6ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db1f3f0507ed4fac8ba175b1ba10e7e2', 'request_id': 'req-db83892b-e2d4-4ed1-b938-c95e2389c6ed'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:43.576605 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-db83892b-e2d4-4ed1-b938-c95e2389c6ed admin admin] The token cache is being invalidate because project db1f3f0507ed4fac8ba175b1ba10e7e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:43.577345 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c14dbf01-2de8-4913-9f02-ce1cefc86418 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:43.577852 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-db83892b-e2d4-4ed1-b938-c95e2389c6ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:43.579176 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c14dbf01-2de8-4913-9f02-ce1cefc86418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:43.580896 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-db83892b-e2d4-4ed1-b938-c95e2389c6ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:43.583112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1041/2079] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:43 2022] DELETE /identity/v3/projects/db1f3f0507ed4fac8ba175b1ba10e7e2 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:43.584570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8fa2d-37df-4313-add4-adc19fbef289 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:43.584829 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8fa2d-37df-4313-add4-adc19fbef289 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:43.585043 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8fa2d-37df-4313-add4-adc19fbef289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:43.605749 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-30a8fa2d-37df-4313-add4-adc19fbef289 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:43.606978 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-30a8fa2d-37df-4313-add4-adc19fbef289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:43.633869 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:43.643370 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:43.662737 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1039/2080] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:43.662737 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14dbf01-2de8-4913-9f02-ce1cefc86418 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:43.665706 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c14dbf01-2de8-4913-9f02-ce1cefc86418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:43.679000 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14dbf01-2de8-4913-9f02-ce1cefc86418 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:43.684036 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a29d74-ae5b-436e-be92-ac645f5a8d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:43.684848 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a29d74-ae5b-436e-be92-ac645f5a8d5a admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:43.685120 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a29d74-ae5b-436e-be92-ac645f5a8d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:43.685399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a29d74-ae5b-436e-be92-ac645f5a8d5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:43.686174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a29d74-ae5b-436e-be92-ac645f5a8d5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:43.688729 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a29d74-ae5b-436e-be92-ac645f5a8d5a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:43.701480 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1042/2081] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:43.703234 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede330d5-507c-4087-a316-6ef6ab4d1c0b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:43.704280 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede330d5-507c-4087-a316-6ef6ab4d1c0b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:43.704619 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede330d5-507c-4087-a316-6ef6ab4d1c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:43.725274 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-ede330d5-507c-4087-a316-6ef6ab4d1c0b None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:43.726591 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ede330d5-507c-4087-a316-6ef6ab4d1c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:43.738624 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1040/2082] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:43 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:43.738624 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a29d74-ae5b-436e-be92-ac645f5a8d5a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:43.738624 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-33a29d74-ae5b-436e-be92-ac645f5a8d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:43.815804 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a29d74-ae5b-436e-be92-ac645f5a8d5a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:43.821144 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41973416-8441-462d-8dbd-66781b44e897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:43.821872 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1043/2083] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:43.824726 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41973416-8441-462d-8dbd-66781b44e897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:43.824726 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41973416-8441-462d-8dbd-66781b44e897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:43.824898 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede330d5-507c-4087-a316-6ef6ab4d1c0b None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:43.825021 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41973416-8441-462d-8dbd-66781b44e897 admin admin] PATH_INFO: `/v3/users/c41197b159194858bd952bf012798542` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:43.825021 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41973416-8441-462d-8dbd-66781b44e897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c41197b159194858bd952bf012798542)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:43.826625 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41973416-8441-462d-8dbd-66781b44e897 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:43.835891 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ede330d5-507c-4087-a316-6ef6ab4d1c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:43.900291 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-41973416-8441-462d-8dbd-66781b44e897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c41197b159194858bd952bf012798542'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:43.909651 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-41973416-8441-462d-8dbd-66781b44e897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c41197b159194858bd952bf012798542'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:43.920936 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede330d5-507c-4087-a316-6ef6ab4d1c0b None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:43.925165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-41973416-8441-462d-8dbd-66781b44e897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c41197b159194858bd952bf012798542'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:43.925929 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-41973416-8441-462d-8dbd-66781b44e897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c41197b159194858bd952bf012798542'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:43.926564 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-41973416-8441-462d-8dbd-66781b44e897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c41197b159194858bd952bf012798542'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:43.926677 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ead49-7705-4c13-bf8a-7a925bb34392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:43.927739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ead49-7705-4c13-bf8a-7a925bb34392 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:43.928232 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ead49-7705-4c13-bf8a-7a925bb34392 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:43.928749 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ead49-7705-4c13-bf8a-7a925bb34392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:43.930814 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-412ead49-7705-4c13-bf8a-7a925bb34392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:43.942144 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1041/2084] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:43 2022] DELETE /identity/v3/users/c41197b159194858bd952bf012798542 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:43.943502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41973416-8441-462d-8dbd-66781b44e897 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:43.944821 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-41973416-8441-462d-8dbd-66781b44e897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:43.947059 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ead49-7705-4c13-bf8a-7a925bb34392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:43.949306 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ead49-7705-4c13-bf8a-7a925bb34392 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:43.961373 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1044/2085] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:43.962643 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ead49-7705-4c13-bf8a-7a925bb34392 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:43.964172 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-412ead49-7705-4c13-bf8a-7a925bb34392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:43.978625 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ead49-7705-4c13-bf8a-7a925bb34392 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:44.013200 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41973416-8441-462d-8dbd-66781b44e897 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:44.018896 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7babc505-76ed-409f-81fb-a057421e853a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:44.019709 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babc505-76ed-409f-81fb-a057421e853a service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:44.020194 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babc505-76ed-409f-81fb-a057421e853a service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:44.020523 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babc505-76ed-409f-81fb-a057421e853a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:44.022932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7babc505-76ed-409f-81fb-a057421e853a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:44.037340 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:44.058374 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6a2dc-3bff-481a-90bf-7adb203dd7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:44.059378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6a2dc-3bff-481a-90bf-7adb203dd7bf admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:44.059813 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6a2dc-3bff-481a-90bf-7adb203dd7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:44.060438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6a2dc-3bff-481a-90bf-7adb203dd7bf admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:44.061507 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6a2dc-3bff-481a-90bf-7adb203dd7bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:44.065319 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6a2dc-3bff-481a-90bf-7adb203dd7bf admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:44.088621 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:44.115554 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1045/2086] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:43 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:44.117125 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2edd0-5c79-4c81-9b88-1077103ec692 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:44.118453 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2edd0-5c79-4c81-9b88-1077103ec692 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:44.118740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2edd0-5c79-4c81-9b88-1077103ec692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:44.159197 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-1dc2edd0-5c79-4c81-9b88-1077103ec692 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:44.164047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1dc2edd0-5c79-4c81-9b88-1077103ec692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:44.165711 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7babc505-76ed-409f-81fb-a057421e853a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:44.167087 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7babc505-76ed-409f-81fb-a057421e853a service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:44.185347 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1046/2087] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:44.185969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2edd0-5c79-4c81-9b88-1077103ec692 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:44.197465 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1042/2088] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:44.199736 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7babc505-76ed-409f-81fb-a057421e853a service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:44.203558 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2edd0-5c79-4c81-9b88-1077103ec692 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:44.223365 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53b35d-1a93-461c-b9e3-47536abbacb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:44.224134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53b35d-1a93-461c-b9e3-47536abbacb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:44.224452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53b35d-1a93-461c-b9e3-47536abbacb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:44.224769 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53b35d-1a93-461c-b9e3-47536abbacb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:44.224919 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7babc505-76ed-409f-81fb-a057421e853a service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:44.225514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53b35d-1a93-461c-b9e3-47536abbacb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:44.227153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53b35d-1a93-461c-b9e3-47536abbacb1 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:44.245798 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41d3fc-5227-49c7-840c-ffa5819fe268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:44.246690 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41d3fc-5227-49c7-840c-ffa5819fe268 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:44.246976 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41d3fc-5227-49c7-840c-ffa5819fe268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:44.247648 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41d3fc-5227-49c7-840c-ffa5819fe268 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:44.248433 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41d3fc-5227-49c7-840c-ffa5819fe268 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:07:44.248733 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41d3fc-5227-49c7-840c-ffa5819fe268 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:44.250376 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41d3fc-5227-49c7-840c-ffa5819fe268 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:44.251870 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1047/2089] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:44.256729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53b35d-1a93-461c-b9e3-47536abbacb1 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:44.279765 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53b35d-1a93-461c-b9e3-47536abbacb1 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:44.283310 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1043/2090] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:07:44.284250 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41d3fc-5227-49c7-840c-ffa5819fe268 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:44.293325 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387fc78-378d-4f10-97d2-dad080b0f388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:44.297989 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387fc78-378d-4f10-97d2-dad080b0f388 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:44.297989 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387fc78-378d-4f10-97d2-dad080b0f388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:44.298256 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41d3fc-5227-49c7-840c-ffa5819fe268 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:44.299762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387fc78-378d-4f10-97d2-dad080b0f388 admin admin] PATH_INFO: `/v3/projects/ef188ab798804cd88719062e8dc2fb97/users/636ff2a569c34dadadfd5d9d704fb7f9/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:44.303631 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108af750-d640-46e9-99ff-fe73d17dc109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:44.304527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108af750-d640-46e9-99ff-fe73d17dc109 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:44.304991 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108af750-d640-46e9-99ff-fe73d17dc109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:44.305432 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108af750-d640-46e9-99ff-fe73d17dc109 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:44.306312 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108af750-d640-46e9-99ff-fe73d17dc109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:44.308438 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108af750-d640-46e9-99ff-fe73d17dc109 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:44.331567 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387fc78-378d-4f10-97d2-dad080b0f388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef188ab798804cd88719062e8dc2fb97, user_id=636ff2a569c34dadadfd5d9d704fb7f9, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:44.347492 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387fc78-378d-4f10-97d2-dad080b0f388 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:44.369771 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1044/2091] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:44 2022] POST /identity/v3/projects => generated 383 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:44.373291 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108af750-d640-46e9-99ff-fe73d17dc109 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:44.389816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1048/2092] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:44 2022] PUT /identity/v3/projects/ef188ab798804cd88719062e8dc2fb97/users/636ff2a569c34dadadfd5d9d704fb7f9/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:07:44.390862 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387fc78-378d-4f10-97d2-dad080b0f388 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:44.564517 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108af750-d640-46e9-99ff-fe73d17dc109 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:44.577824 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751372e6-f09a-404d-a079-10f15637683c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:44.579499 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751372e6-f09a-404d-a079-10f15637683c admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:44.580309 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387fc78-378d-4f10-97d2-dad080b0f388 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:44.580862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751372e6-f09a-404d-a079-10f15637683c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:44.581245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751372e6-f09a-404d-a079-10f15637683c admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:44.583243 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751372e6-f09a-404d-a079-10f15637683c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:44.586263 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751372e6-f09a-404d-a079-10f15637683c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:44.597847 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2fdde-3a27-4b07-b9bb-118bd0348cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:44.598711 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2fdde-3a27-4b07-b9bb-118bd0348cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:44.599212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2fdde-3a27-4b07-b9bb-118bd0348cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:44.599585 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2fdde-3a27-4b07-b9bb-118bd0348cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:44.600657 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2fdde-3a27-4b07-b9bb-118bd0348cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:44.602413 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2fdde-3a27-4b07-b9bb-118bd0348cd7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:44.635579 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1049/2093] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:44.638911 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2fdde-3a27-4b07-b9bb-118bd0348cd7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:44.639602 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1045/2094] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:44 2022] POST /identity/v3/users => generated 292 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:44.645587 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751372e6-f09a-404d-a079-10f15637683c admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:44.669227 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2fdde-3a27-4b07-b9bb-118bd0348cd7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:44.675734 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751372e6-f09a-404d-a079-10f15637683c admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:44.683046 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda9885-f9d5-40c0-8cc9-eb5606722d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:44.685917 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52188618-7069-4195-a300-09ae6fd8b42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:44.686157 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda9885-f9d5-40c0-8cc9-eb5606722d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:44.686545 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda9885-f9d5-40c0-8cc9-eb5606722d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:44.687302 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52188618-7069-4195-a300-09ae6fd8b42e admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:44.687699 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda9885-f9d5-40c0-8cc9-eb5606722d88 admin admin] PATH_INFO: `/v3/projects/ef188ab798804cd88719062e8dc2fb97/users/636ff2a569c34dadadfd5d9d704fb7f9/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:44.689556 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52188618-7069-4195-a300-09ae6fd8b42e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:44.689941 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52188618-7069-4195-a300-09ae6fd8b42e admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:44.690965 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52188618-7069-4195-a300-09ae6fd8b42e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:44.693161 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52188618-7069-4195-a300-09ae6fd8b42e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:44.695351 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda9885-f9d5-40c0-8cc9-eb5606722d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef188ab798804cd88719062e8dc2fb97, user_id=636ff2a569c34dadadfd5d9d704fb7f9, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:44.699240 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda9885-f9d5-40c0-8cc9-eb5606722d88 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:44.719270 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1046/2095] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:44.727984 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52188618-7069-4195-a300-09ae6fd8b42e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:44.741217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1050/2096] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:44 2022] PUT /identity/v3/projects/ef188ab798804cd88719062e8dc2fb97/users/636ff2a569c34dadadfd5d9d704fb7f9/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:44.758483 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52188618-7069-4195-a300-09ae6fd8b42e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:44.825785 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:44.843538 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f35a9-a7d6-4699-be26-c4d71bdb51e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:44.845479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f35a9-a7d6-4699-be26-c4d71bdb51e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:44.845479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f35a9-a7d6-4699-be26-c4d71bdb51e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:44.845726 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f35a9-a7d6-4699-be26-c4d71bdb51e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:44.846731 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f35a9-a7d6-4699-be26-c4d71bdb51e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:44.850695 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f35a9-a7d6-4699-be26-c4d71bdb51e9 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:44.863188 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1047/2097] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:44.867814 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda9885-f9d5-40c0-8cc9-eb5606722d88 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:44.879999 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f35a9-a7d6-4699-be26-c4d71bdb51e9 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:44.884153 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f15f35a9-a7d6-4699-be26-c4d71bdb51e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:44.900323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda9885-f9d5-40c0-8cc9-eb5606722d88 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:44.910635 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1197f8d-f29b-4ff4-bda8-68740fff0e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:44.910635 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1197f8d-f29b-4ff4-bda8-68740fff0e51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:44.910979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1197f8d-f29b-4ff4-bda8-68740fff0e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:44.911617 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1197f8d-f29b-4ff4-bda8-68740fff0e51 admin admin] PATH_INFO: `/v3/projects/a9244f3ef2bf4bc891d0ff3384662e9b/users/5fc2803fed254f3b8a280df51891ec0b/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:44.918008 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f35a9-a7d6-4699-be26-c4d71bdb51e9 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:44.960033 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0afacfc-0ef5-467a-b4b6-e9cf3d905c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:44.961424 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1197f8d-f29b-4ff4-bda8-68740fff0e51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9244f3ef2bf4bc891d0ff3384662e9b, user_id=5fc2803fed254f3b8a280df51891ec0b, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:44.961626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afacfc-0ef5-467a-b4b6-e9cf3d905c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:44.961915 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afacfc-0ef5-467a-b4b6-e9cf3d905c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:44.963450 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afacfc-0ef5-467a-b4b6-e9cf3d905c07 admin admin] PATH_INFO: `/v3/projects/cbae1580ceaa47489ecdb0dca1c4a86c` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:44.964309 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1197f8d-f29b-4ff4-bda8-68740fff0e51 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:44.968369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0afacfc-0ef5-467a-b4b6-e9cf3d905c07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbae1580ceaa47489ecdb0dca1c4a86c)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:44.971997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0afacfc-0ef5-467a-b4b6-e9cf3d905c07 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:44.996526 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1051/2098] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:44 2022] PUT /identity/v3/projects/a9244f3ef2bf4bc891d0ff3384662e9b/users/5fc2803fed254f3b8a280df51891ec0b/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:44.997409 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1197f8d-f29b-4ff4-bda8-68740fff0e51 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:45.007155 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d1197f8d-f29b-4ff4-bda8-68740fff0e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:45.081332 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f0afacfc-0ef5-467a-b4b6-e9cf3d905c07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbae1580ceaa47489ecdb0dca1c4a86c', 'request_id': 'req-f0afacfc-0ef5-467a-b4b6-e9cf3d905c07'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:45.089069 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f0afacfc-0ef5-467a-b4b6-e9cf3d905c07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbae1580ceaa47489ecdb0dca1c4a86c', 'request_id': 'req-f0afacfc-0ef5-467a-b4b6-e9cf3d905c07'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:45.099384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f0afacfc-0ef5-467a-b4b6-e9cf3d905c07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbae1580ceaa47489ecdb0dca1c4a86c', 'request_id': 'req-f0afacfc-0ef5-467a-b4b6-e9cf3d905c07'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:45.110899 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1197f8d-f29b-4ff4-bda8-68740fff0e51 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:45.129922 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f0afacfc-0ef5-467a-b4b6-e9cf3d905c07 admin admin] The token cache is being invalidate because project cbae1580ceaa47489ecdb0dca1c4a86c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:45.130375 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f0afacfc-0ef5-467a-b4b6-e9cf3d905c07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:45.131222 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f0afacfc-0ef5-467a-b4b6-e9cf3d905c07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:45.133582 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1048/2099] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:44 2022] DELETE /identity/v3/projects/cbae1580ceaa47489ecdb0dca1c4a86c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:45.134478 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0afacfc-0ef5-467a-b4b6-e9cf3d905c07 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:45.135806 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f0afacfc-0ef5-467a-b4b6-e9cf3d905c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:45.148900 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:45.210233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e38ef-374b-4b9a-9a86-66cd7eb839b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:45.211124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e38ef-374b-4b9a-9a86-66cd7eb839b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:45.211408 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e38ef-374b-4b9a-9a86-66cd7eb839b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:45.211682 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e38ef-374b-4b9a-9a86-66cd7eb839b4 admin admin] PATH_INFO: `/v3/projects/605aa1b486a8401a90578877b1ad6503` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:45.213306 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e38ef-374b-4b9a-9a86-66cd7eb839b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=605aa1b486a8401a90578877b1ad6503)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:45.215295 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e38ef-374b-4b9a-9a86-66cd7eb839b4 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:45.231923 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0afacfc-0ef5-467a-b4b6-e9cf3d905c07 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:45.238804 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9586b-b44b-43e8-b88b-398a2fd35947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:45.240293 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9586b-b44b-43e8-b88b-398a2fd35947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:45.240769 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9586b-b44b-43e8-b88b-398a2fd35947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:45.241156 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9586b-b44b-43e8-b88b-398a2fd35947 admin admin] PATH_INFO: `/v3/projects/c5dae97ba944458da46dc38dfdd1a896` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:45.243214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9586b-b44b-43e8-b88b-398a2fd35947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5dae97ba944458da46dc38dfdd1a896)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:45.245908 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9586b-b44b-43e8-b88b-398a2fd35947 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:45.303863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ae2e38ef-374b-4b9a-9a86-66cd7eb839b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '605aa1b486a8401a90578877b1ad6503', 'request_id': 'req-ae2e38ef-374b-4b9a-9a86-66cd7eb839b4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:45.316157 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ae2e38ef-374b-4b9a-9a86-66cd7eb839b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '605aa1b486a8401a90578877b1ad6503', 'request_id': 'req-ae2e38ef-374b-4b9a-9a86-66cd7eb839b4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:45.326022 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ae2e38ef-374b-4b9a-9a86-66cd7eb839b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '605aa1b486a8401a90578877b1ad6503', 'request_id': 'req-ae2e38ef-374b-4b9a-9a86-66cd7eb839b4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:45.328311 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5db9586b-b44b-43e8-b88b-398a2fd35947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5dae97ba944458da46dc38dfdd1a896', 'request_id': 'req-5db9586b-b44b-43e8-b88b-398a2fd35947'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:45.335806 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5db9586b-b44b-43e8-b88b-398a2fd35947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5dae97ba944458da46dc38dfdd1a896', 'request_id': 'req-5db9586b-b44b-43e8-b88b-398a2fd35947'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:45.343222 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ae2e38ef-374b-4b9a-9a86-66cd7eb839b4 admin admin] The token cache is being invalidate because project 605aa1b486a8401a90578877b1ad6503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:45.343519 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ae2e38ef-374b-4b9a-9a86-66cd7eb839b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:45.344503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ae2e38ef-374b-4b9a-9a86-66cd7eb839b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:45.346851 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1052/2100] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:44 2022] DELETE /identity/v3/projects/605aa1b486a8401a90578877b1ad6503 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:45.348500 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a2582-1c06-494b-a360-cab5406cfd2d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:45.348791 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a2582-1c06-494b-a360-cab5406cfd2d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:45.349065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a2582-1c06-494b-a360-cab5406cfd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:45.366621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5db9586b-b44b-43e8-b88b-398a2fd35947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5dae97ba944458da46dc38dfdd1a896', 'request_id': 'req-5db9586b-b44b-43e8-b88b-398a2fd35947'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:45.382012 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:45.392017 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5db9586b-b44b-43e8-b88b-398a2fd35947 admin admin] The token cache is being invalidate because project c5dae97ba944458da46dc38dfdd1a896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:45.392394 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5db9586b-b44b-43e8-b88b-398a2fd35947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:45.395588 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5db9586b-b44b-43e8-b88b-398a2fd35947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:45.398891 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1049/2101] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:45 2022] DELETE /identity/v3/projects/c5dae97ba944458da46dc38dfdd1a896 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:45.401433 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146c5a4-963b-4d1b-92c2-9c2e29f2d6ea None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:45.403889 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146c5a4-963b-4d1b-92c2-9c2e29f2d6ea None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:45.404235 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146c5a4-963b-4d1b-92c2-9c2e29f2d6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:45.413441 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a79a2582-1c06-494b-a360-cab5406cfd2d None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:45.415036 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a79a2582-1c06-494b-a360-cab5406cfd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:45.478473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-d146c5a4-963b-4d1b-92c2-9c2e29f2d6ea None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:45.480377 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d146c5a4-963b-4d1b-92c2-9c2e29f2d6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:45.635721 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1053/2102] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:45.658152 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a2582-1c06-494b-a360-cab5406cfd2d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:45.663599 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1050/2103] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:45.666539 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a79a2582-1c06-494b-a360-cab5406cfd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:45.671352 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5f31d-2f27-4eaf-833e-867da358ac6d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:45.671924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5f31d-2f27-4eaf-833e-867da358ac6d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:45.673129 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5f31d-2f27-4eaf-833e-867da358ac6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:45.711075 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-aca5f31d-2f27-4eaf-833e-867da358ac6d None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:45.712358 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-aca5f31d-2f27-4eaf-833e-867da358ac6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:45.722468 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1051/2104] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:07:45.727037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5f31d-2f27-4eaf-833e-867da358ac6d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:45.739954 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5f31d-2f27-4eaf-833e-867da358ac6d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:45.744910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0dc6c-3fe2-4ec6-91f5-5b50280605bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:45.745582 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0dc6c-3fe2-4ec6-91f5-5b50280605bf admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:45.746088 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0dc6c-3fe2-4ec6-91f5-5b50280605bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:45.746088 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0dc6c-3fe2-4ec6-91f5-5b50280605bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:45.747011 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0dc6c-3fe2-4ec6-91f5-5b50280605bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:07:45.747323 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0dc6c-3fe2-4ec6-91f5-5b50280605bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:45.748966 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0dc6c-3fe2-4ec6-91f5-5b50280605bf admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:45.766688 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1052/2105] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:07:45.769061 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0dc6c-3fe2-4ec6-91f5-5b50280605bf admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:45.776692 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a2582-1c06-494b-a360-cab5406cfd2d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:45.782114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b454a3c-2cb3-4f6d-97ae-f95edf0aa683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:45.782789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b454a3c-2cb3-4f6d-97ae-f95edf0aa683 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:45.783070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b454a3c-2cb3-4f6d-97ae-f95edf0aa683 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:45.783488 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b454a3c-2cb3-4f6d-97ae-f95edf0aa683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:45.784857 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0dc6c-3fe2-4ec6-91f5-5b50280605bf admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:45.794322 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b454a3c-2cb3-4f6d-97ae-f95edf0aa683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:45.796002 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b454a3c-2cb3-4f6d-97ae-f95edf0aa683 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:45.797802 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20799a2d-f109-4c11-bee6-288535489b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:45.800122 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20799a2d-f109-4c11-bee6-288535489b27 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:45.800769 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:45.801320 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20799a2d-f109-4c11-bee6-288535489b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:45.802718 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20799a2d-f109-4c11-bee6-288535489b27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:45.804550 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20799a2d-f109-4c11-bee6-288535489b27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:45.808731 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1054/2106] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:07:45.809542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20799a2d-f109-4c11-bee6-288535489b27 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:45.863515 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1053/2107] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:45 2022] POST /identity/v3/projects => generated 367 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:07:45.865469 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b454a3c-2cb3-4f6d-97ae-f95edf0aa683 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:45.884339 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b454a3c-2cb3-4f6d-97ae-f95edf0aa683 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:45.903693 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70273ef2-4a61-443c-9247-15970ad854fc None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:45.904017 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70273ef2-4a61-443c-9247-15970ad854fc None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:45.904390 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70273ef2-4a61-443c-9247-15970ad854fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:45.940235 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-70273ef2-4a61-443c-9247-15970ad854fc None None] MFA Rules not processed for user `636ff2a569c34dadadfd5d9d704fb7f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:45.942003 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-70273ef2-4a61-443c-9247-15970ad854fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:45.965356 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2701dc-f673-4412-96c6-a36e4f0c1d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:45.966044 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2701dc-f673-4412-96c6-a36e4f0c1d7e admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:45.966325 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2701dc-f673-4412-96c6-a36e4f0c1d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:45.966604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2701dc-f673-4412-96c6-a36e4f0c1d7e admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:45.967643 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2701dc-f673-4412-96c6-a36e4f0c1d7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:45.970445 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2701dc-f673-4412-96c6-a36e4f0c1d7e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:45.999306 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1055/2108] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:45 2022] POST /identity/v3/users => generated 284 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:46.003557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2701dc-f673-4412-96c6-a36e4f0c1d7e admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:46.027539 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2701dc-f673-4412-96c6-a36e4f0c1d7e admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:46.037042 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b96f1-0b60-4f52-8c18-e1f2ce0006f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:46.038008 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b96f1-0b60-4f52-8c18-e1f2ce0006f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:46.038870 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b96f1-0b60-4f52-8c18-e1f2ce0006f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:46.039445 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b96f1-0b60-4f52-8c18-e1f2ce0006f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:46.040697 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b96f1-0b60-4f52-8c18-e1f2ce0006f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:46.042495 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b96f1-0b60-4f52-8c18-e1f2ce0006f7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:46.052862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1054/2109] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:46.054717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15744f-ead9-4750-9ce8-c45773fb9734 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:46.055070 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15744f-ead9-4750-9ce8-c45773fb9734 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:46.055490 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15744f-ead9-4750-9ce8-c45773fb9734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:46.059563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1056/2110] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:46.065218 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b96f1-0b60-4f52-8c18-e1f2ce0006f7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:46.076510 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-ae15744f-ead9-4750-9ce8-c45773fb9734 None None] MFA Rules not processed for user `18dad23d295e4d2797889a99114373e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:46.077872 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ae15744f-ead9-4750-9ce8-c45773fb9734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:46.079326 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b96f1-0b60-4f52-8c18-e1f2ce0006f7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:46.092378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67703b0a-b0b9-436a-83d9-de9ab16344f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:46.095397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67703b0a-b0b9-436a-83d9-de9ab16344f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:46.095669 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67703b0a-b0b9-436a-83d9-de9ab16344f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:46.095953 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67703b0a-b0b9-436a-83d9-de9ab16344f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:46.097326 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67703b0a-b0b9-436a-83d9-de9ab16344f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:46.098404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67703b0a-b0b9-436a-83d9-de9ab16344f8 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:46.114557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1057/2111] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:07:46.118785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67703b0a-b0b9-436a-83d9-de9ab16344f8 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:46.140131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67703b0a-b0b9-436a-83d9-de9ab16344f8 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:46.147800 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:46.151429 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a0f69-a631-4de2-bcd3-8032e2e7c9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:46.152905 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a0f69-a631-4de2-bcd3-8032e2e7c9c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:46.152905 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a0f69-a631-4de2-bcd3-8032e2e7c9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:46.153732 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a0f69-a631-4de2-bcd3-8032e2e7c9c7 admin admin] PATH_INFO: `/v3/projects/cac587d9e5834d2dbfd56115dde749e2/users/a6c25ccc7d524ff9945892b98be82354/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:46.179651 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1055/2112] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:46.189658 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15744f-ead9-4750-9ce8-c45773fb9734 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:46.190811 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a0f69-a631-4de2-bcd3-8032e2e7c9c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cac587d9e5834d2dbfd56115dde749e2, user_id=a6c25ccc7d524ff9945892b98be82354, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:46.191463 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ae15744f-ead9-4750-9ce8-c45773fb9734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:46.193798 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a0f69-a631-4de2-bcd3-8032e2e7c9c7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:46.212566 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1058/2113] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:46 2022] PUT /identity/v3/projects/cac587d9e5834d2dbfd56115dde749e2/users/a6c25ccc7d524ff9945892b98be82354/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:07:46.227419 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eeace5-4a07-44f0-8b4a-27ad1bbe41d0 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:46.227867 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eeace5-4a07-44f0-8b4a-27ad1bbe41d0 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:46.228549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eeace5-4a07-44f0-8b4a-27ad1bbe41d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:46.262885 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-89eeace5-4a07-44f0-8b4a-27ad1bbe41d0 None None] MFA Rules not processed for user `a6c25ccc7d524ff9945892b98be82354`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:46.264225 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-89eeace5-4a07-44f0-8b4a-27ad1bbe41d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:46.293066 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15744f-ead9-4750-9ce8-c45773fb9734 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:46.377312 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1059/2114] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:46.382494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eeace5-4a07-44f0-8b4a-27ad1bbe41d0 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:46.387965 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d386c3-4b3e-4f43-84f0-4185badec876 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:46.388746 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d386c3-4b3e-4f43-84f0-4185badec876 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:46.389109 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d386c3-4b3e-4f43-84f0-4185badec876 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:46.389599 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d386c3-4b3e-4f43-84f0-4185badec876 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:46.394655 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-19d386c3-4b3e-4f43-84f0-4185badec876 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:46.424885 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:46.462620 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eeace5-4a07-44f0-8b4a-27ad1bbe41d0 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:46.467457 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3dd51-899c-48d8-867a-3966f36bafc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:46.468140 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3dd51-899c-48d8-867a-3966f36bafc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:46.468614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3dd51-899c-48d8-867a-3966f36bafc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:46.468784 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3dd51-899c-48d8-867a-3966f36bafc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:46.469615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3dd51-899c-48d8-867a-3966f36bafc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:46.472185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3dd51-899c-48d8-867a-3966f36bafc5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:46.474725 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d386c3-4b3e-4f43-84f0-4185badec876 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:46.476957 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d386c3-4b3e-4f43-84f0-4185badec876 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:46.487954 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1056/2115] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:07:46.503890 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1060/2116] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:46 2022] POST /identity/v3/projects => generated 367 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:46.508734 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d386c3-4b3e-4f43-84f0-4185badec876 service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:46.521864 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d386c3-4b3e-4f43-84f0-4185badec876 service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:46.552989 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:46.593397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf572db-dc34-4682-8402-fb86ed5800fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:46.594823 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf572db-dc34-4682-8402-fb86ed5800fa admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:46.595414 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf572db-dc34-4682-8402-fb86ed5800fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:46.595936 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf572db-dc34-4682-8402-fb86ed5800fa admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:46.596936 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf572db-dc34-4682-8402-fb86ed5800fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:46.598983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf572db-dc34-4682-8402-fb86ed5800fa admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:46.623530 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1057/2117] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:46 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:46.627932 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3dd51-899c-48d8-867a-3966f36bafc5 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:46.638757 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3dd51-899c-48d8-867a-3966f36bafc5 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:46.643572 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110e6e3-5d6c-44ea-865a-b751ce0cd90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:46.644247 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110e6e3-5d6c-44ea-865a-b751ce0cd90a admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:46.644575 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110e6e3-5d6c-44ea-865a-b751ce0cd90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:46.644852 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110e6e3-5d6c-44ea-865a-b751ce0cd90a admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:46.645585 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110e6e3-5d6c-44ea-865a-b751ce0cd90a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:46.647205 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110e6e3-5d6c-44ea-865a-b751ce0cd90a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:46.662870 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1061/2118] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:46.664081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf572db-dc34-4682-8402-fb86ed5800fa admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:46.675054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf572db-dc34-4682-8402-fb86ed5800fa admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:46.680290 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0734d2f-67f6-4b44-aada-0105f906952c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:46.681111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0734d2f-67f6-4b44-aada-0105f906952c admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:46.681874 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0734d2f-67f6-4b44-aada-0105f906952c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:46.681874 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0734d2f-67f6-4b44-aada-0105f906952c admin admin] PATH_INFO: `/v3/projects/1a8e888193fa4c97a0ff543dc9c7a81a/users/d00909aef3b943cbabe7d7eae4ec25ea/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:46.698856 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0734d2f-67f6-4b44-aada-0105f906952c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a8e888193fa4c97a0ff543dc9c7a81a, user_id=d00909aef3b943cbabe7d7eae4ec25ea, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:46.702180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0734d2f-67f6-4b44-aada-0105f906952c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:46.724591 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1058/2119] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:46 2022] PUT /identity/v3/projects/1a8e888193fa4c97a0ff543dc9c7a81a/users/d00909aef3b943cbabe7d7eae4ec25ea/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:46.728631 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110e6e3-5d6c-44ea-865a-b751ce0cd90a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:46.741482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110e6e3-5d6c-44ea-865a-b751ce0cd90a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:46.818807 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b8ef6-28d7-4f39-a28d-6e202b58a58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:46.819724 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b8ef6-28d7-4f39-a28d-6e202b58a58b admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:46.820014 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b8ef6-28d7-4f39-a28d-6e202b58a58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:46.820290 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b8ef6-28d7-4f39-a28d-6e202b58a58b admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:46.821129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b8ef6-28d7-4f39-a28d-6e202b58a58b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:46.822754 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b8ef6-28d7-4f39-a28d-6e202b58a58b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:46.838566 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1062/2120] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:46.842498 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0734d2f-67f6-4b44-aada-0105f906952c admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:46.854615 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0734d2f-67f6-4b44-aada-0105f906952c admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:46.880014 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4608e-b0ea-4b17-ab4d-2b132dd1cfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:46.881181 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4608e-b0ea-4b17-ab4d-2b132dd1cfa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:46.881637 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4608e-b0ea-4b17-ab4d-2b132dd1cfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:46.882107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4608e-b0ea-4b17-ab4d-2b132dd1cfa5 admin admin] PATH_INFO: `/v3/projects/1a8e888193fa4c97a0ff543dc9c7a81a/users/d00909aef3b943cbabe7d7eae4ec25ea/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:46.890638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4608e-b0ea-4b17-ab4d-2b132dd1cfa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a8e888193fa4c97a0ff543dc9c7a81a, user_id=d00909aef3b943cbabe7d7eae4ec25ea, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:46.894191 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4608e-b0ea-4b17-ab4d-2b132dd1cfa5 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:46.920189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1059/2121] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:46 2022] PUT /identity/v3/projects/1a8e888193fa4c97a0ff543dc9c7a81a/users/d00909aef3b943cbabe7d7eae4ec25ea/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:46.931405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80388b24-4743-4b21-a889-698e4f2cb91d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:46.931738 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80388b24-4743-4b21-a889-698e4f2cb91d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:46.932029 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80388b24-4743-4b21-a889-698e4f2cb91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:46.974121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-80388b24-4743-4b21-a889-698e4f2cb91d None None] MFA Rules not processed for user `d00909aef3b943cbabe7d7eae4ec25ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:46.975368 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-80388b24-4743-4b21-a889-698e4f2cb91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:47.111892 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1063/2122] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:46 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:47.131466 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4608e-b0ea-4b17-ab4d-2b132dd1cfa5 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:47.134629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8fd4608e-b0ea-4b17-ab4d-2b132dd1cfa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:47.247000 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4608e-b0ea-4b17-ab4d-2b132dd1cfa5 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:47.254011 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496a193-d094-42e8-a5f2-57afeff1d445 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:47.255113 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496a193-d094-42e8-a5f2-57afeff1d445 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:47.255623 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496a193-d094-42e8-a5f2-57afeff1d445 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:47.256142 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496a193-d094-42e8-a5f2-57afeff1d445 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:47.274919 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496a193-d094-42e8-a5f2-57afeff1d445 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:47.278115 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496a193-d094-42e8-a5f2-57afeff1d445 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:47.310877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1060/2123] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:47 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:07:49.269213 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80388b24-4743-4b21-a889-698e4f2cb91d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:49.319179 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:49.364008 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80388b24-4743-4b21-a889-698e4f2cb91d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:49.375193 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bd9a9-b9cb-4b8c-8978-eb82de9d0046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:49.376828 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bd9a9-b9cb-4b8c-8978-eb82de9d0046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:49.377114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bd9a9-b9cb-4b8c-8978-eb82de9d0046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:49.377696 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bd9a9-b9cb-4b8c-8978-eb82de9d0046 admin admin] PATH_INFO: `/v3/users/a6c25ccc7d524ff9945892b98be82354` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:49.379543 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bd9a9-b9cb-4b8c-8978-eb82de9d0046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6c25ccc7d524ff9945892b98be82354)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:49.381628 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bd9a9-b9cb-4b8c-8978-eb82de9d0046 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:49.450065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-198bd9a9-b9cb-4b8c-8978-eb82de9d0046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6c25ccc7d524ff9945892b98be82354'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:49.458409 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-198bd9a9-b9cb-4b8c-8978-eb82de9d0046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6c25ccc7d524ff9945892b98be82354'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:49.459260 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-198bd9a9-b9cb-4b8c-8978-eb82de9d0046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6c25ccc7d524ff9945892b98be82354'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:49.478679 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-198bd9a9-b9cb-4b8c-8978-eb82de9d0046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6c25ccc7d524ff9945892b98be82354'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:49.489781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-198bd9a9-b9cb-4b8c-8978-eb82de9d0046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6c25ccc7d524ff9945892b98be82354'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:49.497831 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1064/2124] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:49 2022] DELETE /identity/v3/users/a6c25ccc7d524ff9945892b98be82354 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:07:49.503742 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be653d2-3b85-4f0f-83e9-36f53cf77d0c None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:49.504265 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be653d2-3b85-4f0f-83e9-36f53cf77d0c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:49.504373 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be653d2-3b85-4f0f-83e9-36f53cf77d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:49.534158 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1be653d2-3b85-4f0f-83e9-36f53cf77d0c None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:49.535396 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1be653d2-3b85-4f0f-83e9-36f53cf77d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:49.634333 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1061/2125] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:49.645432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bd9a9-b9cb-4b8c-8978-eb82de9d0046 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:49.646928 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-198bd9a9-b9cb-4b8c-8978-eb82de9d0046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:49.723484 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bd9a9-b9cb-4b8c-8978-eb82de9d0046 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:49.727815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32508e1-2645-4997-b7a5-9cee8af00e18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:49.728535 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32508e1-2645-4997-b7a5-9cee8af00e18 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:49.728829 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32508e1-2645-4997-b7a5-9cee8af00e18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:49.729113 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32508e1-2645-4997-b7a5-9cee8af00e18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:49.743034 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32508e1-2645-4997-b7a5-9cee8af00e18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:49.744055 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32508e1-2645-4997-b7a5-9cee8af00e18 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:49.757693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1065/2126] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:50.122657 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be653d2-3b85-4f0f-83e9-36f53cf77d0c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:50.124869 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1be653d2-3b85-4f0f-83e9-36f53cf77d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:50.142161 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be653d2-3b85-4f0f-83e9-36f53cf77d0c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:50.147781 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218baefa-b99e-497f-8a16-6787f069125e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:50.149166 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218baefa-b99e-497f-8a16-6787f069125e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:50.149679 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218baefa-b99e-497f-8a16-6787f069125e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:50.150158 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218baefa-b99e-497f-8a16-6787f069125e admin admin] PATH_INFO: `/v3/projects/cac587d9e5834d2dbfd56115dde749e2` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:50.151842 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218baefa-b99e-497f-8a16-6787f069125e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cac587d9e5834d2dbfd56115dde749e2)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:50.154032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218baefa-b99e-497f-8a16-6787f069125e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:50.176631 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:50.225325 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-218baefa-b99e-497f-8a16-6787f069125e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cac587d9e5834d2dbfd56115dde749e2', 'request_id': 'req-218baefa-b99e-497f-8a16-6787f069125e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:50.251993 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-218baefa-b99e-497f-8a16-6787f069125e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cac587d9e5834d2dbfd56115dde749e2', 'request_id': 'req-218baefa-b99e-497f-8a16-6787f069125e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:50.263908 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-218baefa-b99e-497f-8a16-6787f069125e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cac587d9e5834d2dbfd56115dde749e2', 'request_id': 'req-218baefa-b99e-497f-8a16-6787f069125e'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:50.278283 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-218baefa-b99e-497f-8a16-6787f069125e admin admin] The token cache is being invalidate because project cac587d9e5834d2dbfd56115dde749e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:50.285754 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-218baefa-b99e-497f-8a16-6787f069125e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:50.286577 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-218baefa-b99e-497f-8a16-6787f069125e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:50.288651 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1062/2127] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:50 2022] DELETE /identity/v3/projects/cac587d9e5834d2dbfd56115dde749e2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:50.292763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32508e1-2645-4997-b7a5-9cee8af00e18 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:50.305349 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32508e1-2645-4997-b7a5-9cee8af00e18 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:50.371469 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:50.398113 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49698f87-c6bd-44d9-8b4f-c54fc3865829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:50.399025 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49698f87-c6bd-44d9-8b4f-c54fc3865829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:50.399308 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49698f87-c6bd-44d9-8b4f-c54fc3865829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:50.399583 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49698f87-c6bd-44d9-8b4f-c54fc3865829 admin admin] PATH_INFO: `/v3/users/d00909aef3b943cbabe7d7eae4ec25ea` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:50.401047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49698f87-c6bd-44d9-8b4f-c54fc3865829 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d00909aef3b943cbabe7d7eae4ec25ea)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:50.403159 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49698f87-c6bd-44d9-8b4f-c54fc3865829 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:50.475391 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-49698f87-c6bd-44d9-8b4f-c54fc3865829 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd00909aef3b943cbabe7d7eae4ec25ea'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:50.485116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-49698f87-c6bd-44d9-8b4f-c54fc3865829 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd00909aef3b943cbabe7d7eae4ec25ea'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:50.488958 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-49698f87-c6bd-44d9-8b4f-c54fc3865829 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd00909aef3b943cbabe7d7eae4ec25ea'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:50.509006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-49698f87-c6bd-44d9-8b4f-c54fc3865829 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd00909aef3b943cbabe7d7eae4ec25ea'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:50.520731 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-49698f87-c6bd-44d9-8b4f-c54fc3865829 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd00909aef3b943cbabe7d7eae4ec25ea'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:50.532627 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1066/2128] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:50 2022] DELETE /identity/v3/users/d00909aef3b943cbabe7d7eae4ec25ea => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:50.886141 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218baefa-b99e-497f-8a16-6787f069125e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:50.888306 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-218baefa-b99e-497f-8a16-6787f069125e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:50.916441 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218baefa-b99e-497f-8a16-6787f069125e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:51.003525 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015e055-a146-44ab-981b-f795f79105b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:51.004447 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015e055-a146-44ab-981b-f795f79105b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:51.004739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015e055-a146-44ab-981b-f795f79105b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:51.005016 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015e055-a146-44ab-981b-f795f79105b2 admin admin] PATH_INFO: `/v3/projects/1a8e888193fa4c97a0ff543dc9c7a81a` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:51.006997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015e055-a146-44ab-981b-f795f79105b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a8e888193fa4c97a0ff543dc9c7a81a)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:51.009638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015e055-a146-44ab-981b-f795f79105b2 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:51.097583 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6015e055-a146-44ab-981b-f795f79105b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a8e888193fa4c97a0ff543dc9c7a81a', 'request_id': 'req-6015e055-a146-44ab-981b-f795f79105b2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:51.117434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6015e055-a146-44ab-981b-f795f79105b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a8e888193fa4c97a0ff543dc9c7a81a', 'request_id': 'req-6015e055-a146-44ab-981b-f795f79105b2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:51.136807 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6015e055-a146-44ab-981b-f795f79105b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a8e888193fa4c97a0ff543dc9c7a81a', 'request_id': 'req-6015e055-a146-44ab-981b-f795f79105b2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:51.149792 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6015e055-a146-44ab-981b-f795f79105b2 admin admin] The token cache is being invalidate because project 1a8e888193fa4c97a0ff543dc9c7a81a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:51.150210 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6015e055-a146-44ab-981b-f795f79105b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:51.150982 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6015e055-a146-44ab-981b-f795f79105b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:51.152909 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1063/2129] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:50 2022] DELETE /identity/v3/projects/1a8e888193fa4c97a0ff543dc9c7a81a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:51.158397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203d49c-38d2-4200-b084-bfb7361ce76d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:51.158702 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203d49c-38d2-4200-b084-bfb7361ce76d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:51.158983 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203d49c-38d2-4200-b084-bfb7361ce76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:51.181186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e203d49c-38d2-4200-b084-bfb7361ce76d None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:51.182724 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e203d49c-38d2-4200-b084-bfb7361ce76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:51.255628 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1067/2130] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:51.263307 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f7519-3f10-499c-b604-06d0235bccf1 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:51.263591 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f7519-3f10-499c-b604-06d0235bccf1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:51.263895 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f7519-3f10-499c-b604-06d0235bccf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:51.286092 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-408f7519-3f10-499c-b604-06d0235bccf1 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:51.287523 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-408f7519-3f10-499c-b604-06d0235bccf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:51.300642 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1064/2131] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:51.302988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203d49c-38d2-4200-b084-bfb7361ce76d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:51.316863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203d49c-38d2-4200-b084-bfb7361ce76d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:51.322460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0f20f-2870-4f7a-a563-6c04ccca92ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:51.323282 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0f20f-2870-4f7a-a563-6c04ccca92ba admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:51.323628 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0f20f-2870-4f7a-a563-6c04ccca92ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:51.323993 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0f20f-2870-4f7a-a563-6c04ccca92ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:51.324907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0f20f-2870-4f7a-a563-6c04ccca92ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:07:51.325280 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0f20f-2870-4f7a-a563-6c04ccca92ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:51.327324 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0f20f-2870-4f7a-a563-6c04ccca92ba admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:51.356069 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1068/2132] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 22:07:51.360569 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f7519-3f10-499c-b604-06d0235bccf1 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:51.385200 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f7519-3f10-499c-b604-06d0235bccf1 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:51.392123 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29324e1-b9f3-4a0b-8b83-51c1f7c964c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:51.393626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29324e1-b9f3-4a0b-8b83-51c1f7c964c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:51.393927 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29324e1-b9f3-4a0b-8b83-51c1f7c964c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:51.394215 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29324e1-b9f3-4a0b-8b83-51c1f7c964c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:51.394963 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29324e1-b9f3-4a0b-8b83-51c1f7c964c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:51.397008 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29324e1-b9f3-4a0b-8b83-51c1f7c964c4 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:51.457326 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1065/2133] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:51 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:51.461366 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0f20f-2870-4f7a-a563-6c04ccca92ba admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:51.473921 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0f20f-2870-4f7a-a563-6c04ccca92ba admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:51.554227 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:51.569012 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89975393-dc22-4641-b12d-3637526a0b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:51.570028 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89975393-dc22-4641-b12d-3637526a0b27 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:51.570570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89975393-dc22-4641-b12d-3637526a0b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:51.571125 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89975393-dc22-4641-b12d-3637526a0b27 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:51.571941 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89975393-dc22-4641-b12d-3637526a0b27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:51.574663 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89975393-dc22-4641-b12d-3637526a0b27 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:51.600694 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1069/2134] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:51 2022] POST /identity/v3/users => generated 291 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:07:51.604011 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29324e1-b9f3-4a0b-8b83-51c1f7c964c4 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:51.612112 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:51.619170 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29324e1-b9f3-4a0b-8b83-51c1f7c964c4 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:51.635219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53480d-8215-4486-84d7-d9447633f674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:51.635728 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53480d-8215-4486-84d7-d9447633f674 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:51.636016 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53480d-8215-4486-84d7-d9447633f674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:51.636296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53480d-8215-4486-84d7-d9447633f674 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:51.638026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53480d-8215-4486-84d7-d9447633f674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:51.642164 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53480d-8215-4486-84d7-d9447633f674 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:51.667280 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1066/2135] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:51.671090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89975393-dc22-4641-b12d-3637526a0b27 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:51.683378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89975393-dc22-4641-b12d-3637526a0b27 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:51.691444 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57bf002-5824-4431-ae56-79fa2a807909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:51.692269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bf002-5824-4431-ae56-79fa2a807909 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:51.692736 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bf002-5824-4431-ae56-79fa2a807909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:51.693118 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bf002-5824-4431-ae56-79fa2a807909 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:51.693990 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57bf002-5824-4431-ae56-79fa2a807909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:51.695776 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57bf002-5824-4431-ae56-79fa2a807909 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:51.711068 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1070/2136] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:51.715732 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53480d-8215-4486-84d7-d9447633f674 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:51.730019 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53480d-8215-4486-84d7-d9447633f674 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:51.735323 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca30d96-8b30-4e06-ac42-078e9cf1e454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:51.736379 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca30d96-8b30-4e06-ac42-078e9cf1e454 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:51.736794 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca30d96-8b30-4e06-ac42-078e9cf1e454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:51.737164 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca30d96-8b30-4e06-ac42-078e9cf1e454 admin admin] PATH_INFO: `/v3/projects/54d3e11f1c8d4f37b73cd9aa7a166625/users/02d36d01633245a0a23dc9725e66549c/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:51.756998 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca30d96-8b30-4e06-ac42-078e9cf1e454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d3e11f1c8d4f37b73cd9aa7a166625, user_id=02d36d01633245a0a23dc9725e66549c, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:51.760031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca30d96-8b30-4e06-ac42-078e9cf1e454 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:51.784523 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1067/2137] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:51 2022] PUT /identity/v3/projects/54d3e11f1c8d4f37b73cd9aa7a166625/users/02d36d01633245a0a23dc9725e66549c/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:51.793949 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf82a77-3bf8-4852-92e9-ef6ac4d5f1cf None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:51.794242 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf82a77-3bf8-4852-92e9-ef6ac4d5f1cf None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:51.794558 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf82a77-3bf8-4852-92e9-ef6ac4d5f1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:51.831343 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-edf82a77-3bf8-4852-92e9-ef6ac4d5f1cf None None] MFA Rules not processed for user `02d36d01633245a0a23dc9725e66549c`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:51.832853 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-edf82a77-3bf8-4852-92e9-ef6ac4d5f1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:51.941041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1071/2138] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:51.943091 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca30d96-8b30-4e06-ac42-078e9cf1e454 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:52.021707 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca30d96-8b30-4e06-ac42-078e9cf1e454 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:52.027009 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a76f1c-371a-4efb-a84b-3c2757ea52a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:52.028034 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a76f1c-371a-4efb-a84b-3c2757ea52a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:52.028591 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a76f1c-371a-4efb-a84b-3c2757ea52a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:52.029203 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a76f1c-371a-4efb-a84b-3c2757ea52a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:52.030128 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a76f1c-371a-4efb-a84b-3c2757ea52a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:52.033377 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a76f1c-371a-4efb-a84b-3c2757ea52a6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:52.076586 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1068/2139] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:51 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:52.078819 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf82a77-3bf8-4852-92e9-ef6ac4d5f1cf None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:52.092136 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf82a77-3bf8-4852-92e9-ef6ac4d5f1cf None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:52.181796 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91baefd1-3ad9-4a39-b5b3-b571e248e67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:52.182530 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91baefd1-3ad9-4a39-b5b3-b571e248e67b admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:52.182870 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91baefd1-3ad9-4a39-b5b3-b571e248e67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:52.183081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91baefd1-3ad9-4a39-b5b3-b571e248e67b admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:52.183799 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91baefd1-3ad9-4a39-b5b3-b571e248e67b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:52.185849 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91baefd1-3ad9-4a39-b5b3-b571e248e67b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:52.232048 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1072/2140] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:52 2022] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:07:52.233017 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a76f1c-371a-4efb-a84b-3c2757ea52a6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:52.249165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a76f1c-371a-4efb-a84b-3c2757ea52a6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:52.256025 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ff7ae-f52a-4f89-b8a5-4f3f3ecc67af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:52.256771 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ff7ae-f52a-4f89-b8a5-4f3f3ecc67af admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:52.257057 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ff7ae-f52a-4f89-b8a5-4f3f3ecc67af admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:52.257334 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ff7ae-f52a-4f89-b8a5-4f3f3ecc67af admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:52.258077 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ff7ae-f52a-4f89-b8a5-4f3f3ecc67af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:52.260344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ff7ae-f52a-4f89-b8a5-4f3f3ecc67af admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:52.276469 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1069/2141] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:52.288328 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91baefd1-3ad9-4a39-b5b3-b571e248e67b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:52.307307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91baefd1-3ad9-4a39-b5b3-b571e248e67b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:52.318884 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3cf26e-2d57-4a38-a51f-732e62216c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:52.319943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cf26e-2d57-4a38-a51f-732e62216c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:52.320267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cf26e-2d57-4a38-a51f-732e62216c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:52.320657 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cf26e-2d57-4a38-a51f-732e62216c41 admin admin] PATH_INFO: `/v3/projects/0f5697f719a14d43901b21860ef90095/users/5e7ad15d5f9b47c69c523b198a0b00ee/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:52.364317 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3cf26e-2d57-4a38-a51f-732e62216c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f5697f719a14d43901b21860ef90095, user_id=5e7ad15d5f9b47c69c523b198a0b00ee, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:52.367396 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3cf26e-2d57-4a38-a51f-732e62216c41 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:52.404973 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1073/2142] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:52 2022] PUT /identity/v3/projects/0f5697f719a14d43901b21860ef90095/users/5e7ad15d5f9b47c69c523b198a0b00ee/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:52.406199 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ff7ae-f52a-4f89-b8a5-4f3f3ecc67af admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:52.419474 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ff7ae-f52a-4f89-b8a5-4f3f3ecc67af admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:52.552496 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aff458-fd27-4eb3-89c2-ca305edfaf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:52.553220 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aff458-fd27-4eb3-89c2-ca305edfaf86 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:52.553507 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aff458-fd27-4eb3-89c2-ca305edfaf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:52.553788 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aff458-fd27-4eb3-89c2-ca305edfaf86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:52.554544 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aff458-fd27-4eb3-89c2-ca305edfaf86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:52.556179 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aff458-fd27-4eb3-89c2-ca305edfaf86 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:52.575100 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1070/2143] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:52.576349 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3cf26e-2d57-4a38-a51f-732e62216c41 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:52.589309 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3cf26e-2d57-4a38-a51f-732e62216c41 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:52.596712 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308055b-f731-403b-9737-ab260aedad94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:52.598014 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308055b-f731-403b-9737-ab260aedad94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:52.598304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308055b-f731-403b-9737-ab260aedad94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:52.599951 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308055b-f731-403b-9737-ab260aedad94 admin admin] PATH_INFO: `/v3/projects/0f5697f719a14d43901b21860ef90095/users/5e7ad15d5f9b47c69c523b198a0b00ee/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:52.604193 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308055b-f731-403b-9737-ab260aedad94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f5697f719a14d43901b21860ef90095, user_id=5e7ad15d5f9b47c69c523b198a0b00ee, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:52.608060 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308055b-f731-403b-9737-ab260aedad94 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:52.629805 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1074/2144] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:52 2022] PUT /identity/v3/projects/0f5697f719a14d43901b21860ef90095/users/5e7ad15d5f9b47c69c523b198a0b00ee/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:52.640430 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98946f-7461-4083-991f-26719569b089 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:52.641505 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98946f-7461-4083-991f-26719569b089 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:52.642780 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98946f-7461-4083-991f-26719569b089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:52.681439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-ef98946f-7461-4083-991f-26719569b089 None None] MFA Rules not processed for user `5e7ad15d5f9b47c69c523b198a0b00ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:52.683030 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ef98946f-7461-4083-991f-26719569b089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:52.721666 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:52.774117 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1071/2145] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:52.787139 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308055b-f731-403b-9737-ab260aedad94 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:52.788910 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9308055b-f731-403b-9737-ab260aedad94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:52.832460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:52.889377 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308055b-f731-403b-9737-ab260aedad94 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:52.897599 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac88cd-101c-4293-87ef-081c097c3bb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:52.898284 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac88cd-101c-4293-87ef-081c097c3bb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:52.898822 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac88cd-101c-4293-87ef-081c097c3bb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:52.899121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac88cd-101c-4293-87ef-081c097c3bb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:52.915628 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac88cd-101c-4293-87ef-081c097c3bb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:52.918099 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac88cd-101c-4293-87ef-081c097c3bb4 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:52.934045 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1075/2146] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:53.343883 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98946f-7461-4083-991f-26719569b089 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:53.354240 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98946f-7461-4083-991f-26719569b089 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:53.359202 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da6429-9f9f-4669-b0b4-85c75f378999 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e7ad15d5f9b47c69c523b198a0b00ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f5697f719a14d43901b21860ef90095', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:53.360232 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da6429-9f9f-4669-b0b4-85c75f378999 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:53.360658 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da6429-9f9f-4669-b0b4-85c75f378999 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:53.361011 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da6429-9f9f-4669-b0b4-85c75f378999 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:53.361888 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da6429-9f9f-4669-b0b4-85c75f378999 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:07:53.362269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da6429-9f9f-4669-b0b4-85c75f378999 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:53.364014 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da6429-9f9f-4669-b0b4-85c75f378999 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:53.379980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1072/2147] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:07:53.384094 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac88cd-101c-4293-87ef-081c097c3bb4 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:53.394535 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac88cd-101c-4293-87ef-081c097c3bb4 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:53.399418 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4576d-28a2-4513-88b9-40b965885a09 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e7ad15d5f9b47c69c523b198a0b00ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f5697f719a14d43901b21860ef90095', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:53.400177 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4576d-28a2-4513-88b9-40b965885a09 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:53.400589 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4576d-28a2-4513-88b9-40b965885a09 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:53.400941 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4576d-28a2-4513-88b9-40b965885a09 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:53.401714 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4576d-28a2-4513-88b9-40b965885a09 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:53.403726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4576d-28a2-4513-88b9-40b965885a09 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:53.434583 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1076/2148] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:53 2022] POST /identity/v3/projects => generated 353 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:53.445293 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da6429-9f9f-4669-b0b4-85c75f378999 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:53.450209 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404ae27-9322-4636-a889-0d57e888c04b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:53.450604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404ae27-9322-4636-a889-0d57e888c04b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:53.451256 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404ae27-9322-4636-a889-0d57e888c04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:53.461173 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da6429-9f9f-4669-b0b4-85c75f378999 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:53.496018 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c404ae27-9322-4636-a889-0d57e888c04b None None] MFA Rules not processed for user `5fc2803fed254f3b8a280df51891ec0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:53.498163 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c404ae27-9322-4636-a889-0d57e888c04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:53.548244 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d2533-65b1-4cf5-aa53-340423f9145e tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e7ad15d5f9b47c69c523b198a0b00ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f5697f719a14d43901b21860ef90095', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:53.549364 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d2533-65b1-4cf5-aa53-340423f9145e tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:53.549883 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d2533-65b1-4cf5-aa53-340423f9145e tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:53.550628 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d2533-65b1-4cf5-aa53-340423f9145e tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:53.551554 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d2533-65b1-4cf5-aa53-340423f9145e tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:07:53.552054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d2533-65b1-4cf5-aa53-340423f9145e tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:53.553876 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d2533-65b1-4cf5-aa53-340423f9145e tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:53.574985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1073/2149] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 22:07:53.614542 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1077/2150] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:53.622041 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d2533-65b1-4cf5-aa53-340423f9145e tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:53.625198 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-199d2533-65b1-4cf5-aa53-340423f9145e tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:53.647792 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404ae27-9322-4636-a889-0d57e888c04b None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:53.666787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404ae27-9322-4636-a889-0d57e888c04b None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:53.676740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a9da7-c9c4-4d60-8dab-123834b55ce6 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e7ad15d5f9b47c69c523b198a0b00ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f5697f719a14d43901b21860ef90095', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:53.678160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a9da7-c9c4-4d60-8dab-123834b55ce6 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:53.678160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a9da7-c9c4-4d60-8dab-123834b55ce6 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:53.678160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a9da7-c9c4-4d60-8dab-123834b55ce6 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] PATH_INFO: `/v3/projects/8b842c7864704a208b2991534fcef1e7` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:53.688231 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a9da7-c9c4-4d60-8dab-123834b55ce6 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8b842c7864704a208b2991534fcef1e7)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:53.688231 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a9da7-c9c4-4d60-8dab-123834b55ce6 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:53.739405 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d2533-65b1-4cf5-aa53-340423f9145e tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:53.763408 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-247a9da7-c9c4-4d60-8dab-123834b55ce6 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b842c7864704a208b2991534fcef1e7', 'request_id': 'req-247a9da7-c9c4-4d60-8dab-123834b55ce6'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:53.773259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-247a9da7-c9c4-4d60-8dab-123834b55ce6 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b842c7864704a208b2991534fcef1e7', 'request_id': 'req-247a9da7-c9c4-4d60-8dab-123834b55ce6'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:53.779942 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-247a9da7-c9c4-4d60-8dab-123834b55ce6 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b842c7864704a208b2991534fcef1e7', 'request_id': 'req-247a9da7-c9c4-4d60-8dab-123834b55ce6'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:53.791216 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:53.793030 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-247a9da7-c9c4-4d60-8dab-123834b55ce6 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] The token cache is being invalidate because project 8b842c7864704a208b2991534fcef1e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:53.793287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-247a9da7-c9c4-4d60-8dab-123834b55ce6 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:53.793992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-247a9da7-c9c4-4d60-8dab-123834b55ce6 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:53.795685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1078/2151] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:53 2022] DELETE /identity/v3/projects/8b842c7864704a208b2991534fcef1e7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:07:53.828015 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe95478-3548-44a8-89f0-4b063208f081 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:53.828804 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe95478-3548-44a8-89f0-4b063208f081 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:53.829583 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe95478-3548-44a8-89f0-4b063208f081 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:53.829583 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe95478-3548-44a8-89f0-4b063208f081 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:53.831283 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-bbe95478-3548-44a8-89f0-4b063208f081 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:53.935314 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe95478-3548-44a8-89f0-4b063208f081 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:53.937279 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe95478-3548-44a8-89f0-4b063208f081 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:53.951671 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1074/2152] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:54.066788 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a9da7-c9c4-4d60-8dab-123834b55ce6 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:54.068589 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-247a9da7-c9c4-4d60-8dab-123834b55ce6 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:54.082495 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:54.148487 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a9da7-c9c4-4d60-8dab-123834b55ce6 tempest-VolumeQuotaClassesTest-1528277095 tempest-VolumeQuotaClassesTest-1528277095-project-admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:54.153938 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857f117-95fe-413f-9b1e-f603dbb9023a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:54.154875 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857f117-95fe-413f-9b1e-f603dbb9023a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:54.155163 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857f117-95fe-413f-9b1e-f603dbb9023a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:54.155438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857f117-95fe-413f-9b1e-f603dbb9023a admin admin] PATH_INFO: `/v3/users/02d36d01633245a0a23dc9725e66549c` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:54.156968 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857f117-95fe-413f-9b1e-f603dbb9023a admin admin] RBAC: Authorizing `identity:delete_user(user_id=02d36d01633245a0a23dc9725e66549c)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:54.159128 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857f117-95fe-413f-9b1e-f603dbb9023a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:54.274176 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c857f117-95fe-413f-9b1e-f603dbb9023a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02d36d01633245a0a23dc9725e66549c'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:54.283817 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c857f117-95fe-413f-9b1e-f603dbb9023a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02d36d01633245a0a23dc9725e66549c'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:54.284661 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c857f117-95fe-413f-9b1e-f603dbb9023a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02d36d01633245a0a23dc9725e66549c'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:54.299898 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c857f117-95fe-413f-9b1e-f603dbb9023a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02d36d01633245a0a23dc9725e66549c'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:54.314488 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c857f117-95fe-413f-9b1e-f603dbb9023a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02d36d01633245a0a23dc9725e66549c'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:54.322915 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1079/2153] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:54 2022] DELETE /identity/v3/users/02d36d01633245a0a23dc9725e66549c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:54.327946 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c41b64-7968-4205-babc-2ae0c1581483 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:54.328453 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c41b64-7968-4205-babc-2ae0c1581483 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:54.329592 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c41b64-7968-4205-babc-2ae0c1581483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:54.379642 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a4c41b64-7968-4205-babc-2ae0c1581483 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:54.382791 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a4c41b64-7968-4205-babc-2ae0c1581483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:54.486348 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1075/2154] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:54.501122 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857f117-95fe-413f-9b1e-f603dbb9023a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:54.503120 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c857f117-95fe-413f-9b1e-f603dbb9023a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:54.605055 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857f117-95fe-413f-9b1e-f603dbb9023a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:54.613404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a355d0-a34f-4896-9af4-829d78f2298d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:54.614098 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a355d0-a34f-4896-9af4-829d78f2298d service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:54.614386 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a355d0-a34f-4896-9af4-829d78f2298d service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:54.614666 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a355d0-a34f-4896-9af4-829d78f2298d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:54.631567 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a355d0-a34f-4896-9af4-829d78f2298d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:54.633261 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a355d0-a34f-4896-9af4-829d78f2298d service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:54.647119 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1080/2155] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:07:55.198616 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c41b64-7968-4205-babc-2ae0c1581483 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:55.201677 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a4c41b64-7968-4205-babc-2ae0c1581483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:55.224885 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c41b64-7968-4205-babc-2ae0c1581483 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:55.229855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523a07b-4f6b-454e-8f2b-85464c20a860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:55.230868 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523a07b-4f6b-454e-8f2b-85464c20a860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:55.231367 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523a07b-4f6b-454e-8f2b-85464c20a860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:55.231749 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523a07b-4f6b-454e-8f2b-85464c20a860 admin admin] PATH_INFO: `/v3/projects/54d3e11f1c8d4f37b73cd9aa7a166625` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:55.233074 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9523a07b-4f6b-454e-8f2b-85464c20a860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d3e11f1c8d4f37b73cd9aa7a166625)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:55.235893 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9523a07b-4f6b-454e-8f2b-85464c20a860 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:55.319253 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9523a07b-4f6b-454e-8f2b-85464c20a860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d3e11f1c8d4f37b73cd9aa7a166625', 'request_id': 'req-9523a07b-4f6b-454e-8f2b-85464c20a860'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:55.329292 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9523a07b-4f6b-454e-8f2b-85464c20a860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d3e11f1c8d4f37b73cd9aa7a166625', 'request_id': 'req-9523a07b-4f6b-454e-8f2b-85464c20a860'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:55.342887 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9523a07b-4f6b-454e-8f2b-85464c20a860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d3e11f1c8d4f37b73cd9aa7a166625', 'request_id': 'req-9523a07b-4f6b-454e-8f2b-85464c20a860'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:55.360528 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9523a07b-4f6b-454e-8f2b-85464c20a860 admin admin] The token cache is being invalidate because project 54d3e11f1c8d4f37b73cd9aa7a166625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:55.360528 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9523a07b-4f6b-454e-8f2b-85464c20a860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:55.362247 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9523a07b-4f6b-454e-8f2b-85464c20a860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:55.368332 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1076/2156] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:55 2022] DELETE /identity/v3/projects/54d3e11f1c8d4f37b73cd9aa7a166625 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:55.368896 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a355d0-a34f-4896-9af4-829d78f2298d service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:55.380259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a355d0-a34f-4896-9af4-829d78f2298d service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:55.429283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:55.470311 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a9b79-709b-4112-a06e-0fab7aeb3b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:55.471353 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a9b79-709b-4112-a06e-0fab7aeb3b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:55.471639 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a9b79-709b-4112-a06e-0fab7aeb3b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:55.471934 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a9b79-709b-4112-a06e-0fab7aeb3b57 admin admin] PATH_INFO: `/v3/users/5e7ad15d5f9b47c69c523b198a0b00ee` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:55.473255 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a9b79-709b-4112-a06e-0fab7aeb3b57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e7ad15d5f9b47c69c523b198a0b00ee)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:55.475530 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a9b79-709b-4112-a06e-0fab7aeb3b57 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:55.543130 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c42a9b79-709b-4112-a06e-0fab7aeb3b57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e7ad15d5f9b47c69c523b198a0b00ee'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:55.554833 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c42a9b79-709b-4112-a06e-0fab7aeb3b57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e7ad15d5f9b47c69c523b198a0b00ee'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:55.555613 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c42a9b79-709b-4112-a06e-0fab7aeb3b57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e7ad15d5f9b47c69c523b198a0b00ee'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:55.573590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c42a9b79-709b-4112-a06e-0fab7aeb3b57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e7ad15d5f9b47c69c523b198a0b00ee'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:55.585532 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c42a9b79-709b-4112-a06e-0fab7aeb3b57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e7ad15d5f9b47c69c523b198a0b00ee'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:55.596270 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1081/2157] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:07:55 2022] DELETE /identity/v3/users/5e7ad15d5f9b47c69c523b198a0b00ee => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:55.710124 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a253e9b-4c94-45ed-bef1-50a75d814d17 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:55.711506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a253e9b-4c94-45ed-bef1-50a75d814d17 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:55.711988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a253e9b-4c94-45ed-bef1-50a75d814d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:55.729602 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:55.752352 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1a253e9b-4c94-45ed-bef1-50a75d814d17 None None] MFA Rules not processed for user `5fc2803fed254f3b8a280df51891ec0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:55.753939 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1a253e9b-4c94-45ed-bef1-50a75d814d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:55.836556 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1077/2158] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:56.004312 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a9b79-709b-4112-a06e-0fab7aeb3b57 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:56.006285 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c42a9b79-709b-4112-a06e-0fab7aeb3b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:56.139231 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a9b79-709b-4112-a06e-0fab7aeb3b57 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:56.145094 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca1056-9dd2-4145-864b-ffdc181ea7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:56.146123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca1056-9dd2-4145-864b-ffdc181ea7a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:56.146405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca1056-9dd2-4145-864b-ffdc181ea7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:56.146680 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca1056-9dd2-4145-864b-ffdc181ea7a8 admin admin] PATH_INFO: `/v3/projects/0f5697f719a14d43901b21860ef90095` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:56.148019 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca1056-9dd2-4145-864b-ffdc181ea7a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f5697f719a14d43901b21860ef90095)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:56.150068 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca1056-9dd2-4145-864b-ffdc181ea7a8 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:56.231736 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-23ca1056-9dd2-4145-864b-ffdc181ea7a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f5697f719a14d43901b21860ef90095', 'request_id': 'req-23ca1056-9dd2-4145-864b-ffdc181ea7a8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:56.237972 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:56.247449 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-23ca1056-9dd2-4145-864b-ffdc181ea7a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f5697f719a14d43901b21860ef90095', 'request_id': 'req-23ca1056-9dd2-4145-864b-ffdc181ea7a8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:56.258406 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-23ca1056-9dd2-4145-864b-ffdc181ea7a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f5697f719a14d43901b21860ef90095', 'request_id': 'req-23ca1056-9dd2-4145-864b-ffdc181ea7a8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:56.271481 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-23ca1056-9dd2-4145-864b-ffdc181ea7a8 admin admin] The token cache is being invalidate because project 0f5697f719a14d43901b21860ef90095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:07:56.271775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-23ca1056-9dd2-4145-864b-ffdc181ea7a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:56.272493 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-23ca1056-9dd2-4145-864b-ffdc181ea7a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:07:56.276467 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1082/2159] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:07:56 2022] DELETE /identity/v3/projects/0f5697f719a14d43901b21860ef90095 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:56.278991 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1648d56-13d8-417b-b1f1-8da3ca82f7ca None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:56.279475 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1648d56-13d8-417b-b1f1-8da3ca82f7ca None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:56.279900 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1648d56-13d8-417b-b1f1-8da3ca82f7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:56.305875 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c1648d56-13d8-417b-b1f1-8da3ca82f7ca None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:56.307339 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c1648d56-13d8-417b-b1f1-8da3ca82f7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:56.393078 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1078/2160] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:56.401013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa3abb-ae81-4fea-ba57-ec3f607a955d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:56.401312 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa3abb-ae81-4fea-ba57-ec3f607a955d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:56.401624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa3abb-ae81-4fea-ba57-ec3f607a955d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:56.424316 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-69aa3abb-ae81-4fea-ba57-ec3f607a955d None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:56.425910 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-69aa3abb-ae81-4fea-ba57-ec3f607a955d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:56.439035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1083/2161] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:56.440554 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1648d56-13d8-417b-b1f1-8da3ca82f7ca None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:56.451345 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1648d56-13d8-417b-b1f1-8da3ca82f7ca None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:56.469667 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbfeed-0471-4ccf-b6c3-04ed42a8e58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:56.470366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbfeed-0471-4ccf-b6c3-04ed42a8e58a admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:56.470655 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbfeed-0471-4ccf-b6c3-04ed42a8e58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:56.470941 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbfeed-0471-4ccf-b6c3-04ed42a8e58a admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:56.471731 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbfeed-0471-4ccf-b6c3-04ed42a8e58a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:07:56.472047 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbfeed-0471-4ccf-b6c3-04ed42a8e58a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:56.478386 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbfeed-0471-4ccf-b6c3-04ed42a8e58a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:56.533094 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1079/2162] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:07:56.533309 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa3abb-ae81-4fea-ba57-ec3f607a955d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:56.552547 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa3abb-ae81-4fea-ba57-ec3f607a955d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:56.568440 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6efda9-d898-405c-859e-8046d4d1d6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:56.569387 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6efda9-d898-405c-859e-8046d4d1d6e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:56.569822 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6efda9-d898-405c-859e-8046d4d1d6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:56.570245 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6efda9-d898-405c-859e-8046d4d1d6e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:56.571110 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6efda9-d898-405c-859e-8046d4d1d6e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:56.574616 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6efda9-d898-405c-859e-8046d4d1d6e8 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:56.617060 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1084/2163] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:56 2022] POST /identity/v3/projects => generated 399 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:07:56.621095 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbfeed-0471-4ccf-b6c3-04ed42a8e58a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:56.638648 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbfeed-0471-4ccf-b6c3-04ed42a8e58a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:56.741332 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacab6c9-857f-4b65-ab7c-4ab0854f6769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:56.742260 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacab6c9-857f-4b65-ab7c-4ab0854f6769 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:56.742625 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacab6c9-857f-4b65-ab7c-4ab0854f6769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:56.743489 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacab6c9-857f-4b65-ab7c-4ab0854f6769 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:56.743757 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacab6c9-857f-4b65-ab7c-4ab0854f6769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:56.745837 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacab6c9-857f-4b65-ab7c-4ab0854f6769 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:56.772801 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1080/2164] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:56 2022] POST /identity/v3/users => generated 300 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:07:56.777109 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6efda9-d898-405c-859e-8046d4d1d6e8 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:56.789118 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6efda9-d898-405c-859e-8046d4d1d6e8 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:56.794256 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c90cf-bb13-4a25-bb4e-297bf58ae57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:56.795058 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c90cf-bb13-4a25-bb4e-297bf58ae57b admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:56.795404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c90cf-bb13-4a25-bb4e-297bf58ae57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:56.795896 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c90cf-bb13-4a25-bb4e-297bf58ae57b admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:56.796774 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c90cf-bb13-4a25-bb4e-297bf58ae57b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:56.799010 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c90cf-bb13-4a25-bb4e-297bf58ae57b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:56.814459 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1085/2165] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:56.818240 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacab6c9-857f-4b65-ab7c-4ab0854f6769 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:56.830150 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacab6c9-857f-4b65-ab7c-4ab0854f6769 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:56.835704 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67bc44-8d3e-46da-8f4f-f7334290c7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:56.836674 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67bc44-8d3e-46da-8f4f-f7334290c7ca admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:56.836957 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67bc44-8d3e-46da-8f4f-f7334290c7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:56.837233 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67bc44-8d3e-46da-8f4f-f7334290c7ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:56.837978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67bc44-8d3e-46da-8f4f-f7334290c7ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:56.839615 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67bc44-8d3e-46da-8f4f-f7334290c7ca admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:56.858591 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1081/2166] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:56.860181 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c90cf-bb13-4a25-bb4e-297bf58ae57b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:56.873959 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c90cf-bb13-4a25-bb4e-297bf58ae57b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:56.880650 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da57f43-a800-4948-a509-c2f5a14d8e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:56.881554 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da57f43-a800-4948-a509-c2f5a14d8e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:56.881843 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da57f43-a800-4948-a509-c2f5a14d8e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:56.882123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da57f43-a800-4948-a509-c2f5a14d8e3e admin admin] PATH_INFO: `/v3/projects/8d08592b1b1840eeae5e940ed86a34aa/users/be401548ded148bbae2d4f455aab04b2/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:56.905064 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da57f43-a800-4948-a509-c2f5a14d8e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d08592b1b1840eeae5e940ed86a34aa, user_id=be401548ded148bbae2d4f455aab04b2, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:56.909072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da57f43-a800-4948-a509-c2f5a14d8e3e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:56.952720 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1086/2167] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:56 2022] PUT /identity/v3/projects/8d08592b1b1840eeae5e940ed86a34aa/users/be401548ded148bbae2d4f455aab04b2/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:07:56.955149 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fa6e0-0cdd-4202-a1d4-89ae874e9e73 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:56.955442 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fa6e0-0cdd-4202-a1d4-89ae874e9e73 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:56.955722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fa6e0-0cdd-4202-a1d4-89ae874e9e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:56.988693 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-cf3fa6e0-0cdd-4202-a1d4-89ae874e9e73 None None] MFA Rules not processed for user `be401548ded148bbae2d4f455aab04b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:56.990387 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-cf3fa6e0-0cdd-4202-a1d4-89ae874e9e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:56.996633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:57.104234 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1082/2168] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:57.105128 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da57f43-a800-4948-a509-c2f5a14d8e3e admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:57.196676 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da57f43-a800-4948-a509-c2f5a14d8e3e admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:57.201359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d85e69-2d16-429f-b20b-d4b9af410e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:57.202064 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d85e69-2d16-429f-b20b-d4b9af410e11 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:57.202309 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d85e69-2d16-429f-b20b-d4b9af410e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:57.202582 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d85e69-2d16-429f-b20b-d4b9af410e11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:57.203670 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d85e69-2d16-429f-b20b-d4b9af410e11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:57.205694 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d85e69-2d16-429f-b20b-d4b9af410e11 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:57.237800 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1087/2169] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:07:57 2022] POST /identity/v3/projects => generated 401 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:07:57.242410 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fa6e0-0cdd-4202-a1d4-89ae874e9e73 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:57.255322 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fa6e0-0cdd-4202-a1d4-89ae874e9e73 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:57.321569 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa59c7-c643-4179-ad14-0a7a4817bf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:57.322282 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa59c7-c643-4179-ad14-0a7a4817bf86 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:57.322544 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa59c7-c643-4179-ad14-0a7a4817bf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:57.322913 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa59c7-c643-4179-ad14-0a7a4817bf86 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:57.323544 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa59c7-c643-4179-ad14-0a7a4817bf86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:57.325868 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa59c7-c643-4179-ad14-0a7a4817bf86 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:57.352596 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1083/2170] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:07:57 2022] POST /identity/v3/users => generated 307 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:07:57.355955 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d85e69-2d16-429f-b20b-d4b9af410e11 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:57.375431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d85e69-2d16-429f-b20b-d4b9af410e11 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:57.387940 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ac0c3-62fd-4e04-9326-49c84ee9fd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:57.388889 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ac0c3-62fd-4e04-9326-49c84ee9fd9c admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:57.389308 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ac0c3-62fd-4e04-9326-49c84ee9fd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:57.389652 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ac0c3-62fd-4e04-9326-49c84ee9fd9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:57.391119 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ac0c3-62fd-4e04-9326-49c84ee9fd9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:57.393062 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ac0c3-62fd-4e04-9326-49c84ee9fd9c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:57.404931 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1088/2171] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:07:57.410632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa59c7-c643-4179-ad14-0a7a4817bf86 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:57.431145 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa59c7-c643-4179-ad14-0a7a4817bf86 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:57.439000 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad2dc4-0c5d-43c2-ba9a-c75c56c85912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:57.440572 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad2dc4-0c5d-43c2-ba9a-c75c56c85912 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:57.441083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad2dc4-0c5d-43c2-ba9a-c75c56c85912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:57.441585 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad2dc4-0c5d-43c2-ba9a-c75c56c85912 admin admin] PATH_INFO: `/v3/projects/421f16f54534444ead91384fee979b91/users/f16ed02c93774b6ab98f9e16ebf3a132/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:57.467352 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad2dc4-0c5d-43c2-ba9a-c75c56c85912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=421f16f54534444ead91384fee979b91, user_id=f16ed02c93774b6ab98f9e16ebf3a132, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:57.473151 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad2dc4-0c5d-43c2-ba9a-c75c56c85912 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:57.501452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1084/2172] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:57 2022] PUT /identity/v3/projects/421f16f54534444ead91384fee979b91/users/f16ed02c93774b6ab98f9e16ebf3a132/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:07:57.506928 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ac0c3-62fd-4e04-9326-49c84ee9fd9c admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:57.517302 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ac0c3-62fd-4e04-9326-49c84ee9fd9c admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:57.579007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:57.590828 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971a9cb-c3eb-4170-b47a-3992f46d15bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:57.591524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971a9cb-c3eb-4170-b47a-3992f46d15bd admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:57.591807 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971a9cb-c3eb-4170-b47a-3992f46d15bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:57.592089 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971a9cb-c3eb-4170-b47a-3992f46d15bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:57.592861 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971a9cb-c3eb-4170-b47a-3992f46d15bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:57.595093 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971a9cb-c3eb-4170-b47a-3992f46d15bd admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:57.606749 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1089/2173] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:07:57.611883 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad2dc4-0c5d-43c2-ba9a-c75c56c85912 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:57.625065 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad2dc4-0c5d-43c2-ba9a-c75c56c85912 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:57.630358 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d915b-acc8-4ad3-bc1d-279565f6c9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:57.631363 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d915b-acc8-4ad3-bc1d-279565f6c9f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:57.631673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d915b-acc8-4ad3-bc1d-279565f6c9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:57.631987 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d915b-acc8-4ad3-bc1d-279565f6c9f4 admin admin] PATH_INFO: `/v3/projects/421f16f54534444ead91384fee979b91/users/f16ed02c93774b6ab98f9e16ebf3a132/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:57.634214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d915b-acc8-4ad3-bc1d-279565f6c9f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=421f16f54534444ead91384fee979b91, user_id=f16ed02c93774b6ab98f9e16ebf3a132, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:57.636971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d915b-acc8-4ad3-bc1d-279565f6c9f4 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:57.649739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1085/2174] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:07:57 2022] PUT /identity/v3/projects/421f16f54534444ead91384fee979b91/users/f16ed02c93774b6ab98f9e16ebf3a132/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:07:57.662476 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b050d8-2542-4784-bb16-580e6cb2e0ad None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:57.662759 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b050d8-2542-4784-bb16-580e6cb2e0ad None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:57.663070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b050d8-2542-4784-bb16-580e6cb2e0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:57.712318 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d3b050d8-2542-4784-bb16-580e6cb2e0ad None None] MFA Rules not processed for user `f16ed02c93774b6ab98f9e16ebf3a132`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:07:57.714626 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d3b050d8-2542-4784-bb16-580e6cb2e0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:57.795466 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1090/2175] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:07:57 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:07:57.817376 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d915b-acc8-4ad3-bc1d-279565f6c9f4 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:57.819370 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1f7d915b-acc8-4ad3-bc1d-279565f6c9f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:07:57.888709 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d915b-acc8-4ad3-bc1d-279565f6c9f4 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:57.892583 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ed34c-3365-4528-ba45-9cdb688b4b29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:57.893236 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ed34c-3365-4528-ba45-9cdb688b4b29 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:57.893515 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ed34c-3365-4528-ba45-9cdb688b4b29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:57.893828 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ed34c-3365-4528-ba45-9cdb688b4b29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:57.903132 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ed34c-3365-4528-ba45-9cdb688b4b29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:57.904597 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ed34c-3365-4528-ba45-9cdb688b4b29 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:57.910308 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:07:57.916151 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1086/2176] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:57 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:07:58.003613 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b050d8-2542-4784-bb16-580e6cb2e0ad None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:07:58.027159 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b050d8-2542-4784-bb16-580e6cb2e0ad None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:07:58.038608 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d418b-92fc-40b5-8c1a-f26435de9461 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:07:58.039297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d418b-92fc-40b5-8c1a-f26435de9461 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:07:58.039589 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d418b-92fc-40b5-8c1a-f26435de9461 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:07:58.039870 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d418b-92fc-40b5-8c1a-f26435de9461 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:07:58.137494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d418b-92fc-40b5-8c1a-f26435de9461 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:07:58.138822 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d418b-92fc-40b5-8c1a-f26435de9461 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:07:58.164345 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1091/2177] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:07:58 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:08:02.457321 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ed34c-3365-4528-ba45-9cdb688b4b29 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:02.521924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ed34c-3365-4528-ba45-9cdb688b4b29 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:02.526446 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b6450-7b08-4545-a6f7-d3dccbdb8295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:02.527310 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b6450-7b08-4545-a6f7-d3dccbdb8295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:02.527587 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b6450-7b08-4545-a6f7-d3dccbdb8295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:02.527848 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b6450-7b08-4545-a6f7-d3dccbdb8295 admin admin] PATH_INFO: `/v3/users/be401548ded148bbae2d4f455aab04b2` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:02.529037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b6450-7b08-4545-a6f7-d3dccbdb8295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be401548ded148bbae2d4f455aab04b2)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:02.530935 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b6450-7b08-4545-a6f7-d3dccbdb8295 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:02.581031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9e8b6450-7b08-4545-a6f7-d3dccbdb8295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be401548ded148bbae2d4f455aab04b2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:02.588610 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9e8b6450-7b08-4545-a6f7-d3dccbdb8295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be401548ded148bbae2d4f455aab04b2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:02.603045 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9e8b6450-7b08-4545-a6f7-d3dccbdb8295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be401548ded148bbae2d4f455aab04b2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:02.603785 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9e8b6450-7b08-4545-a6f7-d3dccbdb8295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be401548ded148bbae2d4f455aab04b2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:02.604452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9e8b6450-7b08-4545-a6f7-d3dccbdb8295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be401548ded148bbae2d4f455aab04b2'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:02.620271 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1087/2178] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:08:02 2022] DELETE /identity/v3/users/be401548ded148bbae2d4f455aab04b2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:08:02.624858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5c7f9-a32b-41fc-bc00-68d742f7fdd1 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:02.625874 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5c7f9-a32b-41fc-bc00-68d742f7fdd1 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:02.626069 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5c7f9-a32b-41fc-bc00-68d742f7fdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:02.646831 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-89e5c7f9-a32b-41fc-bc00-68d742f7fdd1 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:08:02.646831 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-89e5c7f9-a32b-41fc-bc00-68d742f7fdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:02.718968 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1092/2179] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:08:02.729744 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b6450-7b08-4545-a6f7-d3dccbdb8295 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:02.731889 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9e8b6450-7b08-4545-a6f7-d3dccbdb8295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:02.794312 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b6450-7b08-4545-a6f7-d3dccbdb8295 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:02.798481 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757866e-ccf5-4671-a0b4-5b222d93d50b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:02.799143 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757866e-ccf5-4671-a0b4-5b222d93d50b service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:02.799421 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757866e-ccf5-4671-a0b4-5b222d93d50b service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:02.799694 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757866e-ccf5-4671-a0b4-5b222d93d50b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:02.809702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757866e-ccf5-4671-a0b4-5b222d93d50b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:02.811129 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757866e-ccf5-4671-a0b4-5b222d93d50b service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:02.821692 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1088/2180] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:08:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:08:03.198213 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5c7f9-a32b-41fc-bc00-68d742f7fdd1 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:03.199698 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-89e5c7f9-a32b-41fc-bc00-68d742f7fdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:03.212309 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5c7f9-a32b-41fc-bc00-68d742f7fdd1 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:03.226423 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74d151-084a-4bda-85de-9c17eac7a9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:03.227508 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74d151-084a-4bda-85de-9c17eac7a9d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:03.227862 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74d151-084a-4bda-85de-9c17eac7a9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:03.228166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74d151-084a-4bda-85de-9c17eac7a9d0 admin admin] PATH_INFO: `/v3/projects/8d08592b1b1840eeae5e940ed86a34aa` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:03.229425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74d151-084a-4bda-85de-9c17eac7a9d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d08592b1b1840eeae5e940ed86a34aa)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:03.231614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74d151-084a-4bda-85de-9c17eac7a9d0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:03.239560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:08:03.292165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1b74d151-084a-4bda-85de-9c17eac7a9d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d08592b1b1840eeae5e940ed86a34aa', 'request_id': 'req-1b74d151-084a-4bda-85de-9c17eac7a9d0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:03.300165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1b74d151-084a-4bda-85de-9c17eac7a9d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d08592b1b1840eeae5e940ed86a34aa', 'request_id': 'req-1b74d151-084a-4bda-85de-9c17eac7a9d0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:03.306049 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1b74d151-084a-4bda-85de-9c17eac7a9d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d08592b1b1840eeae5e940ed86a34aa', 'request_id': 'req-1b74d151-084a-4bda-85de-9c17eac7a9d0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:03.318231 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1b74d151-084a-4bda-85de-9c17eac7a9d0 admin admin] The token cache is being invalidate because project 8d08592b1b1840eeae5e940ed86a34aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:08:03.318521 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1b74d151-084a-4bda-85de-9c17eac7a9d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:03.319237 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1b74d151-084a-4bda-85de-9c17eac7a9d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:03.320892 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1093/2181] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:08:03 2022] DELETE /identity/v3/projects/8d08592b1b1840eeae5e940ed86a34aa => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:08:03.324992 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757866e-ccf5-4671-a0b4-5b222d93d50b service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:03.335660 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757866e-ccf5-4671-a0b4-5b222d93d50b service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:03.355628 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:08:03.401393 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbbc87-257a-4572-83df-cf500cf63ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:03.402287 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbbc87-257a-4572-83df-cf500cf63ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:03.402575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbbc87-257a-4572-83df-cf500cf63ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:03.402852 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbbc87-257a-4572-83df-cf500cf63ed9 admin admin] PATH_INFO: `/v3/users/f16ed02c93774b6ab98f9e16ebf3a132` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:03.404051 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbbc87-257a-4572-83df-cf500cf63ed9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f16ed02c93774b6ab98f9e16ebf3a132)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:03.406100 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbbc87-257a-4572-83df-cf500cf63ed9 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:03.462844 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-fdbbbc87-257a-4572-83df-cf500cf63ed9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f16ed02c93774b6ab98f9e16ebf3a132'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:03.471081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-fdbbbc87-257a-4572-83df-cf500cf63ed9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f16ed02c93774b6ab98f9e16ebf3a132'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:03.485613 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-fdbbbc87-257a-4572-83df-cf500cf63ed9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f16ed02c93774b6ab98f9e16ebf3a132'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:03.486254 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-fdbbbc87-257a-4572-83df-cf500cf63ed9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f16ed02c93774b6ab98f9e16ebf3a132'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:03.486864 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-fdbbbc87-257a-4572-83df-cf500cf63ed9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f16ed02c93774b6ab98f9e16ebf3a132'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:03.501790 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1089/2182] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:08:03 2022] DELETE /identity/v3/users/f16ed02c93774b6ab98f9e16ebf3a132 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:08:03.821454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74d151-084a-4bda-85de-9c17eac7a9d0 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:03.822729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1b74d151-084a-4bda-85de-9c17eac7a9d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:03.836291 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74d151-084a-4bda-85de-9c17eac7a9d0 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:03.900697 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988639be-e585-4ebf-be92-3816bc7dfc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:03.901472 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988639be-e585-4ebf-be92-3816bc7dfc87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:03.901765 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988639be-e585-4ebf-be92-3816bc7dfc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:03.902042 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988639be-e585-4ebf-be92-3816bc7dfc87 admin admin] PATH_INFO: `/v3/projects/421f16f54534444ead91384fee979b91` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:03.903608 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988639be-e585-4ebf-be92-3816bc7dfc87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=421f16f54534444ead91384fee979b91)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:03.905591 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988639be-e585-4ebf-be92-3816bc7dfc87 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:03.957931 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-988639be-e585-4ebf-be92-3816bc7dfc87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '421f16f54534444ead91384fee979b91', 'request_id': 'req-988639be-e585-4ebf-be92-3816bc7dfc87'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:03.966022 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-988639be-e585-4ebf-be92-3816bc7dfc87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '421f16f54534444ead91384fee979b91', 'request_id': 'req-988639be-e585-4ebf-be92-3816bc7dfc87'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:03.972286 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-988639be-e585-4ebf-be92-3816bc7dfc87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '421f16f54534444ead91384fee979b91', 'request_id': 'req-988639be-e585-4ebf-be92-3816bc7dfc87'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:03.983600 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-988639be-e585-4ebf-be92-3816bc7dfc87 admin admin] The token cache is being invalidate because project 421f16f54534444ead91384fee979b91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:08:03.983885 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-988639be-e585-4ebf-be92-3816bc7dfc87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:03.984624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-988639be-e585-4ebf-be92-3816bc7dfc87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:03.986196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1094/2183] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:08:03 2022] DELETE /identity/v3/projects/421f16f54534444ead91384fee979b91 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:08:03.991207 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe949d9-d94d-4dd6-b935-89f50156875d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:03.991502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe949d9-d94d-4dd6-b935-89f50156875d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:03.991777 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe949d9-d94d-4dd6-b935-89f50156875d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:04.011416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-9fe949d9-d94d-4dd6-b935-89f50156875d None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:08:04.012557 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9fe949d9-d94d-4dd6-b935-89f50156875d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:04.079818 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1090/2184] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:08:04.089715 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bb14c-7c10-4e12-96b1-99182475b6a3 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:04.090160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bb14c-7c10-4e12-96b1-99182475b6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:04.090530 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bb14c-7c10-4e12-96b1-99182475b6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:04.111863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c60bb14c-7c10-4e12-96b1-99182475b6a3 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:08:04.113217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c60bb14c-7c10-4e12-96b1-99182475b6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:04.121514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1095/2185] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:08:04.126447 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe949d9-d94d-4dd6-b935-89f50156875d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:04.137506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe949d9-d94d-4dd6-b935-89f50156875d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:04.142889 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b46799-bf3c-4a82-8373-2d6b8bbbe459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:04.143576 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b46799-bf3c-4a82-8373-2d6b8bbbe459 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:04.143863 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b46799-bf3c-4a82-8373-2d6b8bbbe459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:04.144138 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b46799-bf3c-4a82-8373-2d6b8bbbe459 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:04.144921 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b46799-bf3c-4a82-8373-2d6b8bbbe459 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:08:04.145226 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b46799-bf3c-4a82-8373-2d6b8bbbe459 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:04.146851 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b46799-bf3c-4a82-8373-2d6b8bbbe459 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:04.166263 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1091/2186] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:08:04.168771 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bb14c-7c10-4e12-96b1-99182475b6a3 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:04.180661 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bb14c-7c10-4e12-96b1-99182475b6a3 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:04.193016 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e5efc-9539-4627-988b-06def4571bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:04.193707 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e5efc-9539-4627-988b-06def4571bdb admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:04.193991 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e5efc-9539-4627-988b-06def4571bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:04.194268 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e5efc-9539-4627-988b-06def4571bdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:04.195006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e5efc-9539-4627-988b-06def4571bdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:04.197010 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e5efc-9539-4627-988b-06def4571bdb admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:04.215498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:08:04.230758 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1096/2187] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:08:04 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:08:04.234946 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b46799-bf3c-4a82-8373-2d6b8bbbe459 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:04.246291 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b46799-bf3c-4a82-8373-2d6b8bbbe459 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:04.277556 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:08:04.325779 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048f579-57ac-4c97-8954-000be6dc9315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:04.326512 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048f579-57ac-4c97-8954-000be6dc9315 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:04.326946 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048f579-57ac-4c97-8954-000be6dc9315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:04.327229 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048f579-57ac-4c97-8954-000be6dc9315 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:04.327969 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048f579-57ac-4c97-8954-000be6dc9315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:04.330581 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048f579-57ac-4c97-8954-000be6dc9315 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:04.357969 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1092/2188] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:08:04 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:08:04.359315 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e5efc-9539-4627-988b-06def4571bdb admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:04.371952 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e5efc-9539-4627-988b-06def4571bdb admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:04.378128 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e89301-4ca7-4859-b6c9-152f3ee0e19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:04.378845 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e89301-4ca7-4859-b6c9-152f3ee0e19b admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:04.379135 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e89301-4ca7-4859-b6c9-152f3ee0e19b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:04.379439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e89301-4ca7-4859-b6c9-152f3ee0e19b admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:04.380176 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e89301-4ca7-4859-b6c9-152f3ee0e19b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:04.381859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e89301-4ca7-4859-b6c9-152f3ee0e19b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:04.397010 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1097/2189] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:08:04.398304 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048f579-57ac-4c97-8954-000be6dc9315 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:04.409938 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048f579-57ac-4c97-8954-000be6dc9315 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:04.414691 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb68d1-f2b3-45bc-9ae1-33b835c16a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:04.415350 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb68d1-f2b3-45bc-9ae1-33b835c16a69 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:04.415635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb68d1-f2b3-45bc-9ae1-33b835c16a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:04.415911 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb68d1-f2b3-45bc-9ae1-33b835c16a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:04.416753 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb68d1-f2b3-45bc-9ae1-33b835c16a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:04.425088 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb68d1-f2b3-45bc-9ae1-33b835c16a69 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:04.435894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1093/2190] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:08:04.440501 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e89301-4ca7-4859-b6c9-152f3ee0e19b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:04.452003 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e89301-4ca7-4859-b6c9-152f3ee0e19b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:04.457675 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6a5ba-d90e-4e93-b805-af824c645a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:04.458660 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6a5ba-d90e-4e93-b805-af824c645a9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:04.458947 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6a5ba-d90e-4e93-b805-af824c645a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:04.459217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6a5ba-d90e-4e93-b805-af824c645a9b admin admin] PATH_INFO: `/v3/projects/969bf0c042754503a7d5c888ec726a37/users/69236d0ddf6c4c76a086861429563432/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:04.476121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6a5ba-d90e-4e93-b805-af824c645a9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=969bf0c042754503a7d5c888ec726a37, user_id=69236d0ddf6c4c76a086861429563432, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:04.478876 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6a5ba-d90e-4e93-b805-af824c645a9b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:04.493615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1098/2191] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:08:04 2022] PUT /identity/v3/projects/969bf0c042754503a7d5c888ec726a37/users/69236d0ddf6c4c76a086861429563432/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:08:04.503921 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47a0b1-2ee5-45fd-bd0d-30eaf2ac3ae8 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:04.504456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47a0b1-2ee5-45fd-bd0d-30eaf2ac3ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:04.504565 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47a0b1-2ee5-45fd-bd0d-30eaf2ac3ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:04.535084 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-fa47a0b1-2ee5-45fd-bd0d-30eaf2ac3ae8 None None] MFA Rules not processed for user `69236d0ddf6c4c76a086861429563432`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:08:04.536269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-fa47a0b1-2ee5-45fd-bd0d-30eaf2ac3ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:04.622731 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1094/2192] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:08:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:08:04.635387 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6a5ba-d90e-4e93-b805-af824c645a9b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:04.638223 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d2f6a5ba-d90e-4e93-b805-af824c645a9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:04.708240 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6a5ba-d90e-4e93-b805-af824c645a9b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:04.711912 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946546f0-6329-47c4-a551-710b18c0c486 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:04.712633 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946546f0-6329-47c4-a551-710b18c0c486 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:04.712909 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946546f0-6329-47c4-a551-710b18c0c486 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:04.713188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946546f0-6329-47c4-a551-710b18c0c486 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:04.723435 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946546f0-6329-47c4-a551-710b18c0c486 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:04.724945 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946546f0-6329-47c4-a551-710b18c0c486 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:04.744425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1099/2193] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:08:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:08:04.764934 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47a0b1-2ee5-45fd-bd0d-30eaf2ac3ae8 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:04.829683 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47a0b1-2ee5-45fd-bd0d-30eaf2ac3ae8 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:04.834427 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1e981-3def-489e-a6ff-eb385a8d72d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:04.835322 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1e981-3def-489e-a6ff-eb385a8d72d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:04.835605 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1e981-3def-489e-a6ff-eb385a8d72d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:04.835883 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1e981-3def-489e-a6ff-eb385a8d72d6 admin admin] PATH_INFO: `/v3/users/69236d0ddf6c4c76a086861429563432` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:04.837152 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1e981-3def-489e-a6ff-eb385a8d72d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69236d0ddf6c4c76a086861429563432)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:04.839192 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1e981-3def-489e-a6ff-eb385a8d72d6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:04.882010 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:08:04.890551 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-faa1e981-3def-489e-a6ff-eb385a8d72d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69236d0ddf6c4c76a086861429563432'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:04.899768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-faa1e981-3def-489e-a6ff-eb385a8d72d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69236d0ddf6c4c76a086861429563432'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:04.912808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-faa1e981-3def-489e-a6ff-eb385a8d72d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69236d0ddf6c4c76a086861429563432'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:04.913479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-faa1e981-3def-489e-a6ff-eb385a8d72d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69236d0ddf6c4c76a086861429563432'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:04.914092 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-faa1e981-3def-489e-a6ff-eb385a8d72d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69236d0ddf6c4c76a086861429563432'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:04.926517 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1095/2194] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:08:04 2022] DELETE /identity/v3/users/69236d0ddf6c4c76a086861429563432 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:08:04.931380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51acd3-01c3-4813-9239-5741dc22d454 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:04.931836 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51acd3-01c3-4813-9239-5741dc22d454 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:04.931950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51acd3-01c3-4813-9239-5741dc22d454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:04.951160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-bc51acd3-01c3-4813-9239-5741dc22d454 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:08:04.952457 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-bc51acd3-01c3-4813-9239-5741dc22d454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:05.025157 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1100/2195] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:08:05.038465 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1e981-3def-489e-a6ff-eb385a8d72d6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:05.040053 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-faa1e981-3def-489e-a6ff-eb385a8d72d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:05.105695 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1e981-3def-489e-a6ff-eb385a8d72d6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:05.117560 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf69fa-8025-43e7-9bab-52544cf04c26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:05.117560 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf69fa-8025-43e7-9bab-52544cf04c26 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:05.117560 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf69fa-8025-43e7-9bab-52544cf04c26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:05.117560 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf69fa-8025-43e7-9bab-52544cf04c26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:05.124411 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf69fa-8025-43e7-9bab-52544cf04c26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:05.126890 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf69fa-8025-43e7-9bab-52544cf04c26 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:05.137859 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1096/2196] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:08:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:08:05.437523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51acd3-01c3-4813-9239-5741dc22d454 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:05.439330 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-bc51acd3-01c3-4813-9239-5741dc22d454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:05.455951 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51acd3-01c3-4813-9239-5741dc22d454 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:05.462310 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a64bb-2599-447e-9ab1-c54d31751612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:05.464306 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a64bb-2599-447e-9ab1-c54d31751612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:05.464744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a64bb-2599-447e-9ab1-c54d31751612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:05.465513 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a64bb-2599-447e-9ab1-c54d31751612 admin admin] PATH_INFO: `/v3/projects/969bf0c042754503a7d5c888ec726a37` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:05.467985 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a64bb-2599-447e-9ab1-c54d31751612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=969bf0c042754503a7d5c888ec726a37)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:05.471234 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a64bb-2599-447e-9ab1-c54d31751612 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:05.550716 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-690a64bb-2599-447e-9ab1-c54d31751612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '969bf0c042754503a7d5c888ec726a37', 'request_id': 'req-690a64bb-2599-447e-9ab1-c54d31751612'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:05.558470 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-690a64bb-2599-447e-9ab1-c54d31751612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '969bf0c042754503a7d5c888ec726a37', 'request_id': 'req-690a64bb-2599-447e-9ab1-c54d31751612'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:05.560506 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:08:05.567375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-690a64bb-2599-447e-9ab1-c54d31751612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '969bf0c042754503a7d5c888ec726a37', 'request_id': 'req-690a64bb-2599-447e-9ab1-c54d31751612'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:05.581012 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-690a64bb-2599-447e-9ab1-c54d31751612 admin admin] The token cache is being invalidate because project 969bf0c042754503a7d5c888ec726a37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:08:05.581304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-690a64bb-2599-447e-9ab1-c54d31751612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:05.582204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-690a64bb-2599-447e-9ab1-c54d31751612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:05.583811 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1101/2197] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:08:05 2022] DELETE /identity/v3/projects/969bf0c042754503a7d5c888ec726a37 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:08:05.588782 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f357b32-6ec2-48fe-b163-f579cd94023e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:05.589270 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f357b32-6ec2-48fe-b163-f579cd94023e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:05.589360 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f357b32-6ec2-48fe-b163-f579cd94023e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:05.607431 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-5f357b32-6ec2-48fe-b163-f579cd94023e None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:08:05.608612 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5f357b32-6ec2-48fe-b163-f579cd94023e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:05.670354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1097/2198] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:08:05.678932 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67c9c4-93ed-4648-a7a1-fc2f5cba357d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:05.679252 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67c9c4-93ed-4648-a7a1-fc2f5cba357d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:05.679551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67c9c4-93ed-4648-a7a1-fc2f5cba357d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:05.697933 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-fb67c9c4-93ed-4648-a7a1-fc2f5cba357d None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:08:05.699188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-fb67c9c4-93ed-4648-a7a1-fc2f5cba357d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:05.707395 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1102/2199] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:08:05.712227 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f357b32-6ec2-48fe-b163-f579cd94023e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:05.729212 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f357b32-6ec2-48fe-b163-f579cd94023e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:05.734254 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5dfdda-dccf-4131-b398-dac358ee4f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:05.735696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dfdda-dccf-4131-b398-dac358ee4f4a admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:05.735813 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dfdda-dccf-4131-b398-dac358ee4f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:05.736076 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dfdda-dccf-4131-b398-dac358ee4f4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:05.736867 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5dfdda-dccf-4131-b398-dac358ee4f4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:08:05.737180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5dfdda-dccf-4131-b398-dac358ee4f4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:05.738786 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5dfdda-dccf-4131-b398-dac358ee4f4a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:05.751503 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1098/2200] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:08:05.756317 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67c9c4-93ed-4648-a7a1-fc2f5cba357d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:05.766558 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67c9c4-93ed-4648-a7a1-fc2f5cba357d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:05.771435 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6edc0fe-8315-4d94-af67-2611780aada5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:05.772113 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edc0fe-8315-4d94-af67-2611780aada5 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:05.772394 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edc0fe-8315-4d94-af67-2611780aada5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:05.772717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edc0fe-8315-4d94-af67-2611780aada5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:05.773430 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6edc0fe-8315-4d94-af67-2611780aada5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:05.775388 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6edc0fe-8315-4d94-af67-2611780aada5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:05.805636 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1103/2201] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:08:05 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:08:05.809783 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5dfdda-dccf-4131-b398-dac358ee4f4a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:05.819868 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5dfdda-dccf-4131-b398-dac358ee4f4a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:05.867670 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:08:05.885070 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfc702-ad92-48e7-93e8-ce701f0e2ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:05.885758 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfc702-ad92-48e7-93e8-ce701f0e2ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:05.886072 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfc702-ad92-48e7-93e8-ce701f0e2ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:05.886413 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfc702-ad92-48e7-93e8-ce701f0e2ca0 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:05.887037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebfc702-ad92-48e7-93e8-ce701f0e2ca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:05.889070 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebfc702-ad92-48e7-93e8-ce701f0e2ca0 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:05.915946 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1099/2202] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:08:05 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:08:05.917068 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6edc0fe-8315-4d94-af67-2611780aada5 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:05.928042 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6edc0fe-8315-4d94-af67-2611780aada5 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:05.933799 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddf3be-ed32-4738-a94a-894b47e57540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:05.934521 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddf3be-ed32-4738-a94a-894b47e57540 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:05.934806 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddf3be-ed32-4738-a94a-894b47e57540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:05.935084 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddf3be-ed32-4738-a94a-894b47e57540 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:05.935850 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ddf3be-ed32-4738-a94a-894b47e57540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:05.937519 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ddf3be-ed32-4738-a94a-894b47e57540 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:05.954033 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1104/2203] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:08:05.955264 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfc702-ad92-48e7-93e8-ce701f0e2ca0 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:05.965863 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfc702-ad92-48e7-93e8-ce701f0e2ca0 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:05.970746 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe72cc-33de-4d0c-902c-9d94ffb54d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:05.971526 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe72cc-33de-4d0c-902c-9d94ffb54d0f admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:05.971822 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe72cc-33de-4d0c-902c-9d94ffb54d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:05.972109 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe72cc-33de-4d0c-902c-9d94ffb54d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:05.972934 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe72cc-33de-4d0c-902c-9d94ffb54d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:05.974558 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe72cc-33de-4d0c-902c-9d94ffb54d0f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:05.993421 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1100/2204] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:08:05.996759 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddf3be-ed32-4738-a94a-894b47e57540 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:06.012323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddf3be-ed32-4738-a94a-894b47e57540 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:06.020534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ffe4e-bfe0-4004-bf2f-b9e1309613ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:06.022169 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ffe4e-bfe0-4004-bf2f-b9e1309613ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:06.022805 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ffe4e-bfe0-4004-bf2f-b9e1309613ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:06.023615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ffe4e-bfe0-4004-bf2f-b9e1309613ed admin admin] PATH_INFO: `/v3/projects/15332dc953844a65a14481b58d42d19b/users/a197bd611ae2409892c110bd5cd61dcb/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:06.041946 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ffe4e-bfe0-4004-bf2f-b9e1309613ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=15332dc953844a65a14481b58d42d19b, user_id=a197bd611ae2409892c110bd5cd61dcb, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:06.044833 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ffe4e-bfe0-4004-bf2f-b9e1309613ed admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:06.061280 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1105/2205] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:08:05 2022] PUT /identity/v3/projects/15332dc953844a65a14481b58d42d19b/users/a197bd611ae2409892c110bd5cd61dcb/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:08:06.072578 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d87d4a-015b-46b1-bc3c-0f85f2f3b8e5 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:06.072915 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d87d4a-015b-46b1-bc3c-0f85f2f3b8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:06.073113 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d87d4a-015b-46b1-bc3c-0f85f2f3b8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:06.107434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-f1d87d4a-015b-46b1-bc3c-0f85f2f3b8e5 None None] MFA Rules not processed for user `a197bd611ae2409892c110bd5cd61dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:08:06.109114 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f1d87d4a-015b-46b1-bc3c-0f85f2f3b8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:06.223294 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1101/2206] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:08:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:08:06.237502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ffe4e-bfe0-4004-bf2f-b9e1309613ed admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:06.239654 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0a9ffe4e-bfe0-4004-bf2f-b9e1309613ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:06.365773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ffe4e-bfe0-4004-bf2f-b9e1309613ed admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:06.369485 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24faa804-8fa5-4e32-871e-63f59a695cdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:06.370153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24faa804-8fa5-4e32-871e-63f59a695cdd service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:06.370434 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24faa804-8fa5-4e32-871e-63f59a695cdd service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:06.370708 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24faa804-8fa5-4e32-871e-63f59a695cdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:06.380457 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24faa804-8fa5-4e32-871e-63f59a695cdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:06.382042 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24faa804-8fa5-4e32-871e-63f59a695cdd service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:06.391457 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1106/2207] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:08:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:08:07.790827 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7967b3c-2658-43cd-a6b6-b530caf74464 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:07.791319 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7967b3c-2658-43cd-a6b6-b530caf74464 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:07.791411 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7967b3c-2658-43cd-a6b6-b530caf74464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:07.799880 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24faa804-8fa5-4e32-871e-63f59a695cdd service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:07.801483 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-24faa804-8fa5-4e32-871e-63f59a695cdd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:07.812366 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c7967b3c-2658-43cd-a6b6-b530caf74464 None None] MFA Rules not processed for user `a197bd611ae2409892c110bd5cd61dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:08:07.814308 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c7967b3c-2658-43cd-a6b6-b530caf74464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:07.821842 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24faa804-8fa5-4e32-871e-63f59a695cdd service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:07.823663 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1102/2208] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:08:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:08:07.826703 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a537bc-2d76-408b-b8b9-e130500ffc9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:07.827542 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a537bc-2d76-408b-b8b9-e130500ffc9c service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:07.827828 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a537bc-2d76-408b-b8b9-e130500ffc9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:07.828111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a537bc-2d76-408b-b8b9-e130500ffc9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:07.830528 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f6a537bc-2d76-408b-b8b9-e130500ffc9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:07.920644 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a537bc-2d76-408b-b8b9-e130500ffc9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:07.922040 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a537bc-2d76-408b-b8b9-e130500ffc9c service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:07.933073 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1107/2209] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:08:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:08:17.804993 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=48,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:08:17.928665 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=88,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:08:31.236263 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f7a4e-03fb-4c58-a2d5-aac5e41232b0 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:31.237359 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f7a4e-03fb-4c58-a2d5-aac5e41232b0 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:31.237893 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f7a4e-03fb-4c58-a2d5-aac5e41232b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:31.279428 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8d9f7a4e-03fb-4c58-a2d5-aac5e41232b0 None None] MFA Rules not processed for user `6d4c4b75552b4c739079f328a6efba40`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:08:31.280671 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8d9f7a4e-03fb-4c58-a2d5-aac5e41232b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:31.366842 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1103/2210] 10.222.0.35 () {58 vars in 1009 bytes} [Thu May 19 22:08:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:08:31.415345 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a537bc-2d76-408b-b8b9-e130500ffc9c service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:31.417430 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f6a537bc-2d76-408b-b8b9-e130500ffc9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:31.536190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a537bc-2d76-408b-b8b9-e130500ffc9c service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:31.541991 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25adbdb-0ec8-41c9-8cc4-22c928cf3441 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a4208619f84f16b735871ee114e660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:31.542549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25adbdb-0ec8-41c9-8cc4-22c928cf3441 service swift] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:31.542858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25adbdb-0ec8-41c9-8cc4-22c928cf3441 service swift] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:31.543157 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25adbdb-0ec8-41c9-8cc4-22c928cf3441 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:31.552917 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25adbdb-0ec8-41c9-8cc4-22c928cf3441 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:31.554538 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25adbdb-0ec8-41c9-8cc4-22c928cf3441 service swift] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:31.572472 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1108/2211] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 22:08:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 22:08:31.756122 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6cc3f-948d-4b25-a383-1238c16c5dcf None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:31.756469 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6cc3f-948d-4b25-a383-1238c16c5dcf None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:31.756763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6cc3f-948d-4b25-a383-1238c16c5dcf None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:31.758282 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1104/2212] 10.222.0.35 () {54 vars in 921 bytes} [Thu May 19 22:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:08:31.785114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a43a7e-8ea5-492b-97c0-30a2b27efd9f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:31.785447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a43a7e-8ea5-492b-97c0-30a2b27efd9f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:31.785686 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a43a7e-8ea5-492b-97c0-30a2b27efd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:31.836025 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6cc3f-948d-4b25-a383-1238c16c5dcf None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:31.838201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e3d6cc3f-948d-4b25-a383-1238c16c5dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:31.874481 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-41a43a7e-8ea5-492b-97c0-30a2b27efd9f None None] MFA Rules not processed for user `b1004beeeaed4af4a92c89ad31008b32`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:08:31.874481 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-41a43a7e-8ea5-492b-97c0-30a2b27efd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:31.965034 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6cc3f-948d-4b25-a383-1238c16c5dcf None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:31.970088 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424c211-5fdb-4ab4-a484-de661bf084e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:31.970969 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424c211-5fdb-4ab4-a484-de661bf084e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:31.971323 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424c211-5fdb-4ab4-a484-de661bf084e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:31.971514 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424c211-5fdb-4ab4-a484-de661bf084e4 admin admin] PATH_INFO: `/v3/users/18dad23d295e4d2797889a99114373e4` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:31.972118 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1109/2213] 10.222.0.35 () {58 vars in 1018 bytes} [Thu May 19 22:08:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:08:31.972793 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424c211-5fdb-4ab4-a484-de661bf084e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18dad23d295e4d2797889a99114373e4)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:31.975195 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424c211-5fdb-4ab4-a484-de661bf084e4 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:31.986510 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a43a7e-8ea5-492b-97c0-30a2b27efd9f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:31.989002 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-41a43a7e-8ea5-492b-97c0-30a2b27efd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:32.001508 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:08:32.006343 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a43a7e-8ea5-492b-97c0-30a2b27efd9f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:32.013253 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb07494-6554-4e8e-9d0c-374ea0af2c95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1004beeeaed4af4a92c89ad31008b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:32.013892 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb07494-6554-4e8e-9d0c-374ea0af2c95 service placement] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:32.014211 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb07494-6554-4e8e-9d0c-374ea0af2c95 service placement] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:32.014546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb07494-6554-4e8e-9d0c-374ea0af2c95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:32.025598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb07494-6554-4e8e-9d0c-374ea0af2c95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:32.027284 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb07494-6554-4e8e-9d0c-374ea0af2c95 service placement] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:32.029785 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:08:32.038829 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b424c211-5fdb-4ab4-a484-de661bf084e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18dad23d295e4d2797889a99114373e4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:32.039834 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1110/2214] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:08:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:08:32.049882 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b424c211-5fdb-4ab4-a484-de661bf084e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18dad23d295e4d2797889a99114373e4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:32.065017 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b424c211-5fdb-4ab4-a484-de661bf084e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18dad23d295e4d2797889a99114373e4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:32.065885 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b424c211-5fdb-4ab4-a484-de661bf084e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18dad23d295e4d2797889a99114373e4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:32.066747 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b424c211-5fdb-4ab4-a484-de661bf084e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18dad23d295e4d2797889a99114373e4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:32.093656 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1105/2215] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:08:31 2022] DELETE /identity/v3/users/18dad23d295e4d2797889a99114373e4 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:08:32.215213 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330701f-c8de-455f-8c55-74fcc5f42bde None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:32.215411 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330701f-c8de-455f-8c55-74fcc5f42bde None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:32.215628 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330701f-c8de-455f-8c55-74fcc5f42bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:32.235836 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6330701f-c8de-455f-8c55-74fcc5f42bde None None] MFA Rules not processed for user `6d4c4b75552b4c739079f328a6efba40`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:08:32.236892 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6330701f-c8de-455f-8c55-74fcc5f42bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:32.310371 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1111/2216] 10.222.0.35 () {58 vars in 967 bytes} [Thu May 19 22:08:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:08:32.324219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424c211-5fdb-4ab4-a484-de661bf084e4 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:32.326306 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b424c211-5fdb-4ab4-a484-de661bf084e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:32.333264 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330701f-c8de-455f-8c55-74fcc5f42bde None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:32.334737 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6330701f-c8de-455f-8c55-74fcc5f42bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:32.437168 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424c211-5fdb-4ab4-a484-de661bf084e4 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:32.441900 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330701f-c8de-455f-8c55-74fcc5f42bde None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:32.447024 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35627ef4-6038-4336-affa-4d186664339a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:32.448024 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35627ef4-6038-4336-affa-4d186664339a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:32.448368 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35627ef4-6038-4336-affa-4d186664339a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:32.448737 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35627ef4-6038-4336-affa-4d186664339a admin admin] PATH_INFO: `/v3/projects/989ebdbbd6114bb2998a6c31aa9579bd` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:32.450054 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35627ef4-6038-4336-affa-4d186664339a admin admin] RBAC: Authorizing `identity:delete_project(project_id=989ebdbbd6114bb2998a6c31aa9579bd)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:32.450211 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b674e4f-371b-427a-8f71-95e1e768c144 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a4208619f84f16b735871ee114e660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:32.450757 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b674e4f-371b-427a-8f71-95e1e768c144 service swift] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:32.451048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b674e4f-371b-427a-8f71-95e1e768c144 service swift] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:32.451325 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b674e4f-371b-427a-8f71-95e1e768c144 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:32.452316 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35627ef4-6038-4336-affa-4d186664339a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:32.462171 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b674e4f-371b-427a-8f71-95e1e768c144 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:32.463768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b674e4f-371b-427a-8f71-95e1e768c144 service swift] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:32.473024 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1106/2217] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 22:08:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 22:08:32.508690 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-35627ef4-6038-4336-affa-4d186664339a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '989ebdbbd6114bb2998a6c31aa9579bd', 'request_id': 'req-35627ef4-6038-4336-affa-4d186664339a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:32.517514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-35627ef4-6038-4336-affa-4d186664339a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '989ebdbbd6114bb2998a6c31aa9579bd', 'request_id': 'req-35627ef4-6038-4336-affa-4d186664339a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:32.524269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-35627ef4-6038-4336-affa-4d186664339a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '989ebdbbd6114bb2998a6c31aa9579bd', 'request_id': 'req-35627ef4-6038-4336-affa-4d186664339a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:32.537554 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-35627ef4-6038-4336-affa-4d186664339a admin admin] The token cache is being invalidate because project 989ebdbbd6114bb2998a6c31aa9579bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:08:32.537899 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-35627ef4-6038-4336-affa-4d186664339a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:32.538521 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-35627ef4-6038-4336-affa-4d186664339a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:32.540082 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1112/2218] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:08:32 2022] DELETE /identity/v3/projects/989ebdbbd6114bb2998a6c31aa9579bd => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:08:32.544788 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b674e4f-371b-427a-8f71-95e1e768c144 service swift] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:32.557294 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b674e4f-371b-427a-8f71-95e1e768c144 service swift] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:32.623032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c743508-8bfb-44b4-b76e-224a17c4d24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:32.624056 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c743508-8bfb-44b4-b76e-224a17c4d24f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:32.624339 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c743508-8bfb-44b4-b76e-224a17c4d24f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:32.624766 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c743508-8bfb-44b4-b76e-224a17c4d24f admin admin] PATH_INFO: `/v3/users/636ff2a569c34dadadfd5d9d704fb7f9` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:32.626933 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c743508-8bfb-44b4-b76e-224a17c4d24f admin admin] RBAC: Authorizing `identity:delete_user(user_id=636ff2a569c34dadadfd5d9d704fb7f9)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:32.636479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c743508-8bfb-44b4-b76e-224a17c4d24f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:32.689373 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7c743508-8bfb-44b4-b76e-224a17c4d24f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '636ff2a569c34dadadfd5d9d704fb7f9'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:32.692823 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:08:32.698834 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7c743508-8bfb-44b4-b76e-224a17c4d24f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '636ff2a569c34dadadfd5d9d704fb7f9'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:32.720524 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7c743508-8bfb-44b4-b76e-224a17c4d24f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '636ff2a569c34dadadfd5d9d704fb7f9'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:32.721712 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7c743508-8bfb-44b4-b76e-224a17c4d24f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '636ff2a569c34dadadfd5d9d704fb7f9'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:32.724175 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-7c743508-8bfb-44b4-b76e-224a17c4d24f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '636ff2a569c34dadadfd5d9d704fb7f9'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:32.740522 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bd882-2abf-43b9-8204-a05fe9254fbb None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:32.740765 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1107/2219] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:08:32 2022] DELETE /identity/v3/users/636ff2a569c34dadadfd5d9d704fb7f9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:08:32.743665 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bd882-2abf-43b9-8204-a05fe9254fbb None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:32.743988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bd882-2abf-43b9-8204-a05fe9254fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:32.763138 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-be2bd882-2abf-43b9-8204-a05fe9254fbb None None] MFA Rules not processed for user `6d4c4b75552b4c739079f328a6efba40`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:08:32.764382 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-be2bd882-2abf-43b9-8204-a05fe9254fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:32.786837 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:08:32.833262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1113/2220] 10.222.0.35 () {58 vars in 1009 bytes} [Thu May 19 22:08:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:08:32.845892 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c743508-8bfb-44b4-b76e-224a17c4d24f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:32.847341 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7c743508-8bfb-44b4-b76e-224a17c4d24f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:32.932688 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c743508-8bfb-44b4-b76e-224a17c4d24f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:32.941265 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bf30d-cfce-47f0-bd02-d3bb842631f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a4208619f84f16b735871ee114e660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:32.941937 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bf30d-cfce-47f0-bd02-d3bb842631f3 service swift] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:32.942218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bf30d-cfce-47f0-bd02-d3bb842631f3 service swift] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:32.942708 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bf30d-cfce-47f0-bd02-d3bb842631f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:32.955315 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20bf30d-cfce-47f0-bd02-d3bb842631f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:32.957187 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20bf30d-cfce-47f0-bd02-d3bb842631f3 service swift] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:32.968696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1108/2221] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 22:08:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 22:08:33.020261 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bd882-2abf-43b9-8204-a05fe9254fbb None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:33.022318 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-be2bd882-2abf-43b9-8204-a05fe9254fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:33.146176 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bd882-2abf-43b9-8204-a05fe9254fbb None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:33.151194 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb527b9-02e7-4f36-a02f-ea4d2353bdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:33.152140 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb527b9-02e7-4f36-a02f-ea4d2353bdba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:33.152454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb527b9-02e7-4f36-a02f-ea4d2353bdba admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:33.152736 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb527b9-02e7-4f36-a02f-ea4d2353bdba admin admin] PATH_INFO: `/v3/projects/ef188ab798804cd88719062e8dc2fb97` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:33.153969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb527b9-02e7-4f36-a02f-ea4d2353bdba admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef188ab798804cd88719062e8dc2fb97)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:33.155924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb527b9-02e7-4f36-a02f-ea4d2353bdba admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:33.218705 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ccb527b9-02e7-4f36-a02f-ea4d2353bdba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef188ab798804cd88719062e8dc2fb97', 'request_id': 'req-ccb527b9-02e7-4f36-a02f-ea4d2353bdba'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:33.227373 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ccb527b9-02e7-4f36-a02f-ea4d2353bdba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef188ab798804cd88719062e8dc2fb97', 'request_id': 'req-ccb527b9-02e7-4f36-a02f-ea4d2353bdba'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:33.237930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ccb527b9-02e7-4f36-a02f-ea4d2353bdba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef188ab798804cd88719062e8dc2fb97', 'request_id': 'req-ccb527b9-02e7-4f36-a02f-ea4d2353bdba'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:33.256211 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ccb527b9-02e7-4f36-a02f-ea4d2353bdba admin admin] The token cache is being invalidate because project ef188ab798804cd88719062e8dc2fb97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:08:33.256558 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ccb527b9-02e7-4f36-a02f-ea4d2353bdba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:33.258115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ccb527b9-02e7-4f36-a02f-ea4d2353bdba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:33.260330 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1114/2222] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:08:33 2022] DELETE /identity/v3/projects/ef188ab798804cd88719062e8dc2fb97 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:08:33.265032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6abe51-64bd-4941-8435-21fe19b1ff82 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:33.265322 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6abe51-64bd-4941-8435-21fe19b1ff82 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:33.265597 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6abe51-64bd-4941-8435-21fe19b1ff82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:33.325761 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6c6abe51-64bd-4941-8435-21fe19b1ff82 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:08:33.326882 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6c6abe51-64bd-4941-8435-21fe19b1ff82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:33.404183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1109/2223] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:08:33.412820 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722db210-9f7b-4a3e-b01e-3de6add9e005 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:33.413111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722db210-9f7b-4a3e-b01e-3de6add9e005 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:33.413391 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722db210-9f7b-4a3e-b01e-3de6add9e005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:33.416278 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2daf25-890a-4bf7-bddc-139d0d2ae8b7 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:33.416602 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2daf25-890a-4bf7-bddc-139d0d2ae8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:33.416884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2daf25-890a-4bf7-bddc-139d0d2ae8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:33.432725 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-722db210-9f7b-4a3e-b01e-3de6add9e005 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:08:33.434088 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-722db210-9f7b-4a3e-b01e-3de6add9e005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:33.435526 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0b2daf25-890a-4bf7-bddc-139d0d2ae8b7 None None] MFA Rules not processed for user `6d4c4b75552b4c739079f328a6efba40`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:08:33.436778 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0b2daf25-890a-4bf7-bddc-139d0d2ae8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:33.447635 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1115/2224] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:08:33.449123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722db210-9f7b-4a3e-b01e-3de6add9e005 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:33.461580 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722db210-9f7b-4a3e-b01e-3de6add9e005 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:33.467378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466a959-f33f-48b8-a8bf-768cb1dfc400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:33.468048 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466a959-f33f-48b8-a8bf-768cb1dfc400 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:33.468573 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466a959-f33f-48b8-a8bf-768cb1dfc400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:33.469146 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466a959-f33f-48b8-a8bf-768cb1dfc400 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:33.470625 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466a959-f33f-48b8-a8bf-768cb1dfc400 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:08:33.471114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466a959-f33f-48b8-a8bf-768cb1dfc400 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:33.472962 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466a959-f33f-48b8-a8bf-768cb1dfc400 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:33.474635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:08:33.487241 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1116/2225] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:08:33.491468 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466a959-f33f-48b8-a8bf-768cb1dfc400 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:33.504176 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466a959-f33f-48b8-a8bf-768cb1dfc400 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:33.508251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1110/2226] 10.222.0.35 () {58 vars in 967 bytes} [Thu May 19 22:08:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:08:33.509724 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65332b-9710-4626-b84d-703d1fcff799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:33.510518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65332b-9710-4626-b84d-703d1fcff799 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:33.510736 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65332b-9710-4626-b84d-703d1fcff799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:33.513482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65332b-9710-4626-b84d-703d1fcff799 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:33.513482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef65332b-9710-4626-b84d-703d1fcff799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:33.513992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef65332b-9710-4626-b84d-703d1fcff799 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:33.524532 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2daf25-890a-4bf7-bddc-139d0d2ae8b7 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:33.526257 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0b2daf25-890a-4bf7-bddc-139d0d2ae8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:33.548454 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1117/2227] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:08:33 2022] POST /identity/v3/projects => generated 357 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:08:33.550434 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65332b-9710-4626-b84d-703d1fcff799 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:33.577332 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:08:33.622760 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2daf25-890a-4bf7-bddc-139d0d2ae8b7 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:33.635767 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65332b-9710-4626-b84d-703d1fcff799 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:33.640758 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103b24c-0fc8-4343-97b5-008da2e2d387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:33.642024 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103b24c-0fc8-4343-97b5-008da2e2d387 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:33.642316 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103b24c-0fc8-4343-97b5-008da2e2d387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:33.642597 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103b24c-0fc8-4343-97b5-008da2e2d387 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:33.643315 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103b24c-0fc8-4343-97b5-008da2e2d387 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:33.645506 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103b24c-0fc8-4343-97b5-008da2e2d387 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:33.680826 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1118/2228] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:08:33 2022] POST /identity/v3/users => generated 279 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:08:33.681719 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103b24c-0fc8-4343-97b5-008da2e2d387 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:33.706076 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103b24c-0fc8-4343-97b5-008da2e2d387 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:33.708207 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1cbc1-ec72-4508-b57f-b41f797f427c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a4208619f84f16b735871ee114e660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:33.708923 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1cbc1-ec72-4508-b57f-b41f797f427c service swift] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:33.709212 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1cbc1-ec72-4508-b57f-b41f797f427c service swift] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:33.709578 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1cbc1-ec72-4508-b57f-b41f797f427c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:33.710720 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84c1e5-09bf-42e7-9b07-eac8049fd112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:33.711384 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84c1e5-09bf-42e7-9b07-eac8049fd112 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:33.711699 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84c1e5-09bf-42e7-9b07-eac8049fd112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:33.711981 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84c1e5-09bf-42e7-9b07-eac8049fd112 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:33.712743 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84c1e5-09bf-42e7-9b07-eac8049fd112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:33.714365 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84c1e5-09bf-42e7-9b07-eac8049fd112 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:33.729457 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1119/2229] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:08:33.730658 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84c1e5-09bf-42e7-9b07-eac8049fd112 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:33.741356 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84c1e5-09bf-42e7-9b07-eac8049fd112 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:33.755562 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4882d-d182-430f-8531-f06a9359125d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:33.756254 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4882d-d182-430f-8531-f06a9359125d admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:33.756577 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4882d-d182-430f-8531-f06a9359125d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:33.756857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4882d-d182-430f-8531-f06a9359125d admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:33.757603 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4882d-d182-430f-8531-f06a9359125d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:33.759244 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4882d-d182-430f-8531-f06a9359125d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:33.771274 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1120/2230] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:08:33.776295 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4882d-d182-430f-8531-f06a9359125d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:33.776482 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1cbc1-ec72-4508-b57f-b41f797f427c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:33.778079 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1cbc1-ec72-4508-b57f-b41f797f427c service swift] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:33.787308 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4882d-d182-430f-8531-f06a9359125d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:33.792048 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c5e7d-c42d-45be-b22d-7ab70526f04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:33.792960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c5e7d-c42d-45be-b22d-7ab70526f04f admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:33.793240 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c5e7d-c42d-45be-b22d-7ab70526f04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:33.793516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c5e7d-c42d-45be-b22d-7ab70526f04f admin admin] PATH_INFO: `/v3/projects/12e2438922a5492c9c830fbb1bfc561f/users/492e8acfff5b49538ea9ed1a54851df8/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:33.794149 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1111/2231] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 22:08:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 19 22:08:33.814727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c5e7d-c42d-45be-b22d-7ab70526f04f admin admin] RBAC: Authorizing `identity:create_grant(project_id=12e2438922a5492c9c830fbb1bfc561f, user_id=492e8acfff5b49538ea9ed1a54851df8, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:33.817520 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c5e7d-c42d-45be-b22d-7ab70526f04f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:33.832192 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1121/2232] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:08:33 2022] PUT /identity/v3/projects/12e2438922a5492c9c830fbb1bfc561f/users/492e8acfff5b49538ea9ed1a54851df8/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:08:33.842261 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ff190-66a0-4d9a-bc78-f87db55dbd1a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:33.843170 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ff190-66a0-4d9a-bc78-f87db55dbd1a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:33.843596 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ff190-66a0-4d9a-bc78-f87db55dbd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:33.879761 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-f81ff190-66a0-4d9a-bc78-f87db55dbd1a None None] MFA Rules not processed for user `492e8acfff5b49538ea9ed1a54851df8`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:08:33.881012 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f81ff190-66a0-4d9a-bc78-f87db55dbd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:33.893746 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:08:33.971341 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1112/2233] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:08:33 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:08:34.000211 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c5e7d-c42d-45be-b22d-7ab70526f04f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:34.002666 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0e7c5e7d-c42d-45be-b22d-7ab70526f04f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:34.094675 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c5e7d-c42d-45be-b22d-7ab70526f04f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:34.102739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40404633-0a02-4266-b914-b607af79d739 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:34.103649 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40404633-0a02-4266-b914-b607af79d739 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:34.104001 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40404633-0a02-4266-b914-b607af79d739 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:34.104358 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40404633-0a02-4266-b914-b607af79d739 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:34.125515 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40404633-0a02-4266-b914-b607af79d739 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:34.126917 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40404633-0a02-4266-b914-b607af79d739 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:34.144062 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1122/2234] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:08:33 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:08:34.161495 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ff190-66a0-4d9a-bc78-f87db55dbd1a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:34.251480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ff190-66a0-4d9a-bc78-f87db55dbd1a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:34.256978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edc248-4ccb-4167-90da-e4d86f8ae492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:34.257875 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edc248-4ccb-4167-90da-e4d86f8ae492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:34.258161 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edc248-4ccb-4167-90da-e4d86f8ae492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:34.258446 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edc248-4ccb-4167-90da-e4d86f8ae492 admin admin] PATH_INFO: `/v3/users/492e8acfff5b49538ea9ed1a54851df8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:34.259683 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edc248-4ccb-4167-90da-e4d86f8ae492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=492e8acfff5b49538ea9ed1a54851df8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:34.261736 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edc248-4ccb-4167-90da-e4d86f8ae492 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:34.316004 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-34edc248-4ccb-4167-90da-e4d86f8ae492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '492e8acfff5b49538ea9ed1a54851df8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:34.325997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-34edc248-4ccb-4167-90da-e4d86f8ae492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '492e8acfff5b49538ea9ed1a54851df8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:34.339927 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-34edc248-4ccb-4167-90da-e4d86f8ae492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '492e8acfff5b49538ea9ed1a54851df8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:34.340782 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-34edc248-4ccb-4167-90da-e4d86f8ae492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '492e8acfff5b49538ea9ed1a54851df8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:34.341394 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-34edc248-4ccb-4167-90da-e4d86f8ae492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '492e8acfff5b49538ea9ed1a54851df8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:34.354700 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1113/2235] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:08:34 2022] DELETE /identity/v3/users/492e8acfff5b49538ea9ed1a54851df8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:08:34.359324 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3a233-6156-4ad6-958d-c2a42ecc3a16 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:34.359734 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3a233-6156-4ad6-958d-c2a42ecc3a16 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:34.360581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3a233-6156-4ad6-958d-c2a42ecc3a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:34.379100 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-fdd3a233-6156-4ad6-958d-c2a42ecc3a16 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:08:34.380330 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-fdd3a233-6156-4ad6-958d-c2a42ecc3a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:34.456171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1123/2236] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:08:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:08:34.466380 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edc248-4ccb-4167-90da-e4d86f8ae492 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:34.467795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-34edc248-4ccb-4167-90da-e4d86f8ae492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:34.519832 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:08:34.569205 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edc248-4ccb-4167-90da-e4d86f8ae492 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:34.572859 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7838d4-591a-4e5e-b8b7-c7414de9ea34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:34.573508 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7838d4-591a-4e5e-b8b7-c7414de9ea34 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:34.573791 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7838d4-591a-4e5e-b8b7-c7414de9ea34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:34.574067 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7838d4-591a-4e5e-b8b7-c7414de9ea34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:34.585031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7838d4-591a-4e5e-b8b7-c7414de9ea34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:34.586508 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7838d4-591a-4e5e-b8b7-c7414de9ea34 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:34.598348 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1114/2237] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:08:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:08:34.935985 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3a233-6156-4ad6-958d-c2a42ecc3a16 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:34.937257 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-fdd3a233-6156-4ad6-958d-c2a42ecc3a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:34.955313 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3a233-6156-4ad6-958d-c2a42ecc3a16 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:34.961091 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc47ac-e15d-44f8-81cc-815461f8a441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:34.962138 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc47ac-e15d-44f8-81cc-815461f8a441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:34.962460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc47ac-e15d-44f8-81cc-815461f8a441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:34.962746 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc47ac-e15d-44f8-81cc-815461f8a441 admin admin] PATH_INFO: `/v3/projects/12e2438922a5492c9c830fbb1bfc561f` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:34.964019 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc47ac-e15d-44f8-81cc-815461f8a441 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12e2438922a5492c9c830fbb1bfc561f)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:34.966264 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc47ac-e15d-44f8-81cc-815461f8a441 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:34.968121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:08:35.027082 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cedc47ac-e15d-44f8-81cc-815461f8a441 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12e2438922a5492c9c830fbb1bfc561f', 'request_id': 'req-cedc47ac-e15d-44f8-81cc-815461f8a441'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:35.035201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cedc47ac-e15d-44f8-81cc-815461f8a441 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12e2438922a5492c9c830fbb1bfc561f', 'request_id': 'req-cedc47ac-e15d-44f8-81cc-815461f8a441'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:35.041846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cedc47ac-e15d-44f8-81cc-815461f8a441 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12e2438922a5492c9c830fbb1bfc561f', 'request_id': 'req-cedc47ac-e15d-44f8-81cc-815461f8a441'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:35.055091 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cedc47ac-e15d-44f8-81cc-815461f8a441 admin admin] The token cache is being invalidate because project 12e2438922a5492c9c830fbb1bfc561f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:08:35.055387 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cedc47ac-e15d-44f8-81cc-815461f8a441 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:35.056046 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-cedc47ac-e15d-44f8-81cc-815461f8a441 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:35.057629 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1124/2238] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:08:34 2022] DELETE /identity/v3/projects/12e2438922a5492c9c830fbb1bfc561f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:08:35.062427 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb97cb1-0296-47b4-a567-5bd5fd24ace2 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:35.063378 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb97cb1-0296-47b4-a567-5bd5fd24ace2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:35.063805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb97cb1-0296-47b4-a567-5bd5fd24ace2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:35.084814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0cb97cb1-0296-47b4-a567-5bd5fd24ace2 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:08:35.086053 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0cb97cb1-0296-47b4-a567-5bd5fd24ace2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:35.152488 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1115/2239] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:08:35.163132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a367dd2-3dde-4075-896d-38d00e57316c None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:35.163418 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a367dd2-3dde-4075-896d-38d00e57316c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:35.163746 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a367dd2-3dde-4075-896d-38d00e57316c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:35.184901 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-5a367dd2-3dde-4075-896d-38d00e57316c None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:08:35.186341 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5a367dd2-3dde-4075-896d-38d00e57316c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:35.196080 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1125/2240] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:08:35.200523 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb97cb1-0296-47b4-a567-5bd5fd24ace2 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:35.211710 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb97cb1-0296-47b4-a567-5bd5fd24ace2 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:35.217368 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f87c7-c523-48ad-80b5-a1abcacba96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:35.218301 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f87c7-c523-48ad-80b5-a1abcacba96f admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:35.218609 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f87c7-c523-48ad-80b5-a1abcacba96f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:35.218890 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f87c7-c523-48ad-80b5-a1abcacba96f admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:35.219677 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f87c7-c523-48ad-80b5-a1abcacba96f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:08:35.220029 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f87c7-c523-48ad-80b5-a1abcacba96f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:35.221904 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f87c7-c523-48ad-80b5-a1abcacba96f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:35.235440 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1116/2241] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:08:35.240045 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a367dd2-3dde-4075-896d-38d00e57316c None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:35.249707 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a367dd2-3dde-4075-896d-38d00e57316c None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:35.255694 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656cad9-92d5-46ea-9b87-4d289485f191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:35.256581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656cad9-92d5-46ea-9b87-4d289485f191 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:35.257036 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656cad9-92d5-46ea-9b87-4d289485f191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:35.257152 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656cad9-92d5-46ea-9b87-4d289485f191 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:35.257837 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656cad9-92d5-46ea-9b87-4d289485f191 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:35.259816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656cad9-92d5-46ea-9b87-4d289485f191 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:35.286203 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1126/2242] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:08:35 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:08:35.290420 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f87c7-c523-48ad-80b5-a1abcacba96f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:35.301186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f87c7-c523-48ad-80b5-a1abcacba96f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:35.379244 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47ddfb-7e09-4e09-89f0-36ac7a0626a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:35.379918 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47ddfb-7e09-4e09-89f0-36ac7a0626a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:35.380204 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47ddfb-7e09-4e09-89f0-36ac7a0626a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:35.380520 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47ddfb-7e09-4e09-89f0-36ac7a0626a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:35.381214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47ddfb-7e09-4e09-89f0-36ac7a0626a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:35.383133 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47ddfb-7e09-4e09-89f0-36ac7a0626a6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:35.402829 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1117/2243] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:08:35 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:08:35.407136 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656cad9-92d5-46ea-9b87-4d289485f191 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:35.421956 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656cad9-92d5-46ea-9b87-4d289485f191 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:35.427343 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1d12b-b8db-481e-a1f9-b0f4c8c63e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:35.428019 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1d12b-b8db-481e-a1f9-b0f4c8c63e89 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:35.428305 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1d12b-b8db-481e-a1f9-b0f4c8c63e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:35.428615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1d12b-b8db-481e-a1f9-b0f4c8c63e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:35.429347 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1d12b-b8db-481e-a1f9-b0f4c8c63e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:35.430968 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1d12b-b8db-481e-a1f9-b0f4c8c63e89 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:35.442943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1127/2244] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:08:35.446872 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47ddfb-7e09-4e09-89f0-36ac7a0626a6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:35.457048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47ddfb-7e09-4e09-89f0-36ac7a0626a6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:35.461816 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c5759-7546-474b-9b73-b01e3e712cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:35.462536 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c5759-7546-474b-9b73-b01e3e712cbc admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:35.462825 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c5759-7546-474b-9b73-b01e3e712cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:35.463108 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c5759-7546-474b-9b73-b01e3e712cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:35.463862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c5759-7546-474b-9b73-b01e3e712cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:35.465555 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c5759-7546-474b-9b73-b01e3e712cbc admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:35.478646 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1118/2245] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:08:35.482933 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1d12b-b8db-481e-a1f9-b0f4c8c63e89 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:35.493766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1d12b-b8db-481e-a1f9-b0f4c8c63e89 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:35.505143 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c2fc0-b172-4d7c-97cf-84ab7a41d0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:35.505970 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c2fc0-b172-4d7c-97cf-84ab7a41d0e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:35.506252 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c2fc0-b172-4d7c-97cf-84ab7a41d0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:35.506528 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c2fc0-b172-4d7c-97cf-84ab7a41d0e1 admin admin] PATH_INFO: `/v3/projects/1ad157bf53f04e5983adbde7e5eb5953/users/672b89d33c114c62b289843760888d77/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:35.525431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c2fc0-b172-4d7c-97cf-84ab7a41d0e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ad157bf53f04e5983adbde7e5eb5953, user_id=672b89d33c114c62b289843760888d77, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:35.528315 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c2fc0-b172-4d7c-97cf-84ab7a41d0e1 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:35.543624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1128/2246] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:08:35 2022] PUT /identity/v3/projects/1ad157bf53f04e5983adbde7e5eb5953/users/672b89d33c114c62b289843760888d77/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:08:35.554484 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a2f21-337a-424a-a011-33bfb6201c5b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:35.554769 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a2f21-337a-424a-a011-33bfb6201c5b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:35.555045 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a2f21-337a-424a-a011-33bfb6201c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:35.584164 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c49a2f21-337a-424a-a011-33bfb6201c5b None None] MFA Rules not processed for user `672b89d33c114c62b289843760888d77`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:08:35.585436 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c49a2f21-337a-424a-a011-33bfb6201c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:35.595678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:08:35.654588 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1119/2247] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:08:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:08:35.666922 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c2fc0-b172-4d7c-97cf-84ab7a41d0e1 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:35.668724 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6e5c2fc0-b172-4d7c-97cf-84ab7a41d0e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:35.728684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c2fc0-b172-4d7c-97cf-84ab7a41d0e1 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:35.732535 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea39095-0a2f-45b5-beb7-5782517646fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:35.733200 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea39095-0a2f-45b5-beb7-5782517646fd service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:35.733487 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea39095-0a2f-45b5-beb7-5782517646fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:35.733766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea39095-0a2f-45b5-beb7-5782517646fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:35.743558 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea39095-0a2f-45b5-beb7-5782517646fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:35.745108 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea39095-0a2f-45b5-beb7-5782517646fd service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:35.754485 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1129/2248] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:08:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:08:36.065941 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a2f21-337a-424a-a011-33bfb6201c5b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:36.069457 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c49a2f21-337a-424a-a011-33bfb6201c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:36.153965 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a2f21-337a-424a-a011-33bfb6201c5b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:36.159725 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d991a-30d2-41f3-a198-fc7788b5b3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:36.160650 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d991a-30d2-41f3-a198-fc7788b5b3fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:36.160927 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d991a-30d2-41f3-a198-fc7788b5b3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:36.161210 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d991a-30d2-41f3-a198-fc7788b5b3fa admin admin] PATH_INFO: `/v3/users/a197bd611ae2409892c110bd5cd61dcb` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:36.162411 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d991a-30d2-41f3-a198-fc7788b5b3fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a197bd611ae2409892c110bd5cd61dcb)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:36.164335 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d991a-30d2-41f3-a198-fc7788b5b3fa admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:36.224590 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1d8d991a-30d2-41f3-a198-fc7788b5b3fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a197bd611ae2409892c110bd5cd61dcb'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:36.232526 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1d8d991a-30d2-41f3-a198-fc7788b5b3fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a197bd611ae2409892c110bd5cd61dcb'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:36.257723 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1d8d991a-30d2-41f3-a198-fc7788b5b3fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a197bd611ae2409892c110bd5cd61dcb'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:36.258559 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1d8d991a-30d2-41f3-a198-fc7788b5b3fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a197bd611ae2409892c110bd5cd61dcb'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:36.259200 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1d8d991a-30d2-41f3-a198-fc7788b5b3fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a197bd611ae2409892c110bd5cd61dcb'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:36.274533 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1120/2249] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:08:36 2022] DELETE /identity/v3/users/a197bd611ae2409892c110bd5cd61dcb => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:08:36.280745 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620ebdc-856e-4398-9d86-9b8768c62979 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:36.281327 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620ebdc-856e-4398-9d86-9b8768c62979 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:36.281672 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620ebdc-856e-4398-9d86-9b8768c62979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:36.302522 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-7620ebdc-856e-4398-9d86-9b8768c62979 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:08:36.303788 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7620ebdc-856e-4398-9d86-9b8768c62979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:36.338589 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:08:36.392191 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1130/2250] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:08:36.404842 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d991a-30d2-41f3-a198-fc7788b5b3fa admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:36.407259 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1d8d991a-30d2-41f3-a198-fc7788b5b3fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:36.445542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:08:36.473706 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d991a-30d2-41f3-a198-fc7788b5b3fa admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:36.477461 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad20e40-a896-45b0-af0e-27c51cd8d24b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:36.478177 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad20e40-a896-45b0-af0e-27c51cd8d24b service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:36.478523 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad20e40-a896-45b0-af0e-27c51cd8d24b service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:36.478862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad20e40-a896-45b0-af0e-27c51cd8d24b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:36.488974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad20e40-a896-45b0-af0e-27c51cd8d24b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:36.490488 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad20e40-a896-45b0-af0e-27c51cd8d24b service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:36.509753 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1121/2251] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:08:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:08:36.695265 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620ebdc-856e-4398-9d86-9b8768c62979 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:36.697045 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7620ebdc-856e-4398-9d86-9b8768c62979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:36.713731 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620ebdc-856e-4398-9d86-9b8768c62979 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:36.721035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11770f35-eece-4c20-8c60-7db6d50b18b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:36.722584 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11770f35-eece-4c20-8c60-7db6d50b18b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:36.722867 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11770f35-eece-4c20-8c60-7db6d50b18b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:36.723271 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11770f35-eece-4c20-8c60-7db6d50b18b3 admin admin] PATH_INFO: `/v3/projects/15332dc953844a65a14481b58d42d19b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:36.724680 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11770f35-eece-4c20-8c60-7db6d50b18b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15332dc953844a65a14481b58d42d19b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:36.727079 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11770f35-eece-4c20-8c60-7db6d50b18b3 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:36.783077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-11770f35-eece-4c20-8c60-7db6d50b18b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15332dc953844a65a14481b58d42d19b', 'request_id': 'req-11770f35-eece-4c20-8c60-7db6d50b18b3'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:36.791221 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-11770f35-eece-4c20-8c60-7db6d50b18b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15332dc953844a65a14481b58d42d19b', 'request_id': 'req-11770f35-eece-4c20-8c60-7db6d50b18b3'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:36.798637 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-11770f35-eece-4c20-8c60-7db6d50b18b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15332dc953844a65a14481b58d42d19b', 'request_id': 'req-11770f35-eece-4c20-8c60-7db6d50b18b3'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:36.810791 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-11770f35-eece-4c20-8c60-7db6d50b18b3 admin admin] The token cache is being invalidate because project 15332dc953844a65a14481b58d42d19b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:08:36.811085 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-11770f35-eece-4c20-8c60-7db6d50b18b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:36.811785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-11770f35-eece-4c20-8c60-7db6d50b18b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:36.814197 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1131/2252] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:08:36 2022] DELETE /identity/v3/projects/15332dc953844a65a14481b58d42d19b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:08:42.680423 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1710ae2-2495-4f54-abee-7dfeb51fbd7c None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:42.680950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1710ae2-2495-4f54-abee-7dfeb51fbd7c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:42.681050 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1710ae2-2495-4f54-abee-7dfeb51fbd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:42.698765 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b1710ae2-2495-4f54-abee-7dfeb51fbd7c None None] MFA Rules not processed for user `c9e6e9d4d6cb499cbd4c886534176b66`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:08:42.699976 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b1710ae2-2495-4f54-abee-7dfeb51fbd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:42.759068 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1122/2253] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:08:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:08:46.806786 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=41,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:08:49.470387 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11770f35-eece-4c20-8c60-7db6d50b18b3 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:49.471823 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-11770f35-eece-4c20-8c60-7db6d50b18b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:49.544543 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11770f35-eece-4c20-8c60-7db6d50b18b3 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:49.549614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bf6db-340a-4253-902e-db7cd1329a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:49.550527 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bf6db-340a-4253-902e-db7cd1329a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:49.550806 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bf6db-340a-4253-902e-db7cd1329a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:49.551085 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bf6db-340a-4253-902e-db7cd1329a23 admin admin] PATH_INFO: `/v3/users/672b89d33c114c62b289843760888d77` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:49.552366 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8bf6db-340a-4253-902e-db7cd1329a23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=672b89d33c114c62b289843760888d77)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:49.554361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8bf6db-340a-4253-902e-db7cd1329a23 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:49.614606 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5a8bf6db-340a-4253-902e-db7cd1329a23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '672b89d33c114c62b289843760888d77'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:49.622436 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5a8bf6db-340a-4253-902e-db7cd1329a23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '672b89d33c114c62b289843760888d77'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:49.623193 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5a8bf6db-340a-4253-902e-db7cd1329a23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '672b89d33c114c62b289843760888d77'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:49.637237 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5a8bf6db-340a-4253-902e-db7cd1329a23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '672b89d33c114c62b289843760888d77'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:49.658045 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5a8bf6db-340a-4253-902e-db7cd1329a23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '672b89d33c114c62b289843760888d77'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:49.665843 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1132/2254] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:08:49 2022] DELETE /identity/v3/users/672b89d33c114c62b289843760888d77 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:08:49.671683 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43046508-0d29-459d-868e-8b53f6f60b6a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:49.672234 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43046508-0d29-459d-868e-8b53f6f60b6a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:49.672633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43046508-0d29-459d-868e-8b53f6f60b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:49.693496 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-43046508-0d29-459d-868e-8b53f6f60b6a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:08:49.694752 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-43046508-0d29-459d-868e-8b53f6f60b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:49.770007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1123/2255] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:08:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:08:49.780040 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bf6db-340a-4253-902e-db7cd1329a23 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:49.781367 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5a8bf6db-340a-4253-902e-db7cd1329a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:49.849871 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bf6db-340a-4253-902e-db7cd1329a23 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:49.853787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503bac8c-81ee-436a-96c2-0caf312f7dc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:49.854505 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bac8c-81ee-436a-96c2-0caf312f7dc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:49.854793 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bac8c-81ee-436a-96c2-0caf312f7dc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:49.855073 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bac8c-81ee-436a-96c2-0caf312f7dc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:49.865568 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503bac8c-81ee-436a-96c2-0caf312f7dc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:49.867084 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503bac8c-81ee-436a-96c2-0caf312f7dc5 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:49.878134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1133/2256] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:08:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:08:50.157322 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43046508-0d29-459d-868e-8b53f6f60b6a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:50.158481 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-43046508-0d29-459d-868e-8b53f6f60b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:50.179968 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43046508-0d29-459d-868e-8b53f6f60b6a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:50.184960 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c32b7-30a1-48ec-a67e-18d5d570aa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:50.185948 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c32b7-30a1-48ec-a67e-18d5d570aa39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:50.186243 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c32b7-30a1-48ec-a67e-18d5d570aa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:50.186564 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c32b7-30a1-48ec-a67e-18d5d570aa39 admin admin] PATH_INFO: `/v3/projects/1ad157bf53f04e5983adbde7e5eb5953` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:50.187878 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c32b7-30a1-48ec-a67e-18d5d570aa39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ad157bf53f04e5983adbde7e5eb5953)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:50.189978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c32b7-30a1-48ec-a67e-18d5d570aa39 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:50.245008 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a71c32b7-30a1-48ec-a67e-18d5d570aa39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ad157bf53f04e5983adbde7e5eb5953', 'request_id': 'req-a71c32b7-30a1-48ec-a67e-18d5d570aa39'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:50.251783 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a71c32b7-30a1-48ec-a67e-18d5d570aa39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ad157bf53f04e5983adbde7e5eb5953', 'request_id': 'req-a71c32b7-30a1-48ec-a67e-18d5d570aa39'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:50.261291 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a71c32b7-30a1-48ec-a67e-18d5d570aa39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ad157bf53f04e5983adbde7e5eb5953', 'request_id': 'req-a71c32b7-30a1-48ec-a67e-18d5d570aa39'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:50.282241 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a71c32b7-30a1-48ec-a67e-18d5d570aa39 admin admin] The token cache is being invalidate because project 1ad157bf53f04e5983adbde7e5eb5953 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:08:50.282541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a71c32b7-30a1-48ec-a67e-18d5d570aa39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:50.283490 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a71c32b7-30a1-48ec-a67e-18d5d570aa39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:08:50.285202 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1124/2257] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:08:50 2022] DELETE /identity/v3/projects/1ad157bf53f04e5983adbde7e5eb5953 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:08:50.290155 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6267d8d-b74c-4c29-bdc9-fb3a552ab8bc None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:50.290447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6267d8d-b74c-4c29-bdc9-fb3a552ab8bc None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:50.290729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6267d8d-b74c-4c29-bdc9-fb3a552ab8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:50.310678 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-f6267d8d-b74c-4c29-bdc9-fb3a552ab8bc None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:08:50.312210 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f6267d8d-b74c-4c29-bdc9-fb3a552ab8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:50.335963 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:08:50.404789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1134/2258] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:08:50.413481 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333331bf-bb76-4ba4-a5ff-1cf7abcb619a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:50.413845 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333331bf-bb76-4ba4-a5ff-1cf7abcb619a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:50.414289 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333331bf-bb76-4ba4-a5ff-1cf7abcb619a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:50.421435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:08:50.441311 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-333331bf-bb76-4ba4-a5ff-1cf7abcb619a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:08:50.442557 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-333331bf-bb76-4ba4-a5ff-1cf7abcb619a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:50.452371 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1125/2259] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:08:50.457289 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6267d8d-b74c-4c29-bdc9-fb3a552ab8bc None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:50.467052 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6267d8d-b74c-4c29-bdc9-fb3a552ab8bc None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:50.473439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3e710-4078-45ef-a90a-ad0be3cdf2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:50.474233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3e710-4078-45ef-a90a-ad0be3cdf2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:50.474901 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3e710-4078-45ef-a90a-ad0be3cdf2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:50.474901 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3e710-4078-45ef-a90a-ad0be3cdf2b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:50.475971 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3e710-4078-45ef-a90a-ad0be3cdf2b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:08:50.476224 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3e710-4078-45ef-a90a-ad0be3cdf2b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:50.478786 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3e710-4078-45ef-a90a-ad0be3cdf2b7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:50.495353 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1135/2260] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:08:50.499689 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333331bf-bb76-4ba4-a5ff-1cf7abcb619a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:50.513650 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333331bf-bb76-4ba4-a5ff-1cf7abcb619a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:50.519204 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d1017-2009-465e-abaf-9f797fd8d29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:50.519942 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d1017-2009-465e-abaf-9f797fd8d29f admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:50.520608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d1017-2009-465e-abaf-9f797fd8d29f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:50.520608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d1017-2009-465e-abaf-9f797fd8d29f admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:50.521418 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d1017-2009-465e-abaf-9f797fd8d29f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:50.523629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d1017-2009-465e-abaf-9f797fd8d29f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:50.553634 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1126/2261] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:08:50 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:08:50.557992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3e710-4078-45ef-a90a-ad0be3cdf2b7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:50.570123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3e710-4078-45ef-a90a-ad0be3cdf2b7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:50.630771 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfbec9-db36-47da-b3ee-8e37b079ca7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:50.631438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfbec9-db36-47da-b3ee-8e37b079ca7b admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:50.631718 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfbec9-db36-47da-b3ee-8e37b079ca7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:50.631992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfbec9-db36-47da-b3ee-8e37b079ca7b admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:50.632708 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dfbec9-db36-47da-b3ee-8e37b079ca7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:50.634717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dfbec9-db36-47da-b3ee-8e37b079ca7b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:50.658845 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1136/2262] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:08:50 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:08:50.663195 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d1017-2009-465e-abaf-9f797fd8d29f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:50.673637 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d1017-2009-465e-abaf-9f797fd8d29f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:50.678357 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d929e6-360a-4c44-91e4-5cd96df716be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:50.679024 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d929e6-360a-4c44-91e4-5cd96df716be admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:50.679319 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d929e6-360a-4c44-91e4-5cd96df716be admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:50.679588 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d929e6-360a-4c44-91e4-5cd96df716be admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:50.680330 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d929e6-360a-4c44-91e4-5cd96df716be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:50.681968 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d929e6-360a-4c44-91e4-5cd96df716be admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:50.693971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1127/2263] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:08:50.698249 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfbec9-db36-47da-b3ee-8e37b079ca7b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:50.709386 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfbec9-db36-47da-b3ee-8e37b079ca7b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:50.714306 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7beb54-a1b9-44e3-a566-d3745063d1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:50.714967 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7beb54-a1b9-44e3-a566-d3745063d1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:50.715256 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7beb54-a1b9-44e3-a566-d3745063d1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:50.715538 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7beb54-a1b9-44e3-a566-d3745063d1d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:50.716268 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7beb54-a1b9-44e3-a566-d3745063d1d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:50.717959 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7beb54-a1b9-44e3-a566-d3745063d1d4 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:50.728372 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1137/2264] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:08:50.732649 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d929e6-360a-4c44-91e4-5cd96df716be admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:50.752965 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d929e6-360a-4c44-91e4-5cd96df716be admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:50.757769 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369236a-a402-4fb8-8d59-b1cd7eabafb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:50.758678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369236a-a402-4fb8-8d59-b1cd7eabafb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:50.758964 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369236a-a402-4fb8-8d59-b1cd7eabafb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:50.759244 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369236a-a402-4fb8-8d59-b1cd7eabafb7 admin admin] PATH_INFO: `/v3/projects/e21a73cb0ab04cc4ba4a837154a65002/users/593d00956939421497a7a7628406b333/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:50.781499 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369236a-a402-4fb8-8d59-b1cd7eabafb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e21a73cb0ab04cc4ba4a837154a65002, user_id=593d00956939421497a7a7628406b333, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:50.784232 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369236a-a402-4fb8-8d59-b1cd7eabafb7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:50.798755 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1128/2265] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:08:50 2022] PUT /identity/v3/projects/e21a73cb0ab04cc4ba4a837154a65002/users/593d00956939421497a7a7628406b333/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:08:50.808927 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42618d-7a17-4287-ac5e-b0b49dfb406e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:50.809221 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42618d-7a17-4287-ac5e-b0b49dfb406e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:50.809507 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42618d-7a17-4287-ac5e-b0b49dfb406e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:50.837405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-8e42618d-7a17-4287-ac5e-b0b49dfb406e None None] MFA Rules not processed for user `593d00956939421497a7a7628406b333`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:08:50.838636 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8e42618d-7a17-4287-ac5e-b0b49dfb406e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:50.911441 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1138/2266] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:08:50 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:08:50.922981 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369236a-a402-4fb8-8d59-b1cd7eabafb7 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:08:50.925220 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7369236a-a402-4fb8-8d59-b1cd7eabafb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:08:50.983044 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369236a-a402-4fb8-8d59-b1cd7eabafb7 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:08:50.987309 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef4b34-1be9-49a6-b3ae-071fe671182e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf64f4ec145742d78eee6c4a447515dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:08:50.988061 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef4b34-1be9-49a6-b3ae-071fe671182e service glance] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:08:50.988315 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef4b34-1be9-49a6-b3ae-071fe671182e service glance] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:08:50.989814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef4b34-1be9-49a6-b3ae-071fe671182e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:08:50.997551 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef4b34-1be9-49a6-b3ae-071fe671182e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:08:50.999070 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef4b34-1be9-49a6-b3ae-071fe671182e service glance] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:08:51.010839 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1129/2267] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:08:50 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:09:00.907713 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:09:01.005557 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=52,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:09:20.036108 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42618d-7a17-4287-ac5e-b0b49dfb406e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:09:20.104144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42618d-7a17-4287-ac5e-b0b49dfb406e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:09:20.108822 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48e878-64c0-49ae-9403-9a5a09c46c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:09:20.109705 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48e878-64c0-49ae-9403-9a5a09c46c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:20.109991 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48e878-64c0-49ae-9403-9a5a09c46c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:20.110271 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48e878-64c0-49ae-9403-9a5a09c46c1e admin admin] PATH_INFO: `/v3/users/593d00956939421497a7a7628406b333` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:20.111473 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48e878-64c0-49ae-9403-9a5a09c46c1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=593d00956939421497a7a7628406b333)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:09:20.113513 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48e878-64c0-49ae-9403-9a5a09c46c1e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:09:20.172377 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1d48e878-64c0-49ae-9403-9a5a09c46c1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '593d00956939421497a7a7628406b333'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:09:20.190554 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1d48e878-64c0-49ae-9403-9a5a09c46c1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '593d00956939421497a7a7628406b333'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:09:20.191622 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1d48e878-64c0-49ae-9403-9a5a09c46c1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '593d00956939421497a7a7628406b333'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:09:20.203573 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1d48e878-64c0-49ae-9403-9a5a09c46c1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '593d00956939421497a7a7628406b333'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:09:20.211736 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1d48e878-64c0-49ae-9403-9a5a09c46c1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '593d00956939421497a7a7628406b333'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:09:20.217865 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1139/2268] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:09:20 2022] DELETE /identity/v3/users/593d00956939421497a7a7628406b333 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:09:20.223249 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b57b8d-388f-401a-a558-aebc665b50e4 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:20.223750 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b57b8d-388f-401a-a558-aebc665b50e4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:20.223853 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b57b8d-388f-401a-a558-aebc665b50e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:20.242905 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-c1b57b8d-388f-401a-a558-aebc665b50e4 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:09:20.244148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c1b57b8d-388f-401a-a558-aebc665b50e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:09:20.313510 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1130/2269] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:09:20.323561 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48e878-64c0-49ae-9403-9a5a09c46c1e admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:09:20.324994 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1d48e878-64c0-49ae-9403-9a5a09c46c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:09:20.387979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48e878-64c0-49ae-9403-9a5a09c46c1e admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:09:20.392344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2edc4-4f24-4024-9f6b-e2a0b8a43ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:09:20.393280 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2edc4-4f24-4024-9f6b-e2a0b8a43ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:20.394654 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2edc4-4f24-4024-9f6b-e2a0b8a43ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:20.395031 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2edc4-4f24-4024-9f6b-e2a0b8a43ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:20.405599 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2edc4-4f24-4024-9f6b-e2a0b8a43ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:09:20.407083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2edc4-4f24-4024-9f6b-e2a0b8a43ae8 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:09:20.418169 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1140/2270] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:09:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:09:20.785522 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b57b8d-388f-401a-a558-aebc665b50e4 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:09:20.786980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c1b57b8d-388f-401a-a558-aebc665b50e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:09:20.798973 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b57b8d-388f-401a-a558-aebc665b50e4 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:09:20.803893 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dc449-9b71-4524-909a-e1a647ac3b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:09:20.804972 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dc449-9b71-4524-909a-e1a647ac3b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:20.805254 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dc449-9b71-4524-909a-e1a647ac3b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:20.805535 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dc449-9b71-4524-909a-e1a647ac3b4d admin admin] PATH_INFO: `/v3/projects/e21a73cb0ab04cc4ba4a837154a65002` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:20.807352 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40dc449-9b71-4524-909a-e1a647ac3b4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e21a73cb0ab04cc4ba4a837154a65002)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:09:20.808809 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40dc449-9b71-4524-909a-e1a647ac3b4d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:09:20.858468 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f40dc449-9b71-4524-909a-e1a647ac3b4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e21a73cb0ab04cc4ba4a837154a65002', 'request_id': 'req-f40dc449-9b71-4524-909a-e1a647ac3b4d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:09:20.865568 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f40dc449-9b71-4524-909a-e1a647ac3b4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e21a73cb0ab04cc4ba4a837154a65002', 'request_id': 'req-f40dc449-9b71-4524-909a-e1a647ac3b4d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:09:20.873419 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f40dc449-9b71-4524-909a-e1a647ac3b4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e21a73cb0ab04cc4ba4a837154a65002', 'request_id': 'req-f40dc449-9b71-4524-909a-e1a647ac3b4d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:09:20.885012 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f40dc449-9b71-4524-909a-e1a647ac3b4d admin admin] The token cache is being invalidate because project e21a73cb0ab04cc4ba4a837154a65002 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:09:20.885305 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f40dc449-9b71-4524-909a-e1a647ac3b4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:09:20.885928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f40dc449-9b71-4524-909a-e1a647ac3b4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:09:20.887459 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1131/2271] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:09:20 2022] DELETE /identity/v3/projects/e21a73cb0ab04cc4ba4a837154a65002 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:09:20.892376 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e68d72-4351-4a83-8028-fdb87d352b18 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:20.892701 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e68d72-4351-4a83-8028-fdb87d352b18 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:20.893003 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e68d72-4351-4a83-8028-fdb87d352b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:20.911900 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e5e68d72-4351-4a83-8028-fdb87d352b18 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:09:20.913183 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e5e68d72-4351-4a83-8028-fdb87d352b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:09:20.931165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:09:20.976642 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1141/2272] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:09:20.985008 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c6c35-6d2c-4cd0-8556-1149600fc80e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:20.985461 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c6c35-6d2c-4cd0-8556-1149600fc80e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:20.985842 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c6c35-6d2c-4cd0-8556-1149600fc80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:21.006032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-565c6c35-6d2c-4cd0-8556-1149600fc80e None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:09:21.007252 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-565c6c35-6d2c-4cd0-8556-1149600fc80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:09:21.015550 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1132/2273] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:09:21.020559 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e68d72-4351-4a83-8028-fdb87d352b18 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:09:21.030550 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e68d72-4351-4a83-8028-fdb87d352b18 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:09:21.035220 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0ba7f-0462-4889-868c-a71fbb4b0c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:09:21.035878 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0ba7f-0462-4889-868c-a71fbb4b0c8a admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:21.036191 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0ba7f-0462-4889-868c-a71fbb4b0c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:21.036755 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0ba7f-0462-4889-868c-a71fbb4b0c8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:21.037250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0ba7f-0462-4889-868c-a71fbb4b0c8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:09:21.037559 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0ba7f-0462-4889-868c-a71fbb4b0c8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:09:21.039171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0ba7f-0462-4889-868c-a71fbb4b0c8a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:09:21.051363 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1142/2274] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:09:21.055609 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c6c35-6d2c-4cd0-8556-1149600fc80e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:09:21.065139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c6c35-6d2c-4cd0-8556-1149600fc80e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:09:21.071321 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9eaa1f-3f97-4711-887a-f75636891d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:09:21.071989 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9eaa1f-3f97-4711-887a-f75636891d1d admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:21.072271 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9eaa1f-3f97-4711-887a-f75636891d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:21.072587 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9eaa1f-3f97-4711-887a-f75636891d1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:21.073312 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9eaa1f-3f97-4711-887a-f75636891d1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:09:21.075273 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9eaa1f-3f97-4711-887a-f75636891d1d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:09:21.101960 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1133/2275] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:09:21 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:09:21.106153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0ba7f-0462-4889-868c-a71fbb4b0c8a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:09:21.117222 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0ba7f-0462-4889-868c-a71fbb4b0c8a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:09:21.180373 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91b004-c24e-44fd-90dc-ded0c71ea214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:09:21.181250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91b004-c24e-44fd-90dc-ded0c71ea214 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:21.181530 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91b004-c24e-44fd-90dc-ded0c71ea214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:21.181803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91b004-c24e-44fd-90dc-ded0c71ea214 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:21.182510 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91b004-c24e-44fd-90dc-ded0c71ea214 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:09:21.184477 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91b004-c24e-44fd-90dc-ded0c71ea214 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:09:21.209052 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1143/2276] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:09:21 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:09:21.210532 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9eaa1f-3f97-4711-887a-f75636891d1d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:09:21.221195 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9eaa1f-3f97-4711-887a-f75636891d1d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:09:21.226112 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446107c-dfb8-4aca-9ee7-151156730f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:09:21.226848 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446107c-dfb8-4aca-9ee7-151156730f90 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:21.227103 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446107c-dfb8-4aca-9ee7-151156730f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:21.227375 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446107c-dfb8-4aca-9ee7-151156730f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:21.228129 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446107c-dfb8-4aca-9ee7-151156730f90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:09:21.229770 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446107c-dfb8-4aca-9ee7-151156730f90 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:09:21.241414 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1134/2277] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:09:21.245872 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91b004-c24e-44fd-90dc-ded0c71ea214 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:09:21.257479 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91b004-c24e-44fd-90dc-ded0c71ea214 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:09:21.262331 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa894fb1-ee78-4fa0-848a-1f6942db6fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:09:21.262995 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa894fb1-ee78-4fa0-848a-1f6942db6fcc admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:21.263276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa894fb1-ee78-4fa0-848a-1f6942db6fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:21.263551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa894fb1-ee78-4fa0-848a-1f6942db6fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:21.264280 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa894fb1-ee78-4fa0-848a-1f6942db6fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:09:21.265923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa894fb1-ee78-4fa0-848a-1f6942db6fcc admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:09:21.277622 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1144/2278] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:09:21.282115 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446107c-dfb8-4aca-9ee7-151156730f90 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:09:21.292890 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446107c-dfb8-4aca-9ee7-151156730f90 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:09:21.297551 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80711b-b41a-4643-87e7-a8f3a712b530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:09:21.298430 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80711b-b41a-4643-87e7-a8f3a712b530 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:21.298752 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80711b-b41a-4643-87e7-a8f3a712b530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:21.299028 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80711b-b41a-4643-87e7-a8f3a712b530 admin admin] PATH_INFO: `/v3/projects/bbf7418da81e4d9bb042a3dbe1cb1b80/users/1256d13e43234ef8b29496e8b4ae359d/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:21.315248 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80711b-b41a-4643-87e7-a8f3a712b530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbf7418da81e4d9bb042a3dbe1cb1b80, user_id=1256d13e43234ef8b29496e8b4ae359d, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:09:21.318191 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80711b-b41a-4643-87e7-a8f3a712b530 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:09:21.332495 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1135/2279] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:09:21 2022] PUT /identity/v3/projects/bbf7418da81e4d9bb042a3dbe1cb1b80/users/1256d13e43234ef8b29496e8b4ae359d/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:09:21.337564 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfa117-1292-442c-a077-e48944df7aae None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:21.337858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfa117-1292-442c-a077-e48944df7aae None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:21.338137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfa117-1292-442c-a077-e48944df7aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:21.356617 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-36cfa117-1292-442c-a077-e48944df7aae None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:09:21.357810 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-36cfa117-1292-442c-a077-e48944df7aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:09:21.420073 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1145/2280] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:09:21.429943 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80711b-b41a-4643-87e7-a8f3a712b530 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:09:21.431795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5f80711b-b41a-4643-87e7-a8f3a712b530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:09:21.454450 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:09:21.494032 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80711b-b41a-4643-87e7-a8f3a712b530 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:09:21.497836 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52908c0-33fa-4e41-985d-7f3e4ee4f95d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:09:21.498485 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52908c0-33fa-4e41-985d-7f3e4ee4f95d service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:21.498766 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52908c0-33fa-4e41-985d-7f3e4ee4f95d service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:21.499040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52908c0-33fa-4e41-985d-7f3e4ee4f95d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:21.509396 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52908c0-33fa-4e41-985d-7f3e4ee4f95d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:09:21.510829 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52908c0-33fa-4e41-985d-7f3e4ee4f95d service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:09:21.520901 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1136/2281] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:09:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:09:22.260328 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4088d28-eb7e-4882-a825-263a64d71867 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:22.260884 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4088d28-eb7e-4882-a825-263a64d71867 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:22.260884 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4088d28-eb7e-4882-a825-263a64d71867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:22.291047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d4088d28-eb7e-4882-a825-263a64d71867 None None] MFA Rules not processed for user `1256d13e43234ef8b29496e8b4ae359d`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:09:22.292281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d4088d28-eb7e-4882-a825-263a64d71867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:09:22.312032 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:09:22.393256 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1146/2282] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:09:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:09:22.404771 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52908c0-33fa-4e41-985d-7f3e4ee4f95d service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:09:22.407096 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d52908c0-33fa-4e41-985d-7f3e4ee4f95d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:09:22.513216 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52908c0-33fa-4e41-985d-7f3e4ee4f95d service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:09:22.517831 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c4f22-7509-4617-9f74-516fa43892cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:09:22.519122 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c4f22-7509-4617-9f74-516fa43892cb service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:22.519479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c4f22-7509-4617-9f74-516fa43892cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:22.519751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c4f22-7509-4617-9f74-516fa43892cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:22.531262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c4f22-7509-4617-9f74-516fa43892cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:09:22.532225 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c4f22-7509-4617-9f74-516fa43892cb service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:09:22.542847 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1137/2283] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:09:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:09:23.924730 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d951b8-fdbc-4088-ac86-881f694ad831 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:23.926170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d951b8-fdbc-4088-ac86-881f694ad831 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:23.926170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d951b8-fdbc-4088-ac86-881f694ad831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:23.944344 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-31d951b8-fdbc-4088-ac86-881f694ad831 None None] MFA Rules not processed for user `1256d13e43234ef8b29496e8b4ae359d`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:09:23.945703 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-31d951b8-fdbc-4088-ac86-881f694ad831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:09:23.952700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1147/2284] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:09:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:09:31.275973 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d65ee5-cfa1-47b2-9c9c-805324b2bfa4 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:31.276570 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d65ee5-cfa1-47b2-9c9c-805324b2bfa4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:31.276570 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d65ee5-cfa1-47b2-9c9c-805324b2bfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:31.345423 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-91d65ee5-cfa1-47b2-9c9c-805324b2bfa4 None None] MFA Rules not processed for user `6d4c4b75552b4c739079f328a6efba40`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:09:31.347282 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-91d65ee5-cfa1-47b2-9c9c-805324b2bfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:09:31.464750 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1138/2285] 10.222.0.35 () {58 vars in 1009 bytes} [Thu May 19 22:09:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:09:31.490456 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d951b8-fdbc-4088-ac86-881f694ad831 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:09:31.493488 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-31d951b8-fdbc-4088-ac86-881f694ad831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:09:31.626662 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d951b8-fdbc-4088-ac86-881f694ad831 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:09:31.633393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb611bda-b895-4306-ba41-15985c5156f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a4208619f84f16b735871ee114e660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:09:31.634480 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb611bda-b895-4306-ba41-15985c5156f9 service swift] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:31.634764 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb611bda-b895-4306-ba41-15985c5156f9 service swift] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:31.635046 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb611bda-b895-4306-ba41-15985c5156f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:31.651768 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb611bda-b895-4306-ba41-15985c5156f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:09:31.653477 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb611bda-b895-4306-ba41-15985c5156f9 service swift] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:09:31.666400 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1148/2286] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 22:09:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 22:09:41.455670 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=95 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:09:41.661204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=63 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:09:45.453706 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d65ee5-cfa1-47b2-9c9c-805324b2bfa4 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:09:45.455270 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-91d65ee5-cfa1-47b2-9c9c-805324b2bfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:09:45.548139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d65ee5-cfa1-47b2-9c9c-805324b2bfa4 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:09:45.553879 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da8f43-4202-4499-94dd-dbbb76ac7f31 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1004beeeaed4af4a92c89ad31008b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:09:45.554565 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da8f43-4202-4499-94dd-dbbb76ac7f31 service placement] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:45.554823 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da8f43-4202-4499-94dd-dbbb76ac7f31 service placement] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:45.555101 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da8f43-4202-4499-94dd-dbbb76ac7f31 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:45.556982 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-79da8f43-4202-4499-94dd-dbbb76ac7f31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:09:45.570321 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da8f43-4202-4499-94dd-dbbb76ac7f31 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:09:45.572394 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da8f43-4202-4499-94dd-dbbb76ac7f31 service placement] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:09:45.590017 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1139/2287] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:09:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:09:47.413598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292a716-260f-415f-abff-78dc519dacda None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:47.414167 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292a716-260f-415f-abff-78dc519dacda None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:47.414257 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292a716-260f-415f-abff-78dc519dacda None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:47.415698 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1149/2288] 10.222.0.35 () {54 vars in 921 bytes} [Thu May 19 22:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:09:47.421765 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5375c8d-e8a1-48a3-a3f4-7ba9a01536fe None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:47.422263 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5375c8d-e8a1-48a3-a3f4-7ba9a01536fe None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:47.422456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5375c8d-e8a1-48a3-a3f4-7ba9a01536fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:47.482404 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a5375c8d-e8a1-48a3-a3f4-7ba9a01536fe None None] MFA Rules not processed for user `902ca8f1d59547a0ab187b4748311f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:09:47.483623 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a5375c8d-e8a1-48a3-a3f4-7ba9a01536fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:09:47.569812 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1140/2289] 10.222.0.35 () {58 vars in 1018 bytes} [Thu May 19 22:09:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:09:47.583532 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292a716-260f-415f-abff-78dc519dacda None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:09:47.585277 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b292a716-260f-415f-abff-78dc519dacda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:09:47.672831 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292a716-260f-415f-abff-78dc519dacda None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:09:47.676668 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6132512-c5bb-41db-909c-d4fe6b702253 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf64f4ec145742d78eee6c4a447515dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:09:47.677334 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6132512-c5bb-41db-909c-d4fe6b702253 service glance] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:47.677617 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6132512-c5bb-41db-909c-d4fe6b702253 service glance] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:47.677896 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6132512-c5bb-41db-909c-d4fe6b702253 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:47.688635 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6132512-c5bb-41db-909c-d4fe6b702253 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:09:47.690105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6132512-c5bb-41db-909c-d4fe6b702253 service glance] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:09:47.702778 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1150/2290] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:09:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:09:47.772898 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d530cbc-e096-4f17-8130-bb6e36a3e233 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:47.773160 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d530cbc-e096-4f17-8130-bb6e36a3e233 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:47.773378 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d530cbc-e096-4f17-8130-bb6e36a3e233 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:47.775083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1141/2291] 10.222.0.35 () {54 vars in 921 bytes} [Thu May 19 22:09:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:09:47.780767 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f872ab-b30c-466a-a119-68048c07b16f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:47.781100 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f872ab-b30c-466a-a119-68048c07b16f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:47.781407 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f872ab-b30c-466a-a119-68048c07b16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:47.799404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-37f872ab-b30c-466a-a119-68048c07b16f None None] MFA Rules not processed for user `a571d6fe63334552b532aae15299ef9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:09:47.800650 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-37f872ab-b30c-466a-a119-68048c07b16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:09:47.807520 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1151/2292] 10.222.0.35 () {58 vars in 1018 bytes} [Thu May 19 22:09:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:09:47.820907 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d530cbc-e096-4f17-8130-bb6e36a3e233 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:09:47.822784 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3d530cbc-e096-4f17-8130-bb6e36a3e233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:09:47.836807 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d530cbc-e096-4f17-8130-bb6e36a3e233 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:09:47.840517 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59d6d9-d7ec-4e9f-8da5-427aed9e7392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:09:47.841158 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59d6d9-d7ec-4e9f-8da5-427aed9e7392 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:47.841444 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59d6d9-d7ec-4e9f-8da5-427aed9e7392 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:47.841723 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59d6d9-d7ec-4e9f-8da5-427aed9e7392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:47.849089 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59d6d9-d7ec-4e9f-8da5-427aed9e7392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:09:47.850554 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59d6d9-d7ec-4e9f-8da5-427aed9e7392 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:09:47.858891 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1142/2293] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:09:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:09:47.951840 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac075627-0e13-4de2-84b7-8f1a383c5a7c None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:47.952146 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac075627-0e13-4de2-84b7-8f1a383c5a7c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:47.952428 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac075627-0e13-4de2-84b7-8f1a383c5a7c None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:47.953881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1152/2294] 10.222.0.35 () {54 vars in 921 bytes} [Thu May 19 22:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:09:47.959826 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c11930-861a-474a-a977-fabebedf3c16 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:47.960111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c11930-861a-474a-a977-fabebedf3c16 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:47.960570 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c11930-861a-474a-a977-fabebedf3c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:47.979598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-20c11930-861a-474a-a977-fabebedf3c16 None None] MFA Rules not processed for user `902ca8f1d59547a0ab187b4748311f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:09:47.980951 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-20c11930-861a-474a-a977-fabebedf3c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:09:47.991848 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1143/2295] 10.222.0.35 () {58 vars in 1018 bytes} [Thu May 19 22:09:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:09:48.004450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac075627-0e13-4de2-84b7-8f1a383c5a7c None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:09:48.029752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac075627-0e13-4de2-84b7-8f1a383c5a7c None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:09:48.033598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ae00a-82c9-4dc0-ad30-e55621677c04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:09:48.034377 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ae00a-82c9-4dc0-ad30-e55621677c04 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:48.034863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ae00a-82c9-4dc0-ad30-e55621677c04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:48.035337 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ae00a-82c9-4dc0-ad30-e55621677c04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:48.047720 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ae00a-82c9-4dc0-ad30-e55621677c04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:09:48.049278 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ae00a-82c9-4dc0-ad30-e55621677c04 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:09:48.073156 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1153/2296] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:09:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:09:49.699212 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c605e-c1af-419d-b8ac-73990c6753aa None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:49.700334 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c605e-c1af-419d-b8ac-73990c6753aa None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:49.700916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c605e-c1af-419d-b8ac-73990c6753aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:49.720970 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-718c605e-c1af-419d-b8ac-73990c6753aa None None] MFA Rules not processed for user `5fc2803fed254f3b8a280df51891ec0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:09:49.722370 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-718c605e-c1af-419d-b8ac-73990c6753aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:09:49.749063 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:09:49.789358 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1144/2297] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:09:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:09:51.240573 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be433d38-02a5-4033-a59d-86ac569b0e1a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:51.241320 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be433d38-02a5-4033-a59d-86ac569b0e1a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:51.241439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be433d38-02a5-4033-a59d-86ac569b0e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:51.264767 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-be433d38-02a5-4033-a59d-86ac569b0e1a None None] MFA Rules not processed for user `6d4c4b75552b4c739079f328a6efba40`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:09:51.265976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-be433d38-02a5-4033-a59d-86ac569b0e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:09:51.273992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1154/2298] 10.222.0.35 () {58 vars in 1009 bytes} [Thu May 19 22:09:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:09:51.286514 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c605e-c1af-419d-b8ac-73990c6753aa None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:09:51.299291 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c605e-c1af-419d-b8ac-73990c6753aa None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:09:51.305577 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3869d5-b18a-40b4-acee-63d95879bb3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a4208619f84f16b735871ee114e660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:09:51.306263 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3869d5-b18a-40b4-acee-63d95879bb3c service swift] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:09:51.306902 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3869d5-b18a-40b4-acee-63d95879bb3c service swift] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:09:51.307224 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3869d5-b18a-40b4-acee-63d95879bb3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:09:51.324881 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3869d5-b18a-40b4-acee-63d95879bb3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:09:51.326765 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3869d5-b18a-40b4-acee-63d95879bb3c service swift] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:09:51.338301 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1145/2299] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 22:09:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 22:10:01.259480 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=47 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:10:01.334069 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=18 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:10:14.748006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ca079-eb8d-4b77-aac6-487d78ef521c None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:10:14.748648 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ca079-eb8d-4b77-aac6-487d78ef521c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:10:14.748648 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ca079-eb8d-4b77-aac6-487d78ef521c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:10:14.772596 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-fd3ca079-eb8d-4b77-aac6-487d78ef521c None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:10:14.773984 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-fd3ca079-eb8d-4b77-aac6-487d78ef521c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:10:14.782394 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1155/2300] 10.222.0.77 () {58 vars in 1016 bytes} [Thu May 19 22:10:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:10:14.806167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3869d5-b18a-40b4-acee-63d95879bb3c service swift] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:10:14.809688 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3c3869d5-b18a-40b4-acee-63d95879bb3c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:10:14.828800 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3869d5-b18a-40b4-acee-63d95879bb3c service swift] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:10:14.838646 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2fe9e-30e6-4c93-bb41-03ce014b6921 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:10:14.839328 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2fe9e-30e6-4c93-bb41-03ce014b6921 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:10:14.839892 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2fe9e-30e6-4c93-bb41-03ce014b6921 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:10:14.840275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2fe9e-30e6-4c93-bb41-03ce014b6921 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:10:14.857049 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2fe9e-30e6-4c93-bb41-03ce014b6921 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:10:14.858841 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2fe9e-30e6-4c93-bb41-03ce014b6921 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:10:14.872584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1146/2301] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:10:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:10:21.932959 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bde3f-6fdf-40ad-af57-ee4878bd40d9 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:10:21.933804 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bde3f-6fdf-40ad-af57-ee4878bd40d9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:10:21.934098 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bde3f-6fdf-40ad-af57-ee4878bd40d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:10:21.946147 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836ed87-1714-41e6-8b5c-ce4acda2228b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:10:21.946734 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836ed87-1714-41e6-8b5c-ce4acda2228b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:10:21.946929 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836ed87-1714-41e6-8b5c-ce4acda2228b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:10:21.959808 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-864bde3f-6fdf-40ad-af57-ee4878bd40d9 None None] MFA Rules not processed for user `6d4c4b75552b4c739079f328a6efba40`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:10:21.961996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-864bde3f-6fdf-40ad-af57-ee4878bd40d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:10:21.967320 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-4836ed87-1714-41e6-8b5c-ce4acda2228b None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:10:21.968829 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4836ed87-1714-41e6-8b5c-ce4acda2228b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:10:21.972472 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1156/2302] 10.222.0.35 () {58 vars in 967 bytes} [Thu May 19 22:10:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:10:21.977761 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1147/2303] 10.222.0.77 () {58 vars in 1016 bytes} [Thu May 19 22:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:10:21.985495 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bde3f-6fdf-40ad-af57-ee4878bd40d9 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:10:21.999550 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bde3f-6fdf-40ad-af57-ee4878bd40d9 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:10:22.002527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836ed87-1714-41e6-8b5c-ce4acda2228b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:10:22.004013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4836ed87-1714-41e6-8b5c-ce4acda2228b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:10:22.006970 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a8c1a-6371-476d-bbf0-e5918e130248 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a4208619f84f16b735871ee114e660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:10:22.007650 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a8c1a-6371-476d-bbf0-e5918e130248 service swift] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:10:22.007929 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a8c1a-6371-476d-bbf0-e5918e130248 service swift] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:10:22.008210 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a8c1a-6371-476d-bbf0-e5918e130248 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:10:22.020025 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a8c1a-6371-476d-bbf0-e5918e130248 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:10:22.022408 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a8c1a-6371-476d-bbf0-e5918e130248 service swift] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:10:22.022932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836ed87-1714-41e6-8b5c-ce4acda2228b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:10:22.030187 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abe2e2-63f3-45e9-87fc-1986b920a2cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:10:22.030849 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abe2e2-63f3-45e9-87fc-1986b920a2cc service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:10:22.031133 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abe2e2-63f3-45e9-87fc-1986b920a2cc service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:10:22.031407 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abe2e2-63f3-45e9-87fc-1986b920a2cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:10:22.032826 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1157/2304] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 22:10:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 19 22:10:22.053526 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70abe2e2-63f3-45e9-87fc-1986b920a2cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:10:22.055232 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70abe2e2-63f3-45e9-87fc-1986b920a2cc service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:10:22.066403 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1148/2305] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:10:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:10:27.257711 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8beaab-3ead-47f9-b006-a3964b96312d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:10:27.258301 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8beaab-3ead-47f9-b006-a3964b96312d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:10:27.258398 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8beaab-3ead-47f9-b006-a3964b96312d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:10:27.277500 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6c8beaab-3ead-47f9-b006-a3964b96312d None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:10:27.278836 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6c8beaab-3ead-47f9-b006-a3964b96312d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:10:27.294497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1158/2306] 10.222.0.77 () {58 vars in 1016 bytes} [Thu May 19 22:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:10:27.315041 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abe2e2-63f3-45e9-87fc-1986b920a2cc service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:10:27.327479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abe2e2-63f3-45e9-87fc-1986b920a2cc service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:10:27.333394 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e27b2-af5a-4850-8a78-a0296222125f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:10:27.334402 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e27b2-af5a-4850-8a78-a0296222125f service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:10:27.334689 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e27b2-af5a-4850-8a78-a0296222125f service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:10:27.334965 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e27b2-af5a-4850-8a78-a0296222125f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:10:27.344949 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e27b2-af5a-4850-8a78-a0296222125f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:10:27.346552 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e27b2-af5a-4850-8a78-a0296222125f service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:10:27.358127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1149/2307] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:10:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:10:31.370665 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a28455-decd-41a6-b64b-b1dff97ffd76 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:10:31.371137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a28455-decd-41a6-b64b-b1dff97ffd76 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:10:31.371237 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a28455-decd-41a6-b64b-b1dff97ffd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:10:31.392807 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d4a28455-decd-41a6-b64b-b1dff97ffd76 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:10:31.394054 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d4a28455-decd-41a6-b64b-b1dff97ffd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:10:31.402591 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1159/2308] 10.222.0.77 () {58 vars in 1016 bytes} [Thu May 19 22:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:10:31.432736 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e27b2-af5a-4850-8a78-a0296222125f service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:10:31.445058 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e27b2-af5a-4850-8a78-a0296222125f service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:10:31.450710 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d3dff-0734-4228-8d15-0b3e5763a723 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:10:31.451344 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d3dff-0734-4228-8d15-0b3e5763a723 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:10:31.451625 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d3dff-0734-4228-8d15-0b3e5763a723 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:10:31.451898 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d3dff-0734-4228-8d15-0b3e5763a723 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:10:31.460990 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d3dff-0734-4228-8d15-0b3e5763a723 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:10:31.462577 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d3dff-0734-4228-8d15-0b3e5763a723 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:10:31.471941 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1150/2309] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:10:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:10:35.557069 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033e72d-63bb-4c46-804d-8fe70007e75e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:10:35.557712 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033e72d-63bb-4c46-804d-8fe70007e75e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:10:35.557712 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033e72d-63bb-4c46-804d-8fe70007e75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:10:35.577769 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-0033e72d-63bb-4c46-804d-8fe70007e75e None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:10:35.579010 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0033e72d-63bb-4c46-804d-8fe70007e75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:10:35.587518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1160/2310] 10.222.0.77 () {58 vars in 1016 bytes} [Thu May 19 22:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:10:35.610646 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d3dff-0734-4228-8d15-0b3e5763a723 service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:10:35.622484 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d3dff-0734-4228-8d15-0b3e5763a723 service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:10:35.627977 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0360c-1faf-47fb-ba12-d9ad8602d747 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:10:35.628645 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0360c-1faf-47fb-ba12-d9ad8602d747 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:10:35.629044 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0360c-1faf-47fb-ba12-d9ad8602d747 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:10:35.629347 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0360c-1faf-47fb-ba12-d9ad8602d747 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:10:35.639058 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0360c-1faf-47fb-ba12-d9ad8602d747 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:10:35.640679 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0360c-1faf-47fb-ba12-d9ad8602d747 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:10:35.651313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1151/2311] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:10:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:10:39.749756 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cf2a3-038b-4a5c-aee2-4531c4343c53 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:10:39.750323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cf2a3-038b-4a5c-aee2-4531c4343c53 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:10:39.750323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cf2a3-038b-4a5c-aee2-4531c4343c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:10:39.768666 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-212cf2a3-038b-4a5c-aee2-4531c4343c53 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:10:39.769883 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-212cf2a3-038b-4a5c-aee2-4531c4343c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:10:39.778626 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1161/2312] 10.222.0.77 () {58 vars in 1016 bytes} [Thu May 19 22:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:10:39.805046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0360c-1faf-47fb-ba12-d9ad8602d747 service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:10:39.816081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0360c-1faf-47fb-ba12-d9ad8602d747 service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:10:39.821812 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8289104-22cc-45b3-b51a-7a3ac9b7f894 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:10:39.822450 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8289104-22cc-45b3-b51a-7a3ac9b7f894 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:10:39.822733 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8289104-22cc-45b3-b51a-7a3ac9b7f894 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:10:39.823007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8289104-22cc-45b3-b51a-7a3ac9b7f894 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:10:39.832016 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8289104-22cc-45b3-b51a-7a3ac9b7f894 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:10:39.834243 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8289104-22cc-45b3-b51a-7a3ac9b7f894 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:10:39.844880 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1152/2313] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:10:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:10:49.763377 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=24 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:10:49.840305 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=39 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:10:57.232478 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75078458-4a55-4ec0-8fc4-a8087de7fbb4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:10:57.233024 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75078458-4a55-4ec0-8fc4-a8087de7fbb4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:10:57.233024 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75078458-4a55-4ec0-8fc4-a8087de7fbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:10:57.250780 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-75078458-4a55-4ec0-8fc4-a8087de7fbb4 None None] MFA Rules not processed for user `1256d13e43234ef8b29496e8b4ae359d`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:10:57.251982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-75078458-4a55-4ec0-8fc4-a8087de7fbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:10:57.260219 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1162/2314] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:10:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:11:04.071073 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff2d4e-19e0-4855-a877-e3a5cc9cad32 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:11:04.071678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff2d4e-19e0-4855-a877-e3a5cc9cad32 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:11:04.071898 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff2d4e-19e0-4855-a877-e3a5cc9cad32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:11:04.091003 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-4eff2d4e-19e0-4855-a877-e3a5cc9cad32 None None] MFA Rules not processed for user `c9e6e9d4d6cb499cbd4c886534176b66`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:11:04.092374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4eff2d4e-19e0-4855-a877-e3a5cc9cad32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:11:04.156240 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1153/2315] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:11:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:11:07.245647 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:11:14.147881 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=25 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:11:17.079102 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c014251-5bd6-4ddc-9d98-7696b9e9c8c8 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:11:17.079700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c014251-5bd6-4ddc-9d98-7696b9e9c8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:11:17.079700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c014251-5bd6-4ddc-9d98-7696b9e9c8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:11:17.099998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-9c014251-5bd6-4ddc-9d98-7696b9e9c8c8 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:11:17.101516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9c014251-5bd6-4ddc-9d98-7696b9e9c8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:11:17.110183 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1163/2316] 10.222.0.77 () {58 vars in 1016 bytes} [Thu May 19 22:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:11:17.131282 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff2d4e-19e0-4855-a877-e3a5cc9cad32 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:11:17.144994 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff2d4e-19e0-4855-a877-e3a5cc9cad32 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:11:17.151372 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b934b03-360c-44bf-8dde-0701628126cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:11:17.152009 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b934b03-360c-44bf-8dde-0701628126cb service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:11:17.152291 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b934b03-360c-44bf-8dde-0701628126cb service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:11:17.152603 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b934b03-360c-44bf-8dde-0701628126cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:11:17.161047 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b934b03-360c-44bf-8dde-0701628126cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:11:17.162682 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b934b03-360c-44bf-8dde-0701628126cb service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:11:17.172167 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1154/2317] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:11:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:11:21.402451 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799e2d3-a1f7-43c6-9b9d-29106d406cf5 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:11:21.403030 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799e2d3-a1f7-43c6-9b9d-29106d406cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:11:21.403030 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799e2d3-a1f7-43c6-9b9d-29106d406cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:11:21.420907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-5799e2d3-a1f7-43c6-9b9d-29106d406cf5 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:11:21.422100 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5799e2d3-a1f7-43c6-9b9d-29106d406cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:11:21.429952 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1164/2318] 10.222.0.77 () {58 vars in 1016 bytes} [Thu May 19 22:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:11:21.454640 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b934b03-360c-44bf-8dde-0701628126cb service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:11:21.466577 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b934b03-360c-44bf-8dde-0701628126cb service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:11:21.472089 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62fcca-f070-4a25-9cc7-99b0fd84082d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:11:21.472770 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62fcca-f070-4a25-9cc7-99b0fd84082d service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:11:21.473057 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62fcca-f070-4a25-9cc7-99b0fd84082d service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:11:21.473335 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62fcca-f070-4a25-9cc7-99b0fd84082d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:11:21.481898 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62fcca-f070-4a25-9cc7-99b0fd84082d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:11:21.483482 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62fcca-f070-4a25-9cc7-99b0fd84082d service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:11:21.493299 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1155/2319] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:11:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:11:25.476616 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90818f-0e70-4db5-a931-561b57f0d608 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:11:25.477387 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90818f-0e70-4db5-a931-561b57f0d608 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:11:25.477610 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90818f-0e70-4db5-a931-561b57f0d608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:11:25.497893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-af90818f-0e70-4db5-a931-561b57f0d608 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:11:25.499113 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-af90818f-0e70-4db5-a931-561b57f0d608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:11:25.507408 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1165/2320] 10.222.0.77 () {58 vars in 1016 bytes} [Thu May 19 22:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:11:25.531429 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62fcca-f070-4a25-9cc7-99b0fd84082d service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:11:25.542663 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62fcca-f070-4a25-9cc7-99b0fd84082d service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:11:25.549539 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137ebef-9f4b-4c82-9101-2e7630ebc023 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:11:25.550814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137ebef-9f4b-4c82-9101-2e7630ebc023 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:11:25.551291 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137ebef-9f4b-4c82-9101-2e7630ebc023 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:11:25.551705 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137ebef-9f4b-4c82-9101-2e7630ebc023 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:11:25.563978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3137ebef-9f4b-4c82-9101-2e7630ebc023 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:11:25.565606 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3137ebef-9f4b-4c82-9101-2e7630ebc023 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:11:25.576289 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1156/2321] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:11:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:11:29.674752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891f0e8-92ff-405b-ad5e-871aaf509215 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:11:29.675350 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891f0e8-92ff-405b-ad5e-871aaf509215 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:11:29.675350 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891f0e8-92ff-405b-ad5e-871aaf509215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:11:29.693954 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c891f0e8-92ff-405b-ad5e-871aaf509215 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:11:29.695152 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c891f0e8-92ff-405b-ad5e-871aaf509215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:11:29.704678 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1166/2322] 10.222.0.77 () {58 vars in 1016 bytes} [Thu May 19 22:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:11:29.752376 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137ebef-9f4b-4c82-9101-2e7630ebc023 service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:11:29.764951 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137ebef-9f4b-4c82-9101-2e7630ebc023 service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:11:29.770611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f126232-4ea1-4d74-bf8c-db4fe8bc6acf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:11:29.771284 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f126232-4ea1-4d74-bf8c-db4fe8bc6acf service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:11:29.771572 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f126232-4ea1-4d74-bf8c-db4fe8bc6acf service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:11:29.771853 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f126232-4ea1-4d74-bf8c-db4fe8bc6acf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:11:29.782523 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f126232-4ea1-4d74-bf8c-db4fe8bc6acf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:11:29.784183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f126232-4ea1-4d74-bf8c-db4fe8bc6acf service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:11:29.794831 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1157/2323] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:11:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:11:34.906698 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dfc8d-1f69-4fc3-84bd-274cb8003028 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:11:34.907233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dfc8d-1f69-4fc3-84bd-274cb8003028 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:11:34.907233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dfc8d-1f69-4fc3-84bd-274cb8003028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:11:34.925813 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-de4dfc8d-1f69-4fc3-84bd-274cb8003028 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:11:34.927034 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-de4dfc8d-1f69-4fc3-84bd-274cb8003028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:11:34.935955 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1167/2324] 10.222.0.77 () {58 vars in 1016 bytes} [Thu May 19 22:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:11:34.959058 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f126232-4ea1-4d74-bf8c-db4fe8bc6acf service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:11:34.972527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f126232-4ea1-4d74-bf8c-db4fe8bc6acf service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:11:34.978819 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376cce1-7aa5-4557-9add-4ffdd383c6b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:11:34.979480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376cce1-7aa5-4557-9add-4ffdd383c6b8 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:11:34.979768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376cce1-7aa5-4557-9add-4ffdd383c6b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:11:34.980049 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376cce1-7aa5-4557-9add-4ffdd383c6b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:11:34.989333 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376cce1-7aa5-4557-9add-4ffdd383c6b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:11:34.990943 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376cce1-7aa5-4557-9add-4ffdd383c6b8 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:11:35.001820 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1158/2325] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:11:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:11:39.474644 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4dfc8d-1f69-4fc3-84bd-274cb8003028 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:11:39.481830 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=16 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:11:39.489167 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4dfc8d-1f69-4fc3-84bd-274cb8003028 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:11:39.494076 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d21e3-9cd1-4ee0-b027-63324f4f6824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:11:39.494731 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d21e3-9cd1-4ee0-b027-63324f4f6824 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:11:39.495014 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d21e3-9cd1-4ee0-b027-63324f4f6824 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:11:39.495295 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d21e3-9cd1-4ee0-b027-63324f4f6824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:11:39.497154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-963d21e3-9cd1-4ee0-b027-63324f4f6824 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:11:39.518650 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d21e3-9cd1-4ee0-b027-63324f4f6824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:11:39.520038 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d21e3-9cd1-4ee0-b027-63324f4f6824 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:11:39.534064 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1168/2326] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:11:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:11:41.104856 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376cce1-7aa5-4557-9add-4ffdd383c6b8 service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:11:41.106829 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9376cce1-7aa5-4557-9add-4ffdd383c6b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:11:41.120745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376cce1-7aa5-4557-9add-4ffdd383c6b8 service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:11:41.132212 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8ce05-48d0-49f8-905b-c452778a3b20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:11:41.133542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8ce05-48d0-49f8-905b-c452778a3b20 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:11:41.134199 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8ce05-48d0-49f8-905b-c452778a3b20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:11:41.134587 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8ce05-48d0-49f8-905b-c452778a3b20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:11:41.136603 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6fd8ce05-48d0-49f8-905b-c452778a3b20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:11:41.151818 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8ce05-48d0-49f8-905b-c452778a3b20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:11:41.153428 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8ce05-48d0-49f8-905b-c452778a3b20 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:11:41.166087 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1159/2327] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:11:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:11:42.970950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd509c3-17d4-441b-be3e-1d0d87f55be2 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:11:42.971482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd509c3-17d4-441b-be3e-1d0d87f55be2 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:11:42.971583 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd509c3-17d4-441b-be3e-1d0d87f55be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:11:42.989421 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-1dd509c3-17d4-441b-be3e-1d0d87f55be2 None None] MFA Rules not processed for user `d20d381f9231454cb27a575538d652ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:11:42.990473 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1dd509c3-17d4-441b-be3e-1d0d87f55be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:11:43.049261 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1169/2328] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:11:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:11:43.694151 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8ce05-48d0-49f8-905b-c452778a3b20 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:11:43.696791 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6fd8ce05-48d0-49f8-905b-c452778a3b20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:11:43.717488 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8ce05-48d0-49f8-905b-c452778a3b20 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:11:43.726300 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb88e3-3dd4-47a4-b25a-ee5a065aa777 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1004beeeaed4af4a92c89ad31008b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:11:43.727048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb88e3-3dd4-47a4-b25a-ee5a065aa777 service placement] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:11:43.727334 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb88e3-3dd4-47a4-b25a-ee5a065aa777 service placement] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:11:43.727614 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb88e3-3dd4-47a4-b25a-ee5a065aa777 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:11:43.729653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-79cb88e3-3dd4-47a4-b25a-ee5a065aa777 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:11:43.744568 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb88e3-3dd4-47a4-b25a-ee5a065aa777 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:11:43.746223 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb88e3-3dd4-47a4-b25a-ee5a065aa777 service placement] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:11:43.757258 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1160/2329] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:11:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:11:50.157101 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd509c3-17d4-441b-be3e-1d0d87f55be2 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:11:50.167326 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd509c3-17d4-441b-be3e-1d0d87f55be2 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:11:50.171452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19be7d1-a421-4349-a70f-e3bd147eab1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:11:50.172113 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19be7d1-a421-4349-a70f-e3bd147eab1c service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:11:50.172707 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19be7d1-a421-4349-a70f-e3bd147eab1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:11:50.172904 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19be7d1-a421-4349-a70f-e3bd147eab1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:11:50.174806 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a19be7d1-a421-4349-a70f-e3bd147eab1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:11:50.193566 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19be7d1-a421-4349-a70f-e3bd147eab1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:11:50.195177 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19be7d1-a421-4349-a70f-e3bd147eab1c service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:11:50.204582 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1170/2330] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:11:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:11:53.753802 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=42 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:11:55.134892 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb88e3-3dd4-47a4-b25a-ee5a065aa777 service placement] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:11:55.147571 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb88e3-3dd4-47a4-b25a-ee5a065aa777 service placement] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:11:55.153720 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412b68f-f14e-4d1d-adda-12a17107eab6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:11:55.154375 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412b68f-f14e-4d1d-adda-12a17107eab6 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:11:55.154660 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412b68f-f14e-4d1d-adda-12a17107eab6 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:11:55.154940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412b68f-f14e-4d1d-adda-12a17107eab6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:11:55.156770 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0412b68f-f14e-4d1d-adda-12a17107eab6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:11:55.168020 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412b68f-f14e-4d1d-adda-12a17107eab6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:11:55.169657 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412b68f-f14e-4d1d-adda-12a17107eab6 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:11:55.178784 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1161/2331] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:11:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:12:00.200556 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=36 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:12:01.537702 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19be7d1-a421-4349-a70f-e3bd147eab1c service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:12:01.566450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19be7d1-a421-4349-a70f-e3bd147eab1c service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:12:01.573652 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0000e64-0d65-4f57-9959-b52b02dace90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:12:01.574584 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0000e64-0d65-4f57-9959-b52b02dace90 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:01.575039 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0000e64-0d65-4f57-9959-b52b02dace90 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:01.575483 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0000e64-0d65-4f57-9959-b52b02dace90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:01.577554 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d0000e64-0d65-4f57-9959-b52b02dace90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:12:01.592504 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0000e64-0d65-4f57-9959-b52b02dace90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:12:01.594658 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0000e64-0d65-4f57-9959-b52b02dace90 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:12:01.615547 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1171/2332] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:12:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:12:05.174635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=6 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:12:10.772922 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412b68f-f14e-4d1d-adda-12a17107eab6 service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:12:10.786030 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412b68f-f14e-4d1d-adda-12a17107eab6 service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:12:10.791495 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa98775-7d91-4241-ab7c-4d6cc6774c1a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1004beeeaed4af4a92c89ad31008b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:12:10.792155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa98775-7d91-4241-ab7c-4d6cc6774c1a service placement] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:10.792481 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa98775-7d91-4241-ab7c-4d6cc6774c1a service placement] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:10.792783 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa98775-7d91-4241-ab7c-4d6cc6774c1a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:10.794812 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5fa98775-7d91-4241-ab7c-4d6cc6774c1a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:12:10.807842 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa98775-7d91-4241-ab7c-4d6cc6774c1a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:12:10.809499 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa98775-7d91-4241-ab7c-4d6cc6774c1a service placement] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:12:10.820225 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1162/2333] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:12:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:12:10.894864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0000e64-0d65-4f57-9959-b52b02dace90 service nova] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:12:10.907102 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0000e64-0d65-4f57-9959-b52b02dace90 service nova] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:12:10.913269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309bc6e-ee4b-443a-9fb6-0f7bec715e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:12:10.914169 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309bc6e-ee4b-443a-9fb6-0f7bec715e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:10.914506 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309bc6e-ee4b-443a-9fb6-0f7bec715e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:10.914731 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309bc6e-ee4b-443a-9fb6-0f7bec715e34 admin admin] PATH_INFO: `/v3/users/1256d13e43234ef8b29496e8b4ae359d` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:10.916051 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309bc6e-ee4b-443a-9fb6-0f7bec715e34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1256d13e43234ef8b29496e8b4ae359d)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:12:10.918083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309bc6e-ee4b-443a-9fb6-0f7bec715e34 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:12:10.971592 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a309bc6e-ee4b-443a-9fb6-0f7bec715e34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1256d13e43234ef8b29496e8b4ae359d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:12:10.980804 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a309bc6e-ee4b-443a-9fb6-0f7bec715e34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1256d13e43234ef8b29496e8b4ae359d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:12:10.981792 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a309bc6e-ee4b-443a-9fb6-0f7bec715e34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1256d13e43234ef8b29496e8b4ae359d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:12:10.998936 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a309bc6e-ee4b-443a-9fb6-0f7bec715e34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1256d13e43234ef8b29496e8b4ae359d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:12:11.007358 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a309bc6e-ee4b-443a-9fb6-0f7bec715e34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1256d13e43234ef8b29496e8b4ae359d'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:12:11.014798 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1172/2334] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:12:10 2022] DELETE /identity/v3/users/1256d13e43234ef8b29496e8b4ae359d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:12:11.069264 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c0203-3acf-44a1-a482-2ed34f90fec2 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:11.069581 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c0203-3acf-44a1-a482-2ed34f90fec2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:11.069865 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c0203-3acf-44a1-a482-2ed34f90fec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:11.092305 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3d0c0203-3acf-44a1-a482-2ed34f90fec2 None None] MFA Rules not processed for user `5fc2803fed254f3b8a280df51891ec0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:12:11.093625 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3d0c0203-3acf-44a1-a482-2ed34f90fec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:12:11.156607 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1163/2335] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:12:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:12:11.203953 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309bc6e-ee4b-443a-9fb6-0f7bec715e34 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:12:11.205752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a309bc6e-ee4b-443a-9fb6-0f7bec715e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:12:11.282499 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309bc6e-ee4b-443a-9fb6-0f7bec715e34 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:12:11.289713 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461fb50-d571-4392-bc49-dae30441f168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:12:11.291516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461fb50-d571-4392-bc49-dae30441f168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:11.291961 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461fb50-d571-4392-bc49-dae30441f168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:11.292321 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461fb50-d571-4392-bc49-dae30441f168 admin admin] PATH_INFO: `/v3/projects/bbf7418da81e4d9bb042a3dbe1cb1b80` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:11.294456 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1461fb50-d571-4392-bc49-dae30441f168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbf7418da81e4d9bb042a3dbe1cb1b80)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:12:11.298395 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1461fb50-d571-4392-bc49-dae30441f168 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:12:11.361457 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1461fb50-d571-4392-bc49-dae30441f168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbf7418da81e4d9bb042a3dbe1cb1b80', 'request_id': 'req-1461fb50-d571-4392-bc49-dae30441f168'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:12:11.377717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1461fb50-d571-4392-bc49-dae30441f168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbf7418da81e4d9bb042a3dbe1cb1b80', 'request_id': 'req-1461fb50-d571-4392-bc49-dae30441f168'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:12:11.382137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:12:11.385453 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1461fb50-d571-4392-bc49-dae30441f168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbf7418da81e4d9bb042a3dbe1cb1b80', 'request_id': 'req-1461fb50-d571-4392-bc49-dae30441f168'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:12:11.402872 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1461fb50-d571-4392-bc49-dae30441f168 admin admin] The token cache is being invalidate because project bbf7418da81e4d9bb042a3dbe1cb1b80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:12:11.403306 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1461fb50-d571-4392-bc49-dae30441f168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:12:11.404137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-1461fb50-d571-4392-bc49-dae30441f168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:12:11.405777 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1173/2336] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:12:11 2022] DELETE /identity/v3/projects/bbf7418da81e4d9bb042a3dbe1cb1b80 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:12:11.502061 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c0203-3acf-44a1-a482-2ed34f90fec2 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:12:11.503712 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3d0c0203-3acf-44a1-a482-2ed34f90fec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:12:11.571595 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c0203-3acf-44a1-a482-2ed34f90fec2 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:12:11.637458 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42632e-b017-4f54-9304-c22606e0ebae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:12:11.638038 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42632e-b017-4f54-9304-c22606e0ebae service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:11.638319 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42632e-b017-4f54-9304-c22606e0ebae service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:11.638626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42632e-b017-4f54-9304-c22606e0ebae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:11.640632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8c42632e-b017-4f54-9304-c22606e0ebae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:12:11.650126 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42632e-b017-4f54-9304-c22606e0ebae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:12:11.651866 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42632e-b017-4f54-9304-c22606e0ebae service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:12:11.667472 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1164/2337] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:12:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:12:19.458032 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461fb50-d571-4392-bc49-dae30441f168 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:12:19.459560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1461fb50-d571-4392-bc49-dae30441f168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:12:19.525351 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461fb50-d571-4392-bc49-dae30441f168 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:12:19.530090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01dab5-df70-437e-9d6f-82aff18afabd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:12:19.530758 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01dab5-df70-437e-9d6f-82aff18afabd service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:19.531041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01dab5-df70-437e-9d6f-82aff18afabd service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:19.531317 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01dab5-df70-437e-9d6f-82aff18afabd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:19.533216 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-df01dab5-df70-437e-9d6f-82aff18afabd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:12:19.597854 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df01dab5-df70-437e-9d6f-82aff18afabd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:12:19.599303 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df01dab5-df70-437e-9d6f-82aff18afabd service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:12:19.608592 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1174/2338] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:12:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:12:19.871770 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42632e-b017-4f54-9304-c22606e0ebae service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:12:19.873469 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8c42632e-b017-4f54-9304-c22606e0ebae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:12:19.958171 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:12:19.983254 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42632e-b017-4f54-9304-c22606e0ebae service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:12:19.990793 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542f760-7740-4442-986f-102e2261cd63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:12:19.991475 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542f760-7740-4442-986f-102e2261cd63 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:19.991756 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542f760-7740-4442-986f-102e2261cd63 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:19.992193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542f760-7740-4442-986f-102e2261cd63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:19.993952 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9542f760-7740-4442-986f-102e2261cd63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:12:20.007592 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542f760-7740-4442-986f-102e2261cd63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:12:20.009463 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542f760-7740-4442-986f-102e2261cd63 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:12:20.020668 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1165/2339] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:12:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:12:23.717736 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01dab5-df70-437e-9d6f-82aff18afabd service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:12:23.719326 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-df01dab5-df70-437e-9d6f-82aff18afabd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:12:23.731315 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01dab5-df70-437e-9d6f-82aff18afabd service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:12:23.735316 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44e2b8-b9e6-4670-83e1-ff5b75542f07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:12:23.736044 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44e2b8-b9e6-4670-83e1-ff5b75542f07 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:23.736283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44e2b8-b9e6-4670-83e1-ff5b75542f07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:23.736602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44e2b8-b9e6-4670-83e1-ff5b75542f07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:23.738488 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5c44e2b8-b9e6-4670-83e1-ff5b75542f07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:12:23.815115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44e2b8-b9e6-4670-83e1-ff5b75542f07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:12:23.816606 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44e2b8-b9e6-4670-83e1-ff5b75542f07 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:12:23.826341 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1175/2340] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:12:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:12:29.605759 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542f760-7740-4442-986f-102e2261cd63 service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:12:29.607214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9542f760-7740-4442-986f-102e2261cd63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:12:29.627585 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542f760-7740-4442-986f-102e2261cd63 service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:12:29.651838 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b68d89-1213-4fd7-87a0-1c374ffca0f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:12:29.652555 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b68d89-1213-4fd7-87a0-1c374ffca0f7 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:29.652877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b68d89-1213-4fd7-87a0-1c374ffca0f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:29.653182 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b68d89-1213-4fd7-87a0-1c374ffca0f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:29.655192 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e3b68d89-1213-4fd7-87a0-1c374ffca0f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:12:29.686163 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b68d89-1213-4fd7-87a0-1c374ffca0f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:12:29.687822 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b68d89-1213-4fd7-87a0-1c374ffca0f7 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:12:29.730923 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1166/2341] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:12:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:12:33.541299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858b977-cf70-4daf-95c7-201446789cd4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:33.541924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858b977-cf70-4daf-95c7-201446789cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:33.541924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858b977-cf70-4daf-95c7-201446789cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:33.559674 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-0858b977-cf70-4daf-95c7-201446789cd4 None None] MFA Rules not processed for user `8bd7f018e42d45a5bea3c9ffaa567496`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:12:33.560912 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0858b977-cf70-4daf-95c7-201446789cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:12:33.567867 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1176/2342] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:12:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:12:39.707712 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=17 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:12:43.553943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:DELETE=1,keystone:SELECT=83 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:12:44.699888 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b68d89-1213-4fd7-87a0-1c374ffca0f7 service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:12:44.701329 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e3b68d89-1213-4fd7-87a0-1c374ffca0f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:12:44.713457 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b68d89-1213-4fd7-87a0-1c374ffca0f7 service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:12:44.717751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da601b2-4d55-4f55-b773-b967953fd3e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:12:44.718477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da601b2-4d55-4f55-b773-b967953fd3e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:44.718835 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da601b2-4d55-4f55-b773-b967953fd3e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:44.719197 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da601b2-4d55-4f55-b773-b967953fd3e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:44.721161 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3da601b2-4d55-4f55-b773-b967953fd3e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:12:44.799150 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da601b2-4d55-4f55-b773-b967953fd3e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:12:44.800688 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da601b2-4d55-4f55-b773-b967953fd3e5 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:12:44.811482 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1167/2343] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:12:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:12:48.462053 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858b977-cf70-4daf-95c7-201446789cd4 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:12:48.464205 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0858b977-cf70-4daf-95c7-201446789cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:12:48.484267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858b977-cf70-4daf-95c7-201446789cd4 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:12:48.490107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99551147-9e98-47b7-a0ff-55bf8e8bf87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:12:48.491741 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99551147-9e98-47b7-a0ff-55bf8e8bf87c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:48.492033 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99551147-9e98-47b7-a0ff-55bf8e8bf87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:48.492309 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99551147-9e98-47b7-a0ff-55bf8e8bf87c admin admin] PATH_INFO: `/v3/users/c9e6e9d4d6cb499cbd4c886534176b66` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:48.494371 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99551147-9e98-47b7-a0ff-55bf8e8bf87c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9e6e9d4d6cb499cbd4c886534176b66)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:12:48.496685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99551147-9e98-47b7-a0ff-55bf8e8bf87c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:12:48.554599 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-99551147-9e98-47b7-a0ff-55bf8e8bf87c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9e6e9d4d6cb499cbd4c886534176b66'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:12:48.565200 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-99551147-9e98-47b7-a0ff-55bf8e8bf87c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9e6e9d4d6cb499cbd4c886534176b66'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:12:48.566078 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-99551147-9e98-47b7-a0ff-55bf8e8bf87c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9e6e9d4d6cb499cbd4c886534176b66'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:12:48.586645 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-99551147-9e98-47b7-a0ff-55bf8e8bf87c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9e6e9d4d6cb499cbd4c886534176b66'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:12:48.596285 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-99551147-9e98-47b7-a0ff-55bf8e8bf87c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9e6e9d4d6cb499cbd4c886534176b66'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:12:48.604789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1177/2344] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:12:48 2022] DELETE /identity/v3/users/c9e6e9d4d6cb499cbd4c886534176b66 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:12:48.886922 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da601b2-4d55-4f55-b773-b967953fd3e5 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:12:48.896837 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da601b2-4d55-4f55-b773-b967953fd3e5 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:12:48.963637 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89813ea6-19e5-4384-9e8d-1c04480158ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:12:48.964573 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89813ea6-19e5-4384-9e8d-1c04480158ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:48.964864 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89813ea6-19e5-4384-9e8d-1c04480158ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:48.965146 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89813ea6-19e5-4384-9e8d-1c04480158ef admin admin] PATH_INFO: `/v3/projects/99307f83b09f476088dc1d7e3111b842` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:48.966377 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89813ea6-19e5-4384-9e8d-1c04480158ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=99307f83b09f476088dc1d7e3111b842)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:12:48.968303 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89813ea6-19e5-4384-9e8d-1c04480158ef admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:12:49.024490 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-89813ea6-19e5-4384-9e8d-1c04480158ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99307f83b09f476088dc1d7e3111b842', 'request_id': 'req-89813ea6-19e5-4384-9e8d-1c04480158ef'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:12:49.031553 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-89813ea6-19e5-4384-9e8d-1c04480158ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99307f83b09f476088dc1d7e3111b842', 'request_id': 'req-89813ea6-19e5-4384-9e8d-1c04480158ef'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:12:49.039135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-89813ea6-19e5-4384-9e8d-1c04480158ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99307f83b09f476088dc1d7e3111b842', 'request_id': 'req-89813ea6-19e5-4384-9e8d-1c04480158ef'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:12:49.051134 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-89813ea6-19e5-4384-9e8d-1c04480158ef admin admin] The token cache is being invalidate because project 99307f83b09f476088dc1d7e3111b842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:12:49.051428 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-89813ea6-19e5-4384-9e8d-1c04480158ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:12:49.052081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-89813ea6-19e5-4384-9e8d-1c04480158ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:12:49.053874 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1168/2345] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:12:48 2022] DELETE /identity/v3/projects/99307f83b09f476088dc1d7e3111b842 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:12:49.059238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a07a8f-7e9f-4fb5-8777-1fde67466a8b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:49.059863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a07a8f-7e9f-4fb5-8777-1fde67466a8b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:49.060215 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a07a8f-7e9f-4fb5-8777-1fde67466a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:49.081998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-74a07a8f-7e9f-4fb5-8777-1fde67466a8b None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:12:49.083125 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-74a07a8f-7e9f-4fb5-8777-1fde67466a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:12:49.160075 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1178/2346] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:12:49.161935 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437abb3-2b7d-4141-bc64-56924121542c None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:49.162222 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437abb3-2b7d-4141-bc64-56924121542c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:49.162499 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437abb3-2b7d-4141-bc64-56924121542c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:49.183028 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3437abb3-2b7d-4141-bc64-56924121542c None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:12:49.184236 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3437abb3-2b7d-4141-bc64-56924121542c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:12:49.192543 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1169/2347] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:12:49.197264 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a07a8f-7e9f-4fb5-8777-1fde67466a8b None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:12:49.208699 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a07a8f-7e9f-4fb5-8777-1fde67466a8b None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:12:49.214157 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac00128-3a29-4a81-a364-ee29fd2b372f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:12:49.214850 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac00128-3a29-4a81-a364-ee29fd2b372f admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:49.215138 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac00128-3a29-4a81-a364-ee29fd2b372f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:49.215416 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac00128-3a29-4a81-a364-ee29fd2b372f admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:49.216158 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac00128-3a29-4a81-a364-ee29fd2b372f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:12:49.216514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac00128-3a29-4a81-a364-ee29fd2b372f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:12:49.218196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac00128-3a29-4a81-a364-ee29fd2b372f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:12:49.231396 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1179/2348] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:12:49.235674 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437abb3-2b7d-4141-bc64-56924121542c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:12:49.246513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437abb3-2b7d-4141-bc64-56924121542c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:12:49.252438 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8f36b-b4b3-4b94-94c5-9cf1b4c22308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:12:49.253098 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8f36b-b4b3-4b94-94c5-9cf1b4c22308 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:49.253381 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8f36b-b4b3-4b94-94c5-9cf1b4c22308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:49.253654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8f36b-b4b3-4b94-94c5-9cf1b4c22308 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:49.254361 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8f36b-b4b3-4b94-94c5-9cf1b4c22308 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:12:49.256323 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8f36b-b4b3-4b94-94c5-9cf1b4c22308 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:12:49.272775 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:12:49.302191 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1170/2349] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:12:49 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:12:49.303651 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac00128-3a29-4a81-a364-ee29fd2b372f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:12:49.315529 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac00128-3a29-4a81-a364-ee29fd2b372f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:12:49.377088 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60480f-e309-4903-a49d-ab9c505dfd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:12:49.377796 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60480f-e309-4903-a49d-ab9c505dfd40 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:49.378074 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60480f-e309-4903-a49d-ab9c505dfd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:49.378376 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60480f-e309-4903-a49d-ab9c505dfd40 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:49.379089 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60480f-e309-4903-a49d-ab9c505dfd40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:12:49.381078 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60480f-e309-4903-a49d-ab9c505dfd40 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:12:49.388383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:12:49.409217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8f36b-b4b3-4b94-94c5-9cf1b4c22308 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:12:49.410050 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1180/2350] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:12:49 2022] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:12:49.420753 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8f36b-b4b3-4b94-94c5-9cf1b4c22308 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:12:49.425657 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198c6ea-1c75-4f05-a5f5-185001f70c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:12:49.426340 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198c6ea-1c75-4f05-a5f5-185001f70c2e admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:49.426630 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198c6ea-1c75-4f05-a5f5-185001f70c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:49.426904 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198c6ea-1c75-4f05-a5f5-185001f70c2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:49.427653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198c6ea-1c75-4f05-a5f5-185001f70c2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:12:49.429347 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198c6ea-1c75-4f05-a5f5-185001f70c2e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:12:49.441563 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1171/2351] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:12:49.445576 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60480f-e309-4903-a49d-ab9c505dfd40 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:12:49.455784 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60480f-e309-4903-a49d-ab9c505dfd40 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:12:49.460809 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93954945-9316-484b-9b4e-3202c1243a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:12:49.461483 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93954945-9316-484b-9b4e-3202c1243a7a admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:49.461770 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93954945-9316-484b-9b4e-3202c1243a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:49.462044 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93954945-9316-484b-9b4e-3202c1243a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:49.463087 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93954945-9316-484b-9b4e-3202c1243a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:12:49.464640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93954945-9316-484b-9b4e-3202c1243a7a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:12:49.475414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1181/2352] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:12:49.480432 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198c6ea-1c75-4f05-a5f5-185001f70c2e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:12:49.490852 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198c6ea-1c75-4f05-a5f5-185001f70c2e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:12:49.496201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eecaf9-b7f6-45fc-a4a0-ca15347e0bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:12:49.497753 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eecaf9-b7f6-45fc-a4a0-ca15347e0bde admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:49.498038 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eecaf9-b7f6-45fc-a4a0-ca15347e0bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:49.498313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eecaf9-b7f6-45fc-a4a0-ca15347e0bde admin admin] PATH_INFO: `/v3/projects/5909239e31bc49d3a4aacfe4ad586501/users/264a11c6e1ad4226a4e1ed85afb4543e/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:49.516648 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eecaf9-b7f6-45fc-a4a0-ca15347e0bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=5909239e31bc49d3a4aacfe4ad586501, user_id=264a11c6e1ad4226a4e1ed85afb4543e, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:12:49.517791 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eecaf9-b7f6-45fc-a4a0-ca15347e0bde admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:12:49.532889 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1172/2353] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:12:49 2022] PUT /identity/v3/projects/5909239e31bc49d3a4aacfe4ad586501/users/264a11c6e1ad4226a4e1ed85afb4543e/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:12:49.543869 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73567e2b-f843-4c60-a11a-e751ff5f6e44 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:49.544285 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73567e2b-f843-4c60-a11a-e751ff5f6e44 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:49.544661 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73567e2b-f843-4c60-a11a-e751ff5f6e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:49.574840 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-73567e2b-f843-4c60-a11a-e751ff5f6e44 None None] MFA Rules not processed for user `264a11c6e1ad4226a4e1ed85afb4543e`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:12:49.576060 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-73567e2b-f843-4c60-a11a-e751ff5f6e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:12:49.646620 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1182/2354] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:12:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:12:49.650998 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eecaf9-b7f6-45fc-a4a0-ca15347e0bde admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:12:49.715689 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eecaf9-b7f6-45fc-a4a0-ca15347e0bde admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:12:49.720435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751f3e6-76b7-41c9-89e8-35c4c8439489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:12:49.721102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751f3e6-76b7-41c9-89e8-35c4c8439489 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:49.721389 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751f3e6-76b7-41c9-89e8-35c4c8439489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:49.721664 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751f3e6-76b7-41c9-89e8-35c4c8439489 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:49.722367 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751f3e6-76b7-41c9-89e8-35c4c8439489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:12:49.724272 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751f3e6-76b7-41c9-89e8-35c4c8439489 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:12:49.754629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1173/2355] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:12:49 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:12:49.758626 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73567e2b-f843-4c60-a11a-e751ff5f6e44 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:12:49.769784 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73567e2b-f843-4c60-a11a-e751ff5f6e44 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:12:49.836478 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcd6c8-690a-4bd1-8611-68dbe9f32ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:12:49.847254 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcd6c8-690a-4bd1-8611-68dbe9f32ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:49.847601 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcd6c8-690a-4bd1-8611-68dbe9f32ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:49.847831 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcd6c8-690a-4bd1-8611-68dbe9f32ec7 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:49.848576 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbcd6c8-690a-4bd1-8611-68dbe9f32ec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:12:49.850588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbcd6c8-690a-4bd1-8611-68dbe9f32ec7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:12:49.875134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1183/2356] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:12:49 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:12:49.878792 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751f3e6-76b7-41c9-89e8-35c4c8439489 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:12:49.890286 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751f3e6-76b7-41c9-89e8-35c4c8439489 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:12:49.901764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdfa95-525b-4c71-9dd1-198af6add5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:12:49.902357 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdfa95-525b-4c71-9dd1-198af6add5bb admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:49.902647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdfa95-525b-4c71-9dd1-198af6add5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:49.902919 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdfa95-525b-4c71-9dd1-198af6add5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:49.903653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdfa95-525b-4c71-9dd1-198af6add5bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:12:49.906066 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdfa95-525b-4c71-9dd1-198af6add5bb admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:12:49.918942 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1174/2357] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:12:49.922954 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcd6c8-690a-4bd1-8611-68dbe9f32ec7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:12:49.933325 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcd6c8-690a-4bd1-8611-68dbe9f32ec7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:12:49.941697 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45060c42-2c33-4497-b2a2-396b4cc08b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:12:49.942745 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45060c42-2c33-4497-b2a2-396b4cc08b80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:49.943112 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45060c42-2c33-4497-b2a2-396b4cc08b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:49.943469 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45060c42-2c33-4497-b2a2-396b4cc08b80 admin admin] PATH_INFO: `/v3/projects/f8afd09c90a148ebbb980a437503fa7d/users/4875ef6f775e446da31314e97c20de37/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:49.963201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45060c42-2c33-4497-b2a2-396b4cc08b80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8afd09c90a148ebbb980a437503fa7d, user_id=4875ef6f775e446da31314e97c20de37, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:12:49.966408 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45060c42-2c33-4497-b2a2-396b4cc08b80 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:12:49.983619 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1184/2358] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:12:49 2022] PUT /identity/v3/projects/f8afd09c90a148ebbb980a437503fa7d/users/4875ef6f775e446da31314e97c20de37/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:12:49.984702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdfa95-525b-4c71-9dd1-198af6add5bb admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:12:49.996531 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdfa95-525b-4c71-9dd1-198af6add5bb admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:12:50.071285 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fae512-78d0-476b-90f9-f090868c29a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:12:50.073377 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fae512-78d0-476b-90f9-f090868c29a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:50.073669 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fae512-78d0-476b-90f9-f090868c29a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:50.073944 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fae512-78d0-476b-90f9-f090868c29a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:50.074685 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fae512-78d0-476b-90f9-f090868c29a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:12:50.076472 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fae512-78d0-476b-90f9-f090868c29a1 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:12:50.090644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1175/2359] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:12:50.092561 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45060c42-2c33-4497-b2a2-396b4cc08b80 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:12:50.104585 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45060c42-2c33-4497-b2a2-396b4cc08b80 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:12:50.110200 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad319b-27be-4f98-9669-d7431717a2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:12:50.111111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad319b-27be-4f98-9669-d7431717a2de admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:50.111397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad319b-27be-4f98-9669-d7431717a2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:50.111820 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad319b-27be-4f98-9669-d7431717a2de admin admin] PATH_INFO: `/v3/projects/f8afd09c90a148ebbb980a437503fa7d/users/4875ef6f775e446da31314e97c20de37/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:50.113900 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad319b-27be-4f98-9669-d7431717a2de admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8afd09c90a148ebbb980a437503fa7d, user_id=4875ef6f775e446da31314e97c20de37, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:12:50.116646 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad319b-27be-4f98-9669-d7431717a2de admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:12:50.130140 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1185/2360] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:12:50 2022] PUT /identity/v3/projects/f8afd09c90a148ebbb980a437503fa7d/users/4875ef6f775e446da31314e97c20de37/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:12:50.142465 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a622e-fff9-4406-8f18-ce847e486788 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:50.142985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a622e-fff9-4406-8f18-ce847e486788 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:50.143272 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a622e-fff9-4406-8f18-ce847e486788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:50.175799 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-0f4a622e-fff9-4406-8f18-ce847e486788 None None] MFA Rules not processed for user `4875ef6f775e446da31314e97c20de37`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:12:50.177197 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-0f4a622e-fff9-4406-8f18-ce847e486788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:12:50.188658 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:12:50.269497 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1176/2361] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:12:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:12:50.281569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad319b-27be-4f98-9669-d7431717a2de admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:12:50.283405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-52ad319b-27be-4f98-9669-d7431717a2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:12:50.317217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:12:50.382367 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad319b-27be-4f98-9669-d7431717a2de admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:12:50.387329 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c64814-9f91-430c-8ba4-8033aab9a99b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:12:50.388070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c64814-9f91-430c-8ba4-8033aab9a99b service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:50.388455 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c64814-9f91-430c-8ba4-8033aab9a99b service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:50.388810 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c64814-9f91-430c-8ba4-8033aab9a99b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:50.399071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c64814-9f91-430c-8ba4-8033aab9a99b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:12:50.401452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c64814-9f91-430c-8ba4-8033aab9a99b service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:12:50.413234 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1186/2362] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:12:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:12:50.495986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a622e-fff9-4406-8f18-ce847e486788 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:12:50.507342 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a622e-fff9-4406-8f18-ce847e486788 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:12:50.511563 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cad3e6-ca34-4efe-9179-ab60a90ff073 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:12:50.512385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cad3e6-ca34-4efe-9179-ab60a90ff073 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:12:50.521473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cad3e6-ca34-4efe-9179-ab60a90ff073 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:12:50.521473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cad3e6-ca34-4efe-9179-ab60a90ff073 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:12:50.574971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cad3e6-ca34-4efe-9179-ab60a90ff073 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:12:50.576728 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cad3e6-ca34-4efe-9179-ab60a90ff073 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:12:50.588572 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1177/2363] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:12:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:13:00.407812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=17 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:00.582246 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=52 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:21.116640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c64814-9f91-430c-8ba4-8033aab9a99b service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:21.194181 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c64814-9f91-430c-8ba4-8033aab9a99b service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:21.198950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a062e3-7153-4f2d-ab4f-238abaa5bd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:21.199891 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a062e3-7153-4f2d-ab4f-238abaa5bd88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:21.200175 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a062e3-7153-4f2d-ab4f-238abaa5bd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:21.200566 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a062e3-7153-4f2d-ab4f-238abaa5bd88 admin admin] PATH_INFO: `/v3/users/264a11c6e1ad4226a4e1ed85afb4543e` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:21.201787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a062e3-7153-4f2d-ab4f-238abaa5bd88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=264a11c6e1ad4226a4e1ed85afb4543e)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:21.203716 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a062e3-7153-4f2d-ab4f-238abaa5bd88 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:21.253999 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e1a062e3-7153-4f2d-ab4f-238abaa5bd88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '264a11c6e1ad4226a4e1ed85afb4543e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:21.261223 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e1a062e3-7153-4f2d-ab4f-238abaa5bd88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '264a11c6e1ad4226a4e1ed85afb4543e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:21.261982 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e1a062e3-7153-4f2d-ab4f-238abaa5bd88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '264a11c6e1ad4226a4e1ed85afb4543e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:21.273827 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e1a062e3-7153-4f2d-ab4f-238abaa5bd88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '264a11c6e1ad4226a4e1ed85afb4543e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:21.281773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e1a062e3-7153-4f2d-ab4f-238abaa5bd88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '264a11c6e1ad4226a4e1ed85afb4543e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:21.296743 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1187/2364] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:13:21 2022] DELETE /identity/v3/users/264a11c6e1ad4226a4e1ed85afb4543e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:13:21.301286 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c71e6-650c-415f-abf7-3c1380095429 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:21.301766 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c71e6-650c-415f-abf7-3c1380095429 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:21.301904 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c71e6-650c-415f-abf7-3c1380095429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:21.320435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-133c71e6-650c-415f-abf7-3c1380095429 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:13:21.321674 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-133c71e6-650c-415f-abf7-3c1380095429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:21.404564 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1178/2365] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:13:21.414253 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a062e3-7153-4f2d-ab4f-238abaa5bd88 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:21.415665 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e1a062e3-7153-4f2d-ab4f-238abaa5bd88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:21.474457 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a062e3-7153-4f2d-ab4f-238abaa5bd88 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:21.478151 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54f3d1-eacf-4cab-b8cb-f7e9605d3b2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:21.478829 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54f3d1-eacf-4cab-b8cb-f7e9605d3b2c service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:21.479117 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54f3d1-eacf-4cab-b8cb-f7e9605d3b2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:21.479398 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54f3d1-eacf-4cab-b8cb-f7e9605d3b2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:21.489010 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54f3d1-eacf-4cab-b8cb-f7e9605d3b2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:21.490460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54f3d1-eacf-4cab-b8cb-f7e9605d3b2c service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:21.500271 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1188/2366] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:13:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:13:21.903110 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c71e6-650c-415f-abf7-3c1380095429 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:21.904829 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-133c71e6-650c-415f-abf7-3c1380095429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:21.917382 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c71e6-650c-415f-abf7-3c1380095429 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:21.922523 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f0e3d-30b2-4f7b-9181-a9c0b61de992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:21.923430 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f0e3d-30b2-4f7b-9181-a9c0b61de992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:21.923695 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f0e3d-30b2-4f7b-9181-a9c0b61de992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:21.923988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f0e3d-30b2-4f7b-9181-a9c0b61de992 admin admin] PATH_INFO: `/v3/projects/5909239e31bc49d3a4aacfe4ad586501` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:21.925284 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f0e3d-30b2-4f7b-9181-a9c0b61de992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5909239e31bc49d3a4aacfe4ad586501)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:21.927203 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f0e3d-30b2-4f7b-9181-a9c0b61de992 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:21.984351 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f83f0e3d-30b2-4f7b-9181-a9c0b61de992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5909239e31bc49d3a4aacfe4ad586501', 'request_id': 'req-f83f0e3d-30b2-4f7b-9181-a9c0b61de992'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:21.990529 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f83f0e3d-30b2-4f7b-9181-a9c0b61de992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5909239e31bc49d3a4aacfe4ad586501', 'request_id': 'req-f83f0e3d-30b2-4f7b-9181-a9c0b61de992'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:21.999068 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f83f0e3d-30b2-4f7b-9181-a9c0b61de992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5909239e31bc49d3a4aacfe4ad586501', 'request_id': 'req-f83f0e3d-30b2-4f7b-9181-a9c0b61de992'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:22.010597 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f83f0e3d-30b2-4f7b-9181-a9c0b61de992 admin admin] The token cache is being invalidate because project 5909239e31bc49d3a4aacfe4ad586501 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:13:22.010872 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f83f0e3d-30b2-4f7b-9181-a9c0b61de992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:22.012313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-f83f0e3d-30b2-4f7b-9181-a9c0b61de992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:22.014021 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1179/2367] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:13:21 2022] DELETE /identity/v3/projects/5909239e31bc49d3a4aacfe4ad586501 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:13:22.019113 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54f3d1-eacf-4cab-b8cb-f7e9605d3b2c service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:22.033492 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54f3d1-eacf-4cab-b8cb-f7e9605d3b2c service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:22.052170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:22.101967 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2382d3-1dfc-4328-850a-37470124e35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:22.102846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2382d3-1dfc-4328-850a-37470124e35b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:22.103163 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2382d3-1dfc-4328-850a-37470124e35b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:22.103522 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2382d3-1dfc-4328-850a-37470124e35b admin admin] PATH_INFO: `/v3/users/4875ef6f775e446da31314e97c20de37` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:22.104770 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2382d3-1dfc-4328-850a-37470124e35b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4875ef6f775e446da31314e97c20de37)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:22.106986 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2382d3-1dfc-4328-850a-37470124e35b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:22.164218 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4d2382d3-1dfc-4328-850a-37470124e35b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4875ef6f775e446da31314e97c20de37'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:22.171522 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4d2382d3-1dfc-4328-850a-37470124e35b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4875ef6f775e446da31314e97c20de37'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:22.172205 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4d2382d3-1dfc-4328-850a-37470124e35b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4875ef6f775e446da31314e97c20de37'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:22.185773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4d2382d3-1dfc-4328-850a-37470124e35b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4875ef6f775e446da31314e97c20de37'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:22.193909 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-4d2382d3-1dfc-4328-850a-37470124e35b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4875ef6f775e446da31314e97c20de37'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:22.203287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1189/2368] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:13:22 2022] DELETE /identity/v3/users/4875ef6f775e446da31314e97c20de37 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:13:22.495033 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f0e3d-30b2-4f7b-9181-a9c0b61de992 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:22.497654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f83f0e3d-30b2-4f7b-9181-a9c0b61de992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:22.512753 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f0e3d-30b2-4f7b-9181-a9c0b61de992 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:22.573325 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb352299-7904-4bd7-899b-ff6f762fdb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:22.574722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb352299-7904-4bd7-899b-ff6f762fdb56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:22.575012 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb352299-7904-4bd7-899b-ff6f762fdb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:22.575291 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb352299-7904-4bd7-899b-ff6f762fdb56 admin admin] PATH_INFO: `/v3/projects/f8afd09c90a148ebbb980a437503fa7d` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:22.576564 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb352299-7904-4bd7-899b-ff6f762fdb56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8afd09c90a148ebbb980a437503fa7d)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:22.578481 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb352299-7904-4bd7-899b-ff6f762fdb56 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:22.611135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:22.628673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-fb352299-7904-4bd7-899b-ff6f762fdb56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8afd09c90a148ebbb980a437503fa7d', 'request_id': 'req-fb352299-7904-4bd7-899b-ff6f762fdb56'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:22.635007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-fb352299-7904-4bd7-899b-ff6f762fdb56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8afd09c90a148ebbb980a437503fa7d', 'request_id': 'req-fb352299-7904-4bd7-899b-ff6f762fdb56'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:22.645159 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-fb352299-7904-4bd7-899b-ff6f762fdb56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8afd09c90a148ebbb980a437503fa7d', 'request_id': 'req-fb352299-7904-4bd7-899b-ff6f762fdb56'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:22.658015 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-fb352299-7904-4bd7-899b-ff6f762fdb56 admin admin] The token cache is being invalidate because project f8afd09c90a148ebbb980a437503fa7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:13:22.658307 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-fb352299-7904-4bd7-899b-ff6f762fdb56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:22.658991 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-fb352299-7904-4bd7-899b-ff6f762fdb56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:22.660556 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1180/2369] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:13:22 2022] DELETE /identity/v3/projects/f8afd09c90a148ebbb980a437503fa7d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:13:22.665483 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e32772-c2d0-4ebb-8dc1-4e71a6daccd1 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:22.665770 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e32772-c2d0-4ebb-8dc1-4e71a6daccd1 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:22.666042 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e32772-c2d0-4ebb-8dc1-4e71a6daccd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:22.685661 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e5e32772-c2d0-4ebb-8dc1-4e71a6daccd1 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:13:22.686855 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e5e32772-c2d0-4ebb-8dc1-4e71a6daccd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:22.751352 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1190/2370] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:13:22.760045 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258bb2d-e183-45b6-bd62-83c98609bb96 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:22.760331 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258bb2d-e183-45b6-bd62-83c98609bb96 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:22.760760 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258bb2d-e183-45b6-bd62-83c98609bb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:22.780357 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1258bb2d-e183-45b6-bd62-83c98609bb96 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:13:22.781608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1258bb2d-e183-45b6-bd62-83c98609bb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:22.789882 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1181/2371] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:13:22.794396 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e32772-c2d0-4ebb-8dc1-4e71a6daccd1 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:22.805228 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e32772-c2d0-4ebb-8dc1-4e71a6daccd1 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:22.811281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f0f4a-1f9c-427c-bd44-83c4f388dfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:22.811960 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f0f4a-1f9c-427c-bd44-83c4f388dfa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:22.812260 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f0f4a-1f9c-427c-bd44-83c4f388dfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:22.812552 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f0f4a-1f9c-427c-bd44-83c4f388dfa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:22.813300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f0f4a-1f9c-427c-bd44-83c4f388dfa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:13:22.813622 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f0f4a-1f9c-427c-bd44-83c4f388dfa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:22.815268 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f0f4a-1f9c-427c-bd44-83c4f388dfa7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:22.828165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1191/2372] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:13:22.832583 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258bb2d-e183-45b6-bd62-83c98609bb96 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:22.842401 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258bb2d-e183-45b6-bd62-83c98609bb96 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:22.847193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b2935-0ac6-43c5-9bb8-8c6337fcc485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:22.847848 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b2935-0ac6-43c5-9bb8-8c6337fcc485 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:22.848134 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b2935-0ac6-43c5-9bb8-8c6337fcc485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:22.848432 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b2935-0ac6-43c5-9bb8-8c6337fcc485 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:22.857382 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b2935-0ac6-43c5-9bb8-8c6337fcc485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:22.859465 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b2935-0ac6-43c5-9bb8-8c6337fcc485 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:22.886891 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1182/2373] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:13:22 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:13:22.890947 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f0f4a-1f9c-427c-bd44-83c4f388dfa7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:22.901441 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f0f4a-1f9c-427c-bd44-83c4f388dfa7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:22.932017 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:22.966988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578dc5a7-2ea0-42e8-85b5-cfc42d07543d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:22.967683 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dc5a7-2ea0-42e8-85b5-cfc42d07543d admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:22.967967 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dc5a7-2ea0-42e8-85b5-cfc42d07543d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:22.968246 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dc5a7-2ea0-42e8-85b5-cfc42d07543d admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:22.968986 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578dc5a7-2ea0-42e8-85b5-cfc42d07543d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:22.970931 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578dc5a7-2ea0-42e8-85b5-cfc42d07543d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:22.994653 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1192/2374] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:13:22 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:13:22.996486 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b2935-0ac6-43c5-9bb8-8c6337fcc485 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:23.015562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b2935-0ac6-43c5-9bb8-8c6337fcc485 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:23.023507 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e062a-f14a-494c-a1a8-34799eee1935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:23.024691 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e062a-f14a-494c-a1a8-34799eee1935 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:23.025208 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e062a-f14a-494c-a1a8-34799eee1935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:23.025759 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e062a-f14a-494c-a1a8-34799eee1935 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:23.027160 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e062a-f14a-494c-a1a8-34799eee1935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:23.029038 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e062a-f14a-494c-a1a8-34799eee1935 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:23.045851 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1183/2375] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:13:23.050088 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578dc5a7-2ea0-42e8-85b5-cfc42d07543d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:23.067399 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578dc5a7-2ea0-42e8-85b5-cfc42d07543d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:23.075562 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e1071-8f1c-49a1-a8fb-fd5ec466dd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:23.076483 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e1071-8f1c-49a1-a8fb-fd5ec466dd17 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:23.076655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e1071-8f1c-49a1-a8fb-fd5ec466dd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:23.076934 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e1071-8f1c-49a1-a8fb-fd5ec466dd17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:23.077671 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e1071-8f1c-49a1-a8fb-fd5ec466dd17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:23.079345 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e1071-8f1c-49a1-a8fb-fd5ec466dd17 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:23.090337 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1193/2376] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:13:23.094865 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e062a-f14a-494c-a1a8-34799eee1935 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:23.109714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e062a-f14a-494c-a1a8-34799eee1935 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:23.116851 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06371f-4a5d-436d-809b-e845f97824f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:23.117773 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06371f-4a5d-436d-809b-e845f97824f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:23.118059 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06371f-4a5d-436d-809b-e845f97824f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:23.118340 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06371f-4a5d-436d-809b-e845f97824f5 admin admin] PATH_INFO: `/v3/projects/5bbaca26193740b7a8c3bf888dd5c86b/users/c55bb090191144228838d2dd0f889c56/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:23.134264 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06371f-4a5d-436d-809b-e845f97824f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bbaca26193740b7a8c3bf888dd5c86b, user_id=c55bb090191144228838d2dd0f889c56, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:23.137434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06371f-4a5d-436d-809b-e845f97824f5 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:23.150193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1184/2377] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:13:23 2022] PUT /identity/v3/projects/5bbaca26193740b7a8c3bf888dd5c86b/users/c55bb090191144228838d2dd0f889c56/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:13:23.168150 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96451b3-d248-4e74-a977-6c60bf3ba9c7 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:23.168921 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96451b3-d248-4e74-a977-6c60bf3ba9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:23.168921 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96451b3-d248-4e74-a977-6c60bf3ba9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:23.197923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a96451b3-d248-4e74-a977-6c60bf3ba9c7 None None] MFA Rules not processed for user `c55bb090191144228838d2dd0f889c56`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:13:23.199310 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a96451b3-d248-4e74-a977-6c60bf3ba9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:23.265814 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1194/2378] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:13:23 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:13:23.269937 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06371f-4a5d-436d-809b-e845f97824f5 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:23.334282 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06371f-4a5d-436d-809b-e845f97824f5 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:23.338835 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2548af-8721-451c-8227-2391ad026be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:23.340291 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2548af-8721-451c-8227-2391ad026be2 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:23.340648 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2548af-8721-451c-8227-2391ad026be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:23.340937 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2548af-8721-451c-8227-2391ad026be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:23.341618 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2548af-8721-451c-8227-2391ad026be2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:23.343537 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2548af-8721-451c-8227-2391ad026be2 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:23.377563 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1185/2379] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:13:23 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:13:23.377682 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96451b3-d248-4e74-a977-6c60bf3ba9c7 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:23.385688 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96451b3-d248-4e74-a977-6c60bf3ba9c7 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:23.443337 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c36a3a-763e-4154-8be1-2cfd7e2965d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:23.444011 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c36a3a-763e-4154-8be1-2cfd7e2965d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:23.444292 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c36a3a-763e-4154-8be1-2cfd7e2965d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:23.444599 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c36a3a-763e-4154-8be1-2cfd7e2965d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:23.445306 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c36a3a-763e-4154-8be1-2cfd7e2965d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:23.447321 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c36a3a-763e-4154-8be1-2cfd7e2965d8 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:23.468088 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1195/2380] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:13:23 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:13:23.472126 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2548af-8721-451c-8227-2391ad026be2 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:23.485833 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2548af-8721-451c-8227-2391ad026be2 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:23.490512 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7431a7-d929-400f-a3c6-6dbba87d4074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:23.491177 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7431a7-d929-400f-a3c6-6dbba87d4074 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:23.491459 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7431a7-d929-400f-a3c6-6dbba87d4074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:23.491734 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7431a7-d929-400f-a3c6-6dbba87d4074 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:23.492490 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7431a7-d929-400f-a3c6-6dbba87d4074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:23.494101 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7431a7-d929-400f-a3c6-6dbba87d4074 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:23.505637 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1186/2381] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:13:23.510229 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c36a3a-763e-4154-8be1-2cfd7e2965d8 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:23.521080 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c36a3a-763e-4154-8be1-2cfd7e2965d8 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:23.525783 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54354fc-7ea8-4bae-9cfb-b8dbf1048b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:23.526716 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54354fc-7ea8-4bae-9cfb-b8dbf1048b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:23.527090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54354fc-7ea8-4bae-9cfb-b8dbf1048b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:23.527376 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54354fc-7ea8-4bae-9cfb-b8dbf1048b1c admin admin] PATH_INFO: `/v3/projects/9e3d3e66020941a5a91465c97634c9e1/users/425238b677224286af85131b1a99a1ba/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:23.543635 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54354fc-7ea8-4bae-9cfb-b8dbf1048b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3d3e66020941a5a91465c97634c9e1, user_id=425238b677224286af85131b1a99a1ba, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:23.546332 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54354fc-7ea8-4bae-9cfb-b8dbf1048b1c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:23.560971 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1196/2382] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:13:23 2022] PUT /identity/v3/projects/9e3d3e66020941a5a91465c97634c9e1/users/425238b677224286af85131b1a99a1ba/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:13:23.565027 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7431a7-d929-400f-a3c6-6dbba87d4074 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:23.575791 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7431a7-d929-400f-a3c6-6dbba87d4074 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:23.603178 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:23.647262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3da48c-90e3-4d44-9dd2-96b69369a6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:23.648130 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3da48c-90e3-4d44-9dd2-96b69369a6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:23.648498 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3da48c-90e3-4d44-9dd2-96b69369a6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:23.648848 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3da48c-90e3-4d44-9dd2-96b69369a6a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:23.649623 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3da48c-90e3-4d44-9dd2-96b69369a6a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:23.651274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3da48c-90e3-4d44-9dd2-96b69369a6a1 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:23.661809 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1187/2383] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:13:23.665993 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54354fc-7ea8-4bae-9cfb-b8dbf1048b1c admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:23.671729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:23.679707 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54354fc-7ea8-4bae-9cfb-b8dbf1048b1c admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:23.685717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21667704-ffc8-4c6b-be91-22efadabbbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:23.686646 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21667704-ffc8-4c6b-be91-22efadabbbf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:23.686937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21667704-ffc8-4c6b-be91-22efadabbbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:23.687222 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21667704-ffc8-4c6b-be91-22efadabbbf6 admin admin] PATH_INFO: `/v3/projects/9e3d3e66020941a5a91465c97634c9e1/users/425238b677224286af85131b1a99a1ba/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:23.690090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21667704-ffc8-4c6b-be91-22efadabbbf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3d3e66020941a5a91465c97634c9e1, user_id=425238b677224286af85131b1a99a1ba, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:23.693160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21667704-ffc8-4c6b-be91-22efadabbbf6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:23.704976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1197/2384] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:13:23 2022] PUT /identity/v3/projects/9e3d3e66020941a5a91465c97634c9e1/users/425238b677224286af85131b1a99a1ba/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:13:23.715197 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8ff8c-35ce-4567-a846-4abcf3e0b20b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:23.715502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8ff8c-35ce-4567-a846-4abcf3e0b20b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:23.715781 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8ff8c-35ce-4567-a846-4abcf3e0b20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:23.745159 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8aa8ff8c-35ce-4567-a846-4abcf3e0b20b None None] MFA Rules not processed for user `425238b677224286af85131b1a99a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:13:23.746935 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8aa8ff8c-35ce-4567-a846-4abcf3e0b20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:23.819563 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1188/2385] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:13:23 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:13:23.832569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21667704-ffc8-4c6b-be91-22efadabbbf6 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:23.834402 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-21667704-ffc8-4c6b-be91-22efadabbbf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:23.902671 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21667704-ffc8-4c6b-be91-22efadabbbf6 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:23.906349 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901dc85d-7d83-4f2a-ad72-dfe0315348f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:23.907009 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901dc85d-7d83-4f2a-ad72-dfe0315348f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:23.907297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901dc85d-7d83-4f2a-ad72-dfe0315348f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:23.907576 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901dc85d-7d83-4f2a-ad72-dfe0315348f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:23.917004 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901dc85d-7d83-4f2a-ad72-dfe0315348f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:23.918942 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901dc85d-7d83-4f2a-ad72-dfe0315348f8 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:23.928926 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1198/2386] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:13:23 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:13:24.014322 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8ff8c-35ce-4567-a846-4abcf3e0b20b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:24.024190 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8ff8c-35ce-4567-a846-4abcf3e0b20b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:24.027841 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7979c08-46e8-4931-b1a4-d2d54d42474c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:24.028545 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7979c08-46e8-4931-b1a4-d2d54d42474c service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:24.028831 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7979c08-46e8-4931-b1a4-d2d54d42474c service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:24.029107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7979c08-46e8-4931-b1a4-d2d54d42474c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:24.088092 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7979c08-46e8-4931-b1a4-d2d54d42474c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:24.089576 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7979c08-46e8-4931-b1a4-d2d54d42474c service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:24.100555 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1189/2387] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:13:24 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:13:29.034013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901dc85d-7d83-4f2a-ad72-dfe0315348f8 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:29.097784 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901dc85d-7d83-4f2a-ad72-dfe0315348f8 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:29.108584 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbd90c-1e42-4f09-95b7-e680d87bdd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:29.109494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbd90c-1e42-4f09-95b7-e680d87bdd8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:29.109775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbd90c-1e42-4f09-95b7-e680d87bdd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:29.110045 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbd90c-1e42-4f09-95b7-e680d87bdd8f admin admin] PATH_INFO: `/v3/users/c55bb090191144228838d2dd0f889c56` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:29.111320 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbd90c-1e42-4f09-95b7-e680d87bdd8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c55bb090191144228838d2dd0f889c56)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:29.113315 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbd90c-1e42-4f09-95b7-e680d87bdd8f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:29.161673 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-28fbd90c-1e42-4f09-95b7-e680d87bdd8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c55bb090191144228838d2dd0f889c56'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:29.169225 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-28fbd90c-1e42-4f09-95b7-e680d87bdd8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c55bb090191144228838d2dd0f889c56'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:29.170096 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-28fbd90c-1e42-4f09-95b7-e680d87bdd8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c55bb090191144228838d2dd0f889c56'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:29.182723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-28fbd90c-1e42-4f09-95b7-e680d87bdd8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c55bb090191144228838d2dd0f889c56'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:29.190314 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-28fbd90c-1e42-4f09-95b7-e680d87bdd8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c55bb090191144228838d2dd0f889c56'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:29.196365 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1199/2388] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:13:29 2022] DELETE /identity/v3/users/c55bb090191144228838d2dd0f889c56 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:13:29.201911 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8207b-d614-4cf1-a45c-f5b522420e3c None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:29.202378 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8207b-d614-4cf1-a45c-f5b522420e3c None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:29.202496 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8207b-d614-4cf1-a45c-f5b522420e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:29.221159 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-18c8207b-d614-4cf1-a45c-f5b522420e3c None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:13:29.222387 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-18c8207b-d614-4cf1-a45c-f5b522420e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:29.263493 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:29.283825 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1190/2389] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:13:29.293532 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbd90c-1e42-4f09-95b7-e680d87bdd8f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:29.295025 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-28fbd90c-1e42-4f09-95b7-e680d87bdd8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:29.308507 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:29.356077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbd90c-1e42-4f09-95b7-e680d87bdd8f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:29.359625 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe413945-15b6-4d0a-9bf7-8c2180c59d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:29.360266 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe413945-15b6-4d0a-9bf7-8c2180c59d4c service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:29.360584 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe413945-15b6-4d0a-9bf7-8c2180c59d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:29.360859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe413945-15b6-4d0a-9bf7-8c2180c59d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:29.371582 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe413945-15b6-4d0a-9bf7-8c2180c59d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:29.373127 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe413945-15b6-4d0a-9bf7-8c2180c59d4c service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:29.383114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1200/2390] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:13:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:13:29.670383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8207b-d614-4cf1-a45c-f5b522420e3c None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:29.671962 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-18c8207b-d614-4cf1-a45c-f5b522420e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:29.685576 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8207b-d614-4cf1-a45c-f5b522420e3c None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:29.690640 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515c8bd-9eae-42da-9283-cb1ad2427390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:29.691540 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515c8bd-9eae-42da-9283-cb1ad2427390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:29.691820 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515c8bd-9eae-42da-9283-cb1ad2427390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:29.692142 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515c8bd-9eae-42da-9283-cb1ad2427390 admin admin] PATH_INFO: `/v3/projects/5bbaca26193740b7a8c3bf888dd5c86b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:29.693428 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515c8bd-9eae-42da-9283-cb1ad2427390 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bbaca26193740b7a8c3bf888dd5c86b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:29.695370 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515c8bd-9eae-42da-9283-cb1ad2427390 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:29.748385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b515c8bd-9eae-42da-9283-cb1ad2427390 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bbaca26193740b7a8c3bf888dd5c86b', 'request_id': 'req-b515c8bd-9eae-42da-9283-cb1ad2427390'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:29.754546 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b515c8bd-9eae-42da-9283-cb1ad2427390 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bbaca26193740b7a8c3bf888dd5c86b', 'request_id': 'req-b515c8bd-9eae-42da-9283-cb1ad2427390'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:29.762607 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b515c8bd-9eae-42da-9283-cb1ad2427390 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bbaca26193740b7a8c3bf888dd5c86b', 'request_id': 'req-b515c8bd-9eae-42da-9283-cb1ad2427390'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:29.773334 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b515c8bd-9eae-42da-9283-cb1ad2427390 admin admin] The token cache is being invalidate because project 5bbaca26193740b7a8c3bf888dd5c86b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:13:29.773632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b515c8bd-9eae-42da-9283-cb1ad2427390 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:29.774272 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b515c8bd-9eae-42da-9283-cb1ad2427390 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:29.775845 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1191/2391] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:13:29 2022] DELETE /identity/v3/projects/5bbaca26193740b7a8c3bf888dd5c86b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:13:29.780864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe413945-15b6-4d0a-9bf7-8c2180c59d4c service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:29.791245 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe413945-15b6-4d0a-9bf7-8c2180c59d4c service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:29.858719 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c258713-55c5-4130-983e-b1c216b9b1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:29.859601 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c258713-55c5-4130-983e-b1c216b9b1da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:29.859890 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c258713-55c5-4130-983e-b1c216b9b1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:29.860166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c258713-55c5-4130-983e-b1c216b9b1da admin admin] PATH_INFO: `/v3/users/425238b677224286af85131b1a99a1ba` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:29.861417 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c258713-55c5-4130-983e-b1c216b9b1da admin admin] RBAC: Authorizing `identity:delete_user(user_id=425238b677224286af85131b1a99a1ba)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:29.863408 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c258713-55c5-4130-983e-b1c216b9b1da admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:29.914349 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6c258713-55c5-4130-983e-b1c216b9b1da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '425238b677224286af85131b1a99a1ba'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:29.921353 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6c258713-55c5-4130-983e-b1c216b9b1da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '425238b677224286af85131b1a99a1ba'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:29.922022 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6c258713-55c5-4130-983e-b1c216b9b1da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '425238b677224286af85131b1a99a1ba'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:29.933844 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6c258713-55c5-4130-983e-b1c216b9b1da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '425238b677224286af85131b1a99a1ba'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:29.941915 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6c258713-55c5-4130-983e-b1c216b9b1da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '425238b677224286af85131b1a99a1ba'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:29.949506 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1201/2392] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:13:29 2022] DELETE /identity/v3/users/425238b677224286af85131b1a99a1ba => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:13:30.250238 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515c8bd-9eae-42da-9283-cb1ad2427390 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:30.251867 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b515c8bd-9eae-42da-9283-cb1ad2427390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:30.266965 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515c8bd-9eae-42da-9283-cb1ad2427390 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:30.327963 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece7b38-e829-4125-8e72-38522c4eb777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:30.328878 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece7b38-e829-4125-8e72-38522c4eb777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:30.329164 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece7b38-e829-4125-8e72-38522c4eb777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:30.329473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece7b38-e829-4125-8e72-38522c4eb777 admin admin] PATH_INFO: `/v3/projects/9e3d3e66020941a5a91465c97634c9e1` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:30.330680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece7b38-e829-4125-8e72-38522c4eb777 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e3d3e66020941a5a91465c97634c9e1)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:30.332633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece7b38-e829-4125-8e72-38522c4eb777 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:30.382613 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5ece7b38-e829-4125-8e72-38522c4eb777 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e3d3e66020941a5a91465c97634c9e1', 'request_id': 'req-5ece7b38-e829-4125-8e72-38522c4eb777'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:30.389358 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5ece7b38-e829-4125-8e72-38522c4eb777 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e3d3e66020941a5a91465c97634c9e1', 'request_id': 'req-5ece7b38-e829-4125-8e72-38522c4eb777'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:30.397289 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5ece7b38-e829-4125-8e72-38522c4eb777 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e3d3e66020941a5a91465c97634c9e1', 'request_id': 'req-5ece7b38-e829-4125-8e72-38522c4eb777'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:30.404415 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:30.409841 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5ece7b38-e829-4125-8e72-38522c4eb777 admin admin] The token cache is being invalidate because project 9e3d3e66020941a5a91465c97634c9e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:13:30.410168 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5ece7b38-e829-4125-8e72-38522c4eb777 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:30.411179 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5ece7b38-e829-4125-8e72-38522c4eb777 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:30.418321 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1192/2393] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:13:30 2022] DELETE /identity/v3/projects/9e3d3e66020941a5a91465c97634c9e1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:13:30.423135 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6067c7-8da5-41ad-8947-6ef36202f73d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:30.423610 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6067c7-8da5-41ad-8947-6ef36202f73d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:30.423720 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6067c7-8da5-41ad-8947-6ef36202f73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:30.440949 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-fa6067c7-8da5-41ad-8947-6ef36202f73d None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:13:30.442153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-fa6067c7-8da5-41ad-8947-6ef36202f73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:30.481474 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:30.513984 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1202/2394] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:13:30.521850 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d517a12-010e-47de-9423-6f690f3b5000 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:30.522136 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d517a12-010e-47de-9423-6f690f3b5000 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:30.522417 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d517a12-010e-47de-9423-6f690f3b5000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:30.541531 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3d517a12-010e-47de-9423-6f690f3b5000 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:13:30.543334 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3d517a12-010e-47de-9423-6f690f3b5000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:30.551282 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1193/2395] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:13:30.555447 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6067c7-8da5-41ad-8947-6ef36202f73d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:30.565744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6067c7-8da5-41ad-8947-6ef36202f73d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:30.570547 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da11982-ade0-49b1-9222-1baad74685bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:30.571221 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da11982-ade0-49b1-9222-1baad74685bf admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:30.571503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da11982-ade0-49b1-9222-1baad74685bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:30.571774 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da11982-ade0-49b1-9222-1baad74685bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:30.572541 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da11982-ade0-49b1-9222-1baad74685bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:13:30.572845 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da11982-ade0-49b1-9222-1baad74685bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:30.575065 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da11982-ade0-49b1-9222-1baad74685bf admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:30.587099 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1203/2396] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:13:30.592164 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d517a12-010e-47de-9423-6f690f3b5000 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:30.601690 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d517a12-010e-47de-9423-6f690f3b5000 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:30.606499 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55414e95-bb48-4331-abbc-14f310964dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:30.607149 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55414e95-bb48-4331-abbc-14f310964dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:30.607428 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55414e95-bb48-4331-abbc-14f310964dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:30.607701 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55414e95-bb48-4331-abbc-14f310964dc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:30.608414 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55414e95-bb48-4331-abbc-14f310964dc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:30.610316 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55414e95-bb48-4331-abbc-14f310964dc6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:30.637577 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1194/2397] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:13:30 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:13:30.642090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da11982-ade0-49b1-9222-1baad74685bf admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:30.653641 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da11982-ade0-49b1-9222-1baad74685bf admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:30.712283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b094583-af75-40af-912e-eb0f4c72b33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:30.712987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b094583-af75-40af-912e-eb0f4c72b33d admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:30.713273 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b094583-af75-40af-912e-eb0f4c72b33d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:30.713550 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b094583-af75-40af-912e-eb0f4c72b33d admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:30.714239 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b094583-af75-40af-912e-eb0f4c72b33d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:30.717001 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b094583-af75-40af-912e-eb0f4c72b33d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:30.739418 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1204/2398] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:13:30 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:13:30.743559 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55414e95-bb48-4331-abbc-14f310964dc6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:30.754168 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55414e95-bb48-4331-abbc-14f310964dc6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:30.758725 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfee73-9234-4a6c-ab57-31215f2026d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:30.759380 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfee73-9234-4a6c-ab57-31215f2026d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:30.759661 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfee73-9234-4a6c-ab57-31215f2026d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:30.760325 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfee73-9234-4a6c-ab57-31215f2026d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:30.760949 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfee73-9234-4a6c-ab57-31215f2026d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:30.763184 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfee73-9234-4a6c-ab57-31215f2026d8 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:30.773951 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1195/2399] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:13:30.779044 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b094583-af75-40af-912e-eb0f4c72b33d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:30.788937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b094583-af75-40af-912e-eb0f4c72b33d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:30.793693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7bc1c6-6b47-452d-8063-a20c3e7b08d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:30.794346 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bc1c6-6b47-452d-8063-a20c3e7b08d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:30.794629 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bc1c6-6b47-452d-8063-a20c3e7b08d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:30.794904 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bc1c6-6b47-452d-8063-a20c3e7b08d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:30.795623 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7bc1c6-6b47-452d-8063-a20c3e7b08d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:30.797254 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7bc1c6-6b47-452d-8063-a20c3e7b08d0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:30.807117 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1205/2400] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:13:30.811245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfee73-9234-4a6c-ab57-31215f2026d8 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:30.821746 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfee73-9234-4a6c-ab57-31215f2026d8 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:30.827891 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35422f-0435-49d2-9327-ff9270f8788d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:30.828858 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35422f-0435-49d2-9327-ff9270f8788d admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:30.829137 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35422f-0435-49d2-9327-ff9270f8788d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:30.829416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35422f-0435-49d2-9327-ff9270f8788d admin admin] PATH_INFO: `/v3/projects/d6ace4c1ad5b46c3bb13225f18514939/users/0c393dc6eaed42caa6e8e029629eba78/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:30.845383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35422f-0435-49d2-9327-ff9270f8788d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6ace4c1ad5b46c3bb13225f18514939, user_id=0c393dc6eaed42caa6e8e029629eba78, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:30.848058 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35422f-0435-49d2-9327-ff9270f8788d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:30.861168 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1196/2401] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:13:30 2022] PUT /identity/v3/projects/d6ace4c1ad5b46c3bb13225f18514939/users/0c393dc6eaed42caa6e8e029629eba78/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:13:30.872515 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd9b7e-de5d-471f-90ad-ad05503fd6f1 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:30.872810 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd9b7e-de5d-471f-90ad-ad05503fd6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:30.873092 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd9b7e-de5d-471f-90ad-ad05503fd6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:30.903699 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d5bd9b7e-de5d-471f-90ad-ad05503fd6f1 None None] MFA Rules not processed for user `0c393dc6eaed42caa6e8e029629eba78`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:13:30.904885 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d5bd9b7e-de5d-471f-90ad-ad05503fd6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:30.970311 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1206/2402] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:13:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:13:30.974810 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35422f-0435-49d2-9327-ff9270f8788d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:31.039124 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35422f-0435-49d2-9327-ff9270f8788d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:31.044000 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f011e5f-a4d1-49f5-9a44-d90a8ab7c48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:31.044698 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f011e5f-a4d1-49f5-9a44-d90a8ab7c48d admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:31.044984 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f011e5f-a4d1-49f5-9a44-d90a8ab7c48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:31.045260 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f011e5f-a4d1-49f5-9a44-d90a8ab7c48d admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:31.045956 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f011e5f-a4d1-49f5-9a44-d90a8ab7c48d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:31.047904 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f011e5f-a4d1-49f5-9a44-d90a8ab7c48d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:31.075169 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1197/2403] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:13:30 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:13:31.079313 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd9b7e-de5d-471f-90ad-ad05503fd6f1 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:31.092290 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd9b7e-de5d-471f-90ad-ad05503fd6f1 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:31.118683 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:31.155219 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b48adc-335e-42e1-a869-debfdb412044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:31.155816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b48adc-335e-42e1-a869-debfdb412044 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:31.156101 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b48adc-335e-42e1-a869-debfdb412044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:31.156381 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b48adc-335e-42e1-a869-debfdb412044 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:31.157124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b48adc-335e-42e1-a869-debfdb412044 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:31.159048 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b48adc-335e-42e1-a869-debfdb412044 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:31.177906 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1207/2404] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:13:31 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:13:31.181926 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f011e5f-a4d1-49f5-9a44-d90a8ab7c48d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:31.193391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f011e5f-a4d1-49f5-9a44-d90a8ab7c48d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:31.199494 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0d7ee-4465-4c4c-9e3b-79d28da25e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:31.200245 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0d7ee-4465-4c4c-9e3b-79d28da25e0b admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:31.200573 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0d7ee-4465-4c4c-9e3b-79d28da25e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:31.200855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0d7ee-4465-4c4c-9e3b-79d28da25e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:31.201597 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0d7ee-4465-4c4c-9e3b-79d28da25e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:31.203324 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0d7ee-4465-4c4c-9e3b-79d28da25e0b admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:31.214808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1198/2405] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:13:31.218898 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b48adc-335e-42e1-a869-debfdb412044 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:31.229106 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b48adc-335e-42e1-a869-debfdb412044 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:31.234087 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d7dd1-657f-4511-8a1f-fddc12cf2886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:31.235053 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d7dd1-657f-4511-8a1f-fddc12cf2886 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:31.235341 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d7dd1-657f-4511-8a1f-fddc12cf2886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:31.235648 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d7dd1-657f-4511-8a1f-fddc12cf2886 admin admin] PATH_INFO: `/v3/projects/e1e11baed7944c4aa29161399ca66d9e/users/cd8698cc7126490db692aae15956d6b4/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:31.253277 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d7dd1-657f-4511-8a1f-fddc12cf2886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e11baed7944c4aa29161399ca66d9e, user_id=cd8698cc7126490db692aae15956d6b4, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:31.255959 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d7dd1-657f-4511-8a1f-fddc12cf2886 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:31.270168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1208/2406] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:13:31 2022] PUT /identity/v3/projects/e1e11baed7944c4aa29161399ca66d9e/users/cd8698cc7126490db692aae15956d6b4/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:13:31.274314 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0d7ee-4465-4c4c-9e3b-79d28da25e0b admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:31.285299 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0d7ee-4465-4c4c-9e3b-79d28da25e0b admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:31.347697 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4145a50-cbb4-4633-a830-f0effbb1140a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:31.348384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4145a50-cbb4-4633-a830-f0effbb1140a admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:31.348741 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4145a50-cbb4-4633-a830-f0effbb1140a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:31.348952 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4145a50-cbb4-4633-a830-f0effbb1140a admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:31.349690 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4145a50-cbb4-4633-a830-f0effbb1140a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:31.351518 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4145a50-cbb4-4633-a830-f0effbb1140a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:31.363801 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1199/2407] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:13:31.370556 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d7dd1-657f-4511-8a1f-fddc12cf2886 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:31.382211 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d7dd1-657f-4511-8a1f-fddc12cf2886 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:31.387432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a2ea5-8392-45fa-8c7b-ead6f3fb800a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:31.388346 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a2ea5-8392-45fa-8c7b-ead6f3fb800a admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:31.388658 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a2ea5-8392-45fa-8c7b-ead6f3fb800a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:31.388936 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a2ea5-8392-45fa-8c7b-ead6f3fb800a admin admin] PATH_INFO: `/v3/projects/e1e11baed7944c4aa29161399ca66d9e/users/cd8698cc7126490db692aae15956d6b4/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:31.390945 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a2ea5-8392-45fa-8c7b-ead6f3fb800a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e11baed7944c4aa29161399ca66d9e, user_id=cd8698cc7126490db692aae15956d6b4, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:31.393679 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a2ea5-8392-45fa-8c7b-ead6f3fb800a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:31.405205 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1209/2408] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:13:31 2022] PUT /identity/v3/projects/e1e11baed7944c4aa29161399ca66d9e/users/cd8698cc7126490db692aae15956d6b4/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:13:31.415317 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b89aba-9651-45c1-9998-81f5f334dd15 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:31.415539 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b89aba-9651-45c1-9998-81f5f334dd15 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:31.415815 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b89aba-9651-45c1-9998-81f5f334dd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:31.423260 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:31.444051 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b4b89aba-9651-45c1-9998-81f5f334dd15 None None] MFA Rules not processed for user `cd8698cc7126490db692aae15956d6b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:13:31.447208 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b4b89aba-9651-45c1-9998-81f5f334dd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:31.525317 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1200/2409] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:13:31 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:13:31.537126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a2ea5-8392-45fa-8c7b-ead6f3fb800a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:31.538942 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a20a2ea5-8392-45fa-8c7b-ead6f3fb800a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:31.597646 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a2ea5-8392-45fa-8c7b-ead6f3fb800a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:31.601795 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c69d9-b0e9-4ebb-b7a0-790ede9e4b26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:31.603111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c69d9-b0e9-4ebb-b7a0-790ede9e4b26 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:31.603377 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c69d9-b0e9-4ebb-b7a0-790ede9e4b26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:31.603779 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c69d9-b0e9-4ebb-b7a0-790ede9e4b26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:31.617741 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c69d9-b0e9-4ebb-b7a0-790ede9e4b26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:31.619191 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c69d9-b0e9-4ebb-b7a0-790ede9e4b26 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:31.628877 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1210/2410] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:13:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:13:32.207304 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b89aba-9651-45c1-9998-81f5f334dd15 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:32.272579 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b89aba-9651-45c1-9998-81f5f334dd15 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:32.285308 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ae67d-61dc-4cc9-afd0-9af3b792c41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:32.285308 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ae67d-61dc-4cc9-afd0-9af3b792c41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:32.285308 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ae67d-61dc-4cc9-afd0-9af3b792c41a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:32.285308 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ae67d-61dc-4cc9-afd0-9af3b792c41a admin admin] PATH_INFO: `/v3/users/0c393dc6eaed42caa6e8e029629eba78` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:32.286260 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ae67d-61dc-4cc9-afd0-9af3b792c41a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c393dc6eaed42caa6e8e029629eba78)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:32.286260 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ae67d-61dc-4cc9-afd0-9af3b792c41a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:32.330914 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5a9ae67d-61dc-4cc9-afd0-9af3b792c41a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c393dc6eaed42caa6e8e029629eba78'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:32.340094 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5a9ae67d-61dc-4cc9-afd0-9af3b792c41a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c393dc6eaed42caa6e8e029629eba78'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:32.352580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5a9ae67d-61dc-4cc9-afd0-9af3b792c41a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c393dc6eaed42caa6e8e029629eba78'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:32.353248 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5a9ae67d-61dc-4cc9-afd0-9af3b792c41a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c393dc6eaed42caa6e8e029629eba78'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:32.353857 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-5a9ae67d-61dc-4cc9-afd0-9af3b792c41a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c393dc6eaed42caa6e8e029629eba78'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:32.366617 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1201/2411] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:13:32 2022] DELETE /identity/v3/users/0c393dc6eaed42caa6e8e029629eba78 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:13:32.371570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3394a-f3ad-4904-9dc3-ee0741309231 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:32.371879 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3394a-f3ad-4904-9dc3-ee0741309231 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:32.372159 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3394a-f3ad-4904-9dc3-ee0741309231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:32.397512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-5eb3394a-f3ad-4904-9dc3-ee0741309231 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:13:32.398733 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5eb3394a-f3ad-4904-9dc3-ee0741309231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:32.475631 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1211/2412] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:13:32.485455 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ae67d-61dc-4cc9-afd0-9af3b792c41a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:32.486957 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5a9ae67d-61dc-4cc9-afd0-9af3b792c41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:32.499820 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:32.561805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ae67d-61dc-4cc9-afd0-9af3b792c41a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:32.565521 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee801e8-8cb4-4e2c-b544-ee1be97f961f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:32.566174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee801e8-8cb4-4e2c-b544-ee1be97f961f service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:32.566456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee801e8-8cb4-4e2c-b544-ee1be97f961f service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:32.566732 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee801e8-8cb4-4e2c-b544-ee1be97f961f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:32.576993 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee801e8-8cb4-4e2c-b544-ee1be97f961f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:32.578427 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee801e8-8cb4-4e2c-b544-ee1be97f961f service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:32.588059 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1202/2413] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:13:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:13:32.893489 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3394a-f3ad-4904-9dc3-ee0741309231 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:32.894996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5eb3394a-f3ad-4904-9dc3-ee0741309231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:32.913586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3394a-f3ad-4904-9dc3-ee0741309231 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:32.913586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d89abe-d117-4f99-998f-edb28cd1f9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:32.913586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d89abe-d117-4f99-998f-edb28cd1f9e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:32.913980 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d89abe-d117-4f99-998f-edb28cd1f9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:32.914169 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d89abe-d117-4f99-998f-edb28cd1f9e9 admin admin] PATH_INFO: `/v3/projects/d6ace4c1ad5b46c3bb13225f18514939` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:32.915423 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d89abe-d117-4f99-998f-edb28cd1f9e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6ace4c1ad5b46c3bb13225f18514939)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:32.918181 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d89abe-d117-4f99-998f-edb28cd1f9e9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:32.940513 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:32.975759 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-57d89abe-d117-4f99-998f-edb28cd1f9e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6ace4c1ad5b46c3bb13225f18514939', 'request_id': 'req-57d89abe-d117-4f99-998f-edb28cd1f9e9'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:32.984777 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-57d89abe-d117-4f99-998f-edb28cd1f9e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6ace4c1ad5b46c3bb13225f18514939', 'request_id': 'req-57d89abe-d117-4f99-998f-edb28cd1f9e9'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:32.990949 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-57d89abe-d117-4f99-998f-edb28cd1f9e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6ace4c1ad5b46c3bb13225f18514939', 'request_id': 'req-57d89abe-d117-4f99-998f-edb28cd1f9e9'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:33.002752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-57d89abe-d117-4f99-998f-edb28cd1f9e9 admin admin] The token cache is being invalidate because project d6ace4c1ad5b46c3bb13225f18514939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:13:33.003042 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-57d89abe-d117-4f99-998f-edb28cd1f9e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:33.003742 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-57d89abe-d117-4f99-998f-edb28cd1f9e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:33.005343 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1212/2414] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:13:32 2022] DELETE /identity/v3/projects/d6ace4c1ad5b46c3bb13225f18514939 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:13:33.009342 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee801e8-8cb4-4e2c-b544-ee1be97f961f service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:33.019780 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee801e8-8cb4-4e2c-b544-ee1be97f961f service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:33.077349 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32289d-17f6-467f-b7e5-bd3adfe5e24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:33.078422 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32289d-17f6-467f-b7e5-bd3adfe5e24f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:33.078708 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32289d-17f6-467f-b7e5-bd3adfe5e24f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:33.078985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32289d-17f6-467f-b7e5-bd3adfe5e24f admin admin] PATH_INFO: `/v3/users/cd8698cc7126490db692aae15956d6b4` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:33.080203 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32289d-17f6-467f-b7e5-bd3adfe5e24f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd8698cc7126490db692aae15956d6b4)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:33.082180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32289d-17f6-467f-b7e5-bd3adfe5e24f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:33.136913 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ff32289d-17f6-467f-b7e5-bd3adfe5e24f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd8698cc7126490db692aae15956d6b4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:33.144529 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ff32289d-17f6-467f-b7e5-bd3adfe5e24f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd8698cc7126490db692aae15956d6b4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:33.173153 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ff32289d-17f6-467f-b7e5-bd3adfe5e24f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd8698cc7126490db692aae15956d6b4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:33.174033 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ff32289d-17f6-467f-b7e5-bd3adfe5e24f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd8698cc7126490db692aae15956d6b4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:33.174783 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ff32289d-17f6-467f-b7e5-bd3adfe5e24f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd8698cc7126490db692aae15956d6b4'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:33.196515 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1203/2415] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:13:33 2022] DELETE /identity/v3/users/cd8698cc7126490db692aae15956d6b4 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:13:33.492642 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d89abe-d117-4f99-998f-edb28cd1f9e9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:33.494222 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-57d89abe-d117-4f99-998f-edb28cd1f9e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:33.507519 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d89abe-d117-4f99-998f-edb28cd1f9e9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:33.579987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2177d-1320-4b40-8d5c-f68b53cac0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:33.580690 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2177d-1320-4b40-8d5c-f68b53cac0ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:33.580981 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2177d-1320-4b40-8d5c-f68b53cac0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:33.589290 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2177d-1320-4b40-8d5c-f68b53cac0ca admin admin] PATH_INFO: `/v3/projects/e1e11baed7944c4aa29161399ca66d9e` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:33.590817 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2177d-1320-4b40-8d5c-f68b53cac0ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1e11baed7944c4aa29161399ca66d9e)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:33.593081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2177d-1320-4b40-8d5c-f68b53cac0ca admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:33.647810 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-25b2177d-1320-4b40-8d5c-f68b53cac0ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1e11baed7944c4aa29161399ca66d9e', 'request_id': 'req-25b2177d-1320-4b40-8d5c-f68b53cac0ca'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:33.655918 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-25b2177d-1320-4b40-8d5c-f68b53cac0ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1e11baed7944c4aa29161399ca66d9e', 'request_id': 'req-25b2177d-1320-4b40-8d5c-f68b53cac0ca'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:33.670528 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-25b2177d-1320-4b40-8d5c-f68b53cac0ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1e11baed7944c4aa29161399ca66d9e', 'request_id': 'req-25b2177d-1320-4b40-8d5c-f68b53cac0ca'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:33.687957 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-25b2177d-1320-4b40-8d5c-f68b53cac0ca admin admin] The token cache is being invalidate because project e1e11baed7944c4aa29161399ca66d9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:13:33.688357 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-25b2177d-1320-4b40-8d5c-f68b53cac0ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:33.689288 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-25b2177d-1320-4b40-8d5c-f68b53cac0ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:33.691137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1213/2416] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:13:33 2022] DELETE /identity/v3/projects/e1e11baed7944c4aa29161399ca66d9e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:13:33.696482 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938a9a4-f033-4bc5-895c-14a935e58bdb None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:33.697040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938a9a4-f033-4bc5-895c-14a935e58bdb None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:33.697040 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938a9a4-f033-4bc5-895c-14a935e58bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:33.715687 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b938a9a4-f033-4bc5-895c-14a935e58bdb None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:13:33.716939 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b938a9a4-f033-4bc5-895c-14a935e58bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:33.751882 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:33.788183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1204/2417] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:13:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:13:33.798987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224958f5-ba4b-41df-932e-aba087a8a4b6 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:33.799279 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224958f5-ba4b-41df-932e-aba087a8a4b6 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:33.799670 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224958f5-ba4b-41df-932e-aba087a8a4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:33.820149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-224958f5-ba4b-41df-932e-aba087a8a4b6 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:13:33.821469 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-224958f5-ba4b-41df-932e-aba087a8a4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:33.830388 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1214/2418] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:13:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:13:33.834698 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938a9a4-f033-4bc5-895c-14a935e58bdb None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:33.844987 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938a9a4-f033-4bc5-895c-14a935e58bdb None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:33.849714 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb32cb-1ac1-47b2-a5dd-d980762ac359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:33.850394 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb32cb-1ac1-47b2-a5dd-d980762ac359 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:33.850705 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb32cb-1ac1-47b2-a5dd-d980762ac359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:33.850984 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb32cb-1ac1-47b2-a5dd-d980762ac359 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:33.851717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb32cb-1ac1-47b2-a5dd-d980762ac359 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:13:33.852026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb32cb-1ac1-47b2-a5dd-d980762ac359 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:33.853669 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb32cb-1ac1-47b2-a5dd-d980762ac359 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:33.866690 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1205/2419] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:13:33.872076 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224958f5-ba4b-41df-932e-aba087a8a4b6 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:33.881396 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224958f5-ba4b-41df-932e-aba087a8a4b6 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:33.886576 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bacc7-6f1a-40d9-9ff7-8e7fe5c907be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:33.887230 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bacc7-6f1a-40d9-9ff7-8e7fe5c907be admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:33.887517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bacc7-6f1a-40d9-9ff7-8e7fe5c907be admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:33.887796 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bacc7-6f1a-40d9-9ff7-8e7fe5c907be admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:33.888516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396bacc7-6f1a-40d9-9ff7-8e7fe5c907be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:33.890467 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396bacc7-6f1a-40d9-9ff7-8e7fe5c907be admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:33.922313 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1215/2420] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:13:33 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:13:33.926459 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb32cb-1ac1-47b2-a5dd-d980762ac359 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:33.937393 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb32cb-1ac1-47b2-a5dd-d980762ac359 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:34.003972 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b05393-9e62-4112-9827-7bc00cb17992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:34.004712 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b05393-9e62-4112-9827-7bc00cb17992 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:34.005029 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b05393-9e62-4112-9827-7bc00cb17992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:34.005316 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b05393-9e62-4112-9827-7bc00cb17992 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:34.006079 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b05393-9e62-4112-9827-7bc00cb17992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:34.008160 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b05393-9e62-4112-9827-7bc00cb17992 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:34.029908 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1206/2421] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:13:33 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:13:34.034047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bacc7-6f1a-40d9-9ff7-8e7fe5c907be admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:34.045493 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bacc7-6f1a-40d9-9ff7-8e7fe5c907be admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:34.050368 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affae269-a6fa-4604-9f32-950c10bf0172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:34.051057 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affae269-a6fa-4604-9f32-950c10bf0172 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:34.051343 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affae269-a6fa-4604-9f32-950c10bf0172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:34.051622 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affae269-a6fa-4604-9f32-950c10bf0172 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:34.052360 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affae269-a6fa-4604-9f32-950c10bf0172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:34.054036 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affae269-a6fa-4604-9f32-950c10bf0172 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:34.056640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:34.068051 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1216/2422] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:13:34.072215 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b05393-9e62-4112-9827-7bc00cb17992 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:34.082514 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b05393-9e62-4112-9827-7bc00cb17992 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:34.087302 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a83931-0d18-41af-a120-51000724e488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:34.087959 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a83931-0d18-41af-a120-51000724e488 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:34.088250 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a83931-0d18-41af-a120-51000724e488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:34.088576 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a83931-0d18-41af-a120-51000724e488 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:34.089838 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a83931-0d18-41af-a120-51000724e488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:34.091638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a83931-0d18-41af-a120-51000724e488 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:34.104464 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1207/2423] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:13:34.109697 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affae269-a6fa-4604-9f32-950c10bf0172 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:34.119851 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affae269-a6fa-4604-9f32-950c10bf0172 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:34.124419 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47742c-4706-43c9-8bb5-a1d1c96e0a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:34.125315 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47742c-4706-43c9-8bb5-a1d1c96e0a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:34.125597 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47742c-4706-43c9-8bb5-a1d1c96e0a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:34.125879 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47742c-4706-43c9-8bb5-a1d1c96e0a48 admin admin] PATH_INFO: `/v3/projects/551768e0f68742049e7f8e05eed25c0e/users/4bb0f3d7219c4a0d84d72563783f0050/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:34.140664 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47742c-4706-43c9-8bb5-a1d1c96e0a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=551768e0f68742049e7f8e05eed25c0e, user_id=4bb0f3d7219c4a0d84d72563783f0050, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:34.143305 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47742c-4706-43c9-8bb5-a1d1c96e0a48 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:34.157259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1217/2424] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:13:34 2022] PUT /identity/v3/projects/551768e0f68742049e7f8e05eed25c0e/users/4bb0f3d7219c4a0d84d72563783f0050/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:13:34.169472 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf8095-97c8-4cf9-b570-5463517d9434 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:34.169757 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf8095-97c8-4cf9-b570-5463517d9434 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:34.170037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf8095-97c8-4cf9-b570-5463517d9434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:34.197555 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-52cf8095-97c8-4cf9-b570-5463517d9434 None None] MFA Rules not processed for user `4bb0f3d7219c4a0d84d72563783f0050`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:13:34.198868 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-52cf8095-97c8-4cf9-b570-5463517d9434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:34.273768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1208/2425] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:13:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:13:34.279107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47742c-4706-43c9-8bb5-a1d1c96e0a48 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:34.344189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47742c-4706-43c9-8bb5-a1d1c96e0a48 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:34.348974 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8a0fc-9a76-4e1d-82c6-d0b4a6477270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:34.349640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8a0fc-9a76-4e1d-82c6-d0b4a6477270 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:34.349927 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8a0fc-9a76-4e1d-82c6-d0b4a6477270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:34.350250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8a0fc-9a76-4e1d-82c6-d0b4a6477270 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:34.350943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8a0fc-9a76-4e1d-82c6-d0b4a6477270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:34.352997 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8a0fc-9a76-4e1d-82c6-d0b4a6477270 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:34.382692 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1218/2426] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:13:34 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:13:34.387617 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf8095-97c8-4cf9-b570-5463517d9434 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:34.398850 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf8095-97c8-4cf9-b570-5463517d9434 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:34.424661 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:34.458238 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9bb39-f9d8-43a7-801b-210d880ad48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:34.458901 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9bb39-f9d8-43a7-801b-210d880ad48c admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:34.459187 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9bb39-f9d8-43a7-801b-210d880ad48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:34.459464 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9bb39-f9d8-43a7-801b-210d880ad48c admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:34.460225 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9bb39-f9d8-43a7-801b-210d880ad48c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:34.462123 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9bb39-f9d8-43a7-801b-210d880ad48c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:34.483966 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1209/2427] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:13:34 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:13:34.487962 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8a0fc-9a76-4e1d-82c6-d0b4a6477270 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:34.499267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8a0fc-9a76-4e1d-82c6-d0b4a6477270 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:34.503926 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e8a04-d40f-43ef-a5fa-4f12d9905718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:34.504619 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e8a04-d40f-43ef-a5fa-4f12d9905718 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:34.504906 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e8a04-d40f-43ef-a5fa-4f12d9905718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:34.505186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e8a04-d40f-43ef-a5fa-4f12d9905718 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:34.505910 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e8a04-d40f-43ef-a5fa-4f12d9905718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:34.507656 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e8a04-d40f-43ef-a5fa-4f12d9905718 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:34.519057 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1219/2428] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:13:34.523591 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9bb39-f9d8-43a7-801b-210d880ad48c admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:34.534319 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9bb39-f9d8-43a7-801b-210d880ad48c admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:34.539803 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18cab9a-47e4-4713-847c-66797200213e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:34.540752 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cab9a-47e4-4713-847c-66797200213e admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:34.541161 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cab9a-47e4-4713-847c-66797200213e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:34.541429 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cab9a-47e4-4713-847c-66797200213e admin admin] PATH_INFO: `/v3/projects/4d075baf73754a61ba719000c76d4e47/users/1a07ddb1482943d0a6cc40aac32c8e11/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:34.560324 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18cab9a-47e4-4713-847c-66797200213e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d075baf73754a61ba719000c76d4e47, user_id=1a07ddb1482943d0a6cc40aac32c8e11, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:34.563069 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18cab9a-47e4-4713-847c-66797200213e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:34.578457 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1210/2429] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:13:34 2022] PUT /identity/v3/projects/4d075baf73754a61ba719000c76d4e47/users/1a07ddb1482943d0a6cc40aac32c8e11/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:13:34.582646 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e8a04-d40f-43ef-a5fa-4f12d9905718 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:34.592917 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e8a04-d40f-43ef-a5fa-4f12d9905718 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:34.651364 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff092a-ee32-40f7-b653-f53b4b550b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:34.652255 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff092a-ee32-40f7-b653-f53b4b550b8a admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:34.652733 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff092a-ee32-40f7-b653-f53b4b550b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:34.653022 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff092a-ee32-40f7-b653-f53b4b550b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:34.653761 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff092a-ee32-40f7-b653-f53b4b550b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:34.655381 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff092a-ee32-40f7-b653-f53b4b550b8a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:34.665346 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1220/2430] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:13:34.673836 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18cab9a-47e4-4713-847c-66797200213e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:34.681936 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18cab9a-47e4-4713-847c-66797200213e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:34.687900 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ec3db-2ed5-480f-983f-23f892721c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:34.689029 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ec3db-2ed5-480f-983f-23f892721c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:34.689306 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ec3db-2ed5-480f-983f-23f892721c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:34.689595 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ec3db-2ed5-480f-983f-23f892721c50 admin admin] PATH_INFO: `/v3/projects/4d075baf73754a61ba719000c76d4e47/users/1a07ddb1482943d0a6cc40aac32c8e11/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:34.691813 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ec3db-2ed5-480f-983f-23f892721c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d075baf73754a61ba719000c76d4e47, user_id=1a07ddb1482943d0a6cc40aac32c8e11, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:34.694554 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ec3db-2ed5-480f-983f-23f892721c50 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:34.705647 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1211/2431] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:13:34 2022] PUT /identity/v3/projects/4d075baf73754a61ba719000c76d4e47/users/1a07ddb1482943d0a6cc40aac32c8e11/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:13:34.716378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a20de-9c40-4f6a-9ad8-1e8b4b619e4e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:34.716687 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a20de-9c40-4f6a-9ad8-1e8b4b619e4e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:34.716963 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a20de-9c40-4f6a-9ad8-1e8b4b619e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:34.745576 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-216a20de-9c40-4f6a-9ad8-1e8b4b619e4e None None] MFA Rules not processed for user `1a07ddb1482943d0a6cc40aac32c8e11`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:13:34.746786 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-216a20de-9c40-4f6a-9ad8-1e8b4b619e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:34.780754 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:34.821414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1221/2432] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:13:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:13:34.832576 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ec3db-2ed5-480f-983f-23f892721c50 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:34.835123 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-445ec3db-2ed5-480f-983f-23f892721c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:34.909114 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ec3db-2ed5-480f-983f-23f892721c50 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:34.912826 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c365a-ad68-4b7e-9ad2-50e7226636e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:34.913485 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c365a-ad68-4b7e-9ad2-50e7226636e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:34.913772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c365a-ad68-4b7e-9ad2-50e7226636e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:34.914052 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c365a-ad68-4b7e-9ad2-50e7226636e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:34.974297 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c365a-ad68-4b7e-9ad2-50e7226636e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:34.975750 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c365a-ad68-4b7e-9ad2-50e7226636e1 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:34.985473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1212/2433] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:13:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:13:40.106765 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a20de-9c40-4f6a-9ad8-1e8b4b619e4e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:40.108699 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-216a20de-9c40-4f6a-9ad8-1e8b4b619e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:40.205075 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a20de-9c40-4f6a-9ad8-1e8b4b619e4e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:40.211533 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb6cd1-a986-404d-8eb9-0d144806a26d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:40.212218 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb6cd1-a986-404d-8eb9-0d144806a26d service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:40.212544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb6cd1-a986-404d-8eb9-0d144806a26d service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:40.212831 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb6cd1-a986-404d-8eb9-0d144806a26d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:40.215813 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-bfeb6cd1-a986-404d-8eb9-0d144806a26d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:40.291754 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c365a-ad68-4b7e-9ad2-50e7226636e1 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:40.305285 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c365a-ad68-4b7e-9ad2-50e7226636e1 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:40.310137 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305ae14-b538-45d4-9271-fd8f5ebe70f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:40.312022 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305ae14-b538-45d4-9271-fd8f5ebe70f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:40.312878 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305ae14-b538-45d4-9271-fd8f5ebe70f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:40.313364 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305ae14-b538-45d4-9271-fd8f5ebe70f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:40.313794 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb6cd1-a986-404d-8eb9-0d144806a26d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:40.318914 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb6cd1-a986-404d-8eb9-0d144806a26d service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:40.326384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305ae14-b538-45d4-9271-fd8f5ebe70f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:40.328191 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305ae14-b538-45d4-9271-fd8f5ebe70f4 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:40.329612 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1222/2434] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:13:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:13:40.347744 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1213/2435] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:13:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:13:40.950624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e8188-b0e6-4f69-b7bd-ab7ad482b133 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:40.950916 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e8188-b0e6-4f69-b7bd-ab7ad482b133 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:40.951252 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e8188-b0e6-4f69-b7bd-ab7ad482b133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:40.969018 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-2c1e8188-b0e6-4f69-b7bd-ab7ad482b133 None None] MFA Rules not processed for user `6d4c4b75552b4c739079f328a6efba40`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:13:40.970221 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2c1e8188-b0e6-4f69-b7bd-ab7ad482b133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:41.030262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1223/2436] 10.222.0.35 () {58 vars in 1009 bytes} [Thu May 19 22:13:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:13:41.078819 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305ae14-b538-45d4-9271-fd8f5ebe70f4 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:41.080252 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7305ae14-b538-45d4-9271-fd8f5ebe70f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:41.106528 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:41.158019 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305ae14-b538-45d4-9271-fd8f5ebe70f4 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:41.163036 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83382a-4d46-449d-8374-95452b511afc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a4208619f84f16b735871ee114e660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:41.163685 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83382a-4d46-449d-8374-95452b511afc service swift] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:41.163971 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83382a-4d46-449d-8374-95452b511afc service swift] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:41.164251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83382a-4d46-449d-8374-95452b511afc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:41.172735 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83382a-4d46-449d-8374-95452b511afc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:41.174339 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83382a-4d46-449d-8374-95452b511afc service swift] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:41.182507 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1214/2437] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 22:13:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 22:13:45.543139 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e8188-b0e6-4f69-b7bd-ab7ad482b133 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:45.559303 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:45.627765 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e8188-b0e6-4f69-b7bd-ab7ad482b133 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:45.632286 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4a351-a61c-425b-b37a-243e08671281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:45.633190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4a351-a61c-425b-b37a-243e08671281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:45.633472 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4a351-a61c-425b-b37a-243e08671281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:45.633754 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4a351-a61c-425b-b37a-243e08671281 admin admin] PATH_INFO: `/v3/users/4bb0f3d7219c4a0d84d72563783f0050` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:45.635050 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4a351-a61c-425b-b37a-243e08671281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bb0f3d7219c4a0d84d72563783f0050)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:45.637276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4a351-a61c-425b-b37a-243e08671281 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:45.705027 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-dfc4a351-a61c-425b-b37a-243e08671281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bb0f3d7219c4a0d84d72563783f0050'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:45.713482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-dfc4a351-a61c-425b-b37a-243e08671281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bb0f3d7219c4a0d84d72563783f0050'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:45.714276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-dfc4a351-a61c-425b-b37a-243e08671281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bb0f3d7219c4a0d84d72563783f0050'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:45.735082 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-dfc4a351-a61c-425b-b37a-243e08671281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bb0f3d7219c4a0d84d72563783f0050'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:45.756125 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-dfc4a351-a61c-425b-b37a-243e08671281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bb0f3d7219c4a0d84d72563783f0050'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:45.764140 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1224/2438] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:13:45 2022] DELETE /identity/v3/users/4bb0f3d7219c4a0d84d72563783f0050 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:13:45.768713 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26e946-8361-4e46-877b-a10a871eeebb None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:45.769300 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26e946-8361-4e46-877b-a10a871eeebb None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:45.769513 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26e946-8361-4e46-877b-a10a871eeebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:45.791726 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-df26e946-8361-4e46-877b-a10a871eeebb None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:13:45.793170 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-df26e946-8361-4e46-877b-a10a871eeebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:45.870751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1215/2439] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:13:45.881328 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4a351-a61c-425b-b37a-243e08671281 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:45.883028 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-dfc4a351-a61c-425b-b37a-243e08671281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:45.970164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4a351-a61c-425b-b37a-243e08671281 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:45.973956 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394356a-4b30-42d2-9dfc-ace643c2e226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:45.974683 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394356a-4b30-42d2-9dfc-ace643c2e226 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:45.975535 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394356a-4b30-42d2-9dfc-ace643c2e226 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:45.975535 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394356a-4b30-42d2-9dfc-ace643c2e226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:45.987315 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394356a-4b30-42d2-9dfc-ace643c2e226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:45.988932 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394356a-4b30-42d2-9dfc-ace643c2e226 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:46.001636 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1225/2440] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:13:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:13:46.431391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26e946-8361-4e46-877b-a10a871eeebb None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:46.433009 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-df26e946-8361-4e46-877b-a10a871eeebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:46.462857 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26e946-8361-4e46-877b-a10a871eeebb None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:46.468120 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a1941-99c2-4e4a-b63a-d899fe460ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:46.469531 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a1941-99c2-4e4a-b63a-d899fe460ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:46.470069 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a1941-99c2-4e4a-b63a-d899fe460ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:46.470376 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a1941-99c2-4e4a-b63a-d899fe460ebc admin admin] PATH_INFO: `/v3/projects/551768e0f68742049e7f8e05eed25c0e` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:46.472590 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a1941-99c2-4e4a-b63a-d899fe460ebc admin admin] RBAC: Authorizing `identity:delete_project(project_id=551768e0f68742049e7f8e05eed25c0e)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:46.476166 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a1941-99c2-4e4a-b63a-d899fe460ebc admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:46.539848 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4f2a1941-99c2-4e4a-b63a-d899fe460ebc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '551768e0f68742049e7f8e05eed25c0e', 'request_id': 'req-4f2a1941-99c2-4e4a-b63a-d899fe460ebc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:46.547965 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4f2a1941-99c2-4e4a-b63a-d899fe460ebc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '551768e0f68742049e7f8e05eed25c0e', 'request_id': 'req-4f2a1941-99c2-4e4a-b63a-d899fe460ebc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:46.557745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4f2a1941-99c2-4e4a-b63a-d899fe460ebc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '551768e0f68742049e7f8e05eed25c0e', 'request_id': 'req-4f2a1941-99c2-4e4a-b63a-d899fe460ebc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:46.570467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4f2a1941-99c2-4e4a-b63a-d899fe460ebc admin admin] The token cache is being invalidate because project 551768e0f68742049e7f8e05eed25c0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:13:46.570760 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4f2a1941-99c2-4e4a-b63a-d899fe460ebc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:46.571431 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4f2a1941-99c2-4e4a-b63a-d899fe460ebc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:46.573090 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1216/2441] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:13:46 2022] DELETE /identity/v3/projects/551768e0f68742049e7f8e05eed25c0e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:13:46.578461 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394356a-4b30-42d2-9dfc-ace643c2e226 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:46.590515 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394356a-4b30-42d2-9dfc-ace643c2e226 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:46.626892 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:46.660996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f23570-e00c-45dc-b879-2b561cb23af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:46.661802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f23570-e00c-45dc-b879-2b561cb23af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:46.662084 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f23570-e00c-45dc-b879-2b561cb23af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:46.662363 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f23570-e00c-45dc-b879-2b561cb23af8 admin admin] PATH_INFO: `/v3/users/1a07ddb1482943d0a6cc40aac32c8e11` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:46.663603 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f23570-e00c-45dc-b879-2b561cb23af8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a07ddb1482943d0a6cc40aac32c8e11)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:46.665614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f23570-e00c-45dc-b879-2b561cb23af8 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:46.723162 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-15f23570-e00c-45dc-b879-2b561cb23af8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a07ddb1482943d0a6cc40aac32c8e11'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:46.732757 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-15f23570-e00c-45dc-b879-2b561cb23af8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a07ddb1482943d0a6cc40aac32c8e11'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:46.733684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-15f23570-e00c-45dc-b879-2b561cb23af8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a07ddb1482943d0a6cc40aac32c8e11'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:46.752348 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-15f23570-e00c-45dc-b879-2b561cb23af8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a07ddb1482943d0a6cc40aac32c8e11'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:46.761391 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-15f23570-e00c-45dc-b879-2b561cb23af8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a07ddb1482943d0a6cc40aac32c8e11'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:46.771700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1226/2442] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:13:46 2022] DELETE /identity/v3/users/1a07ddb1482943d0a6cc40aac32c8e11 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:13:47.109994 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a1941-99c2-4e4a-b63a-d899fe460ebc admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:47.111618 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4f2a1941-99c2-4e4a-b63a-d899fe460ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:47.133748 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a1941-99c2-4e4a-b63a-d899fe460ebc admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:47.228213 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:47.276284 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacb219-c3bd-49f0-9abd-279211dd186f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:47.277757 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacb219-c3bd-49f0-9abd-279211dd186f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:47.278227 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacb219-c3bd-49f0-9abd-279211dd186f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:47.278722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacb219-c3bd-49f0-9abd-279211dd186f admin admin] PATH_INFO: `/v3/projects/4d075baf73754a61ba719000c76d4e47` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:47.280885 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aacb219-c3bd-49f0-9abd-279211dd186f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d075baf73754a61ba719000c76d4e47)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:47.294717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aacb219-c3bd-49f0-9abd-279211dd186f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:47.444734 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1aacb219-c3bd-49f0-9abd-279211dd186f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d075baf73754a61ba719000c76d4e47', 'request_id': 'req-1aacb219-c3bd-49f0-9abd-279211dd186f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:47.455878 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1aacb219-c3bd-49f0-9abd-279211dd186f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d075baf73754a61ba719000c76d4e47', 'request_id': 'req-1aacb219-c3bd-49f0-9abd-279211dd186f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:47.476023 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1aacb219-c3bd-49f0-9abd-279211dd186f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d075baf73754a61ba719000c76d4e47', 'request_id': 'req-1aacb219-c3bd-49f0-9abd-279211dd186f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:47.494225 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1aacb219-c3bd-49f0-9abd-279211dd186f admin admin] The token cache is being invalidate because project 4d075baf73754a61ba719000c76d4e47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:13:47.494521 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1aacb219-c3bd-49f0-9abd-279211dd186f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:47.495623 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1aacb219-c3bd-49f0-9abd-279211dd186f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:47.500456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1217/2443] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:13:47 2022] DELETE /identity/v3/projects/4d075baf73754a61ba719000c76d4e47 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:13:47.503014 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1114e-362d-4722-a1dd-e41a602d4bcc None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:47.503309 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1114e-362d-4722-a1dd-e41a602d4bcc None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:47.503587 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1114e-362d-4722-a1dd-e41a602d4bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:47.557624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-3fa1114e-362d-4722-a1dd-e41a602d4bcc None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:13:47.558940 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3fa1114e-362d-4722-a1dd-e41a602d4bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:47.671263 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1227/2444] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:13:47.676679 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e76d8-26c5-4485-8394-c3196442ecc8 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:47.677164 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e76d8-26c5-4485-8394-c3196442ecc8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:47.677411 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e76d8-26c5-4485-8394-c3196442ecc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:47.704594 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-940e76d8-26c5-4485-8394-c3196442ecc8 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:13:47.705962 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-940e76d8-26c5-4485-8394-c3196442ecc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:47.720462 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1218/2445] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:13:47.723596 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1114e-362d-4722-a1dd-e41a602d4bcc None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:47.736437 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1114e-362d-4722-a1dd-e41a602d4bcc None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:47.742666 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61138ba1-3993-4f7e-a878-7825ed4c5a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:47.743674 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61138ba1-3993-4f7e-a878-7825ed4c5a9b admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:47.743963 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61138ba1-3993-4f7e-a878-7825ed4c5a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:47.744238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61138ba1-3993-4f7e-a878-7825ed4c5a9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:47.745439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61138ba1-3993-4f7e-a878-7825ed4c5a9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:13:47.745728 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61138ba1-3993-4f7e-a878-7825ed4c5a9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:47.747722 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61138ba1-3993-4f7e-a878-7825ed4c5a9b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:47.765760 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1228/2446] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 22:13:47.770369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e76d8-26c5-4485-8394-c3196442ecc8 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:47.781928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e76d8-26c5-4485-8394-c3196442ecc8 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:47.788103 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fdf65-8de3-40fc-93eb-3b7ebf7e465c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:47.789522 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fdf65-8de3-40fc-93eb-3b7ebf7e465c admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:47.790106 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fdf65-8de3-40fc-93eb-3b7ebf7e465c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:47.790687 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fdf65-8de3-40fc-93eb-3b7ebf7e465c admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:47.792061 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8fdf65-8de3-40fc-93eb-3b7ebf7e465c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:47.796482 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8fdf65-8de3-40fc-93eb-3b7ebf7e465c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:47.848514 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1219/2447] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:13:47 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:13:47.851678 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61138ba1-3993-4f7e-a878-7825ed4c5a9b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:47.872126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61138ba1-3993-4f7e-a878-7825ed4c5a9b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:47.956248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:47.982913 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ef3cb-1a3e-409b-8234-1a84e17dd7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:47.984013 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ef3cb-1a3e-409b-8234-1a84e17dd7a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:47.984133 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ef3cb-1a3e-409b-8234-1a84e17dd7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:47.984536 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ef3cb-1a3e-409b-8234-1a84e17dd7a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:47.985356 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ef3cb-1a3e-409b-8234-1a84e17dd7a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:47.987529 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ef3cb-1a3e-409b-8234-1a84e17dd7a8 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:48.013628 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1229/2448] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:13:47 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:13:48.015822 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fdf65-8de3-40fc-93eb-3b7ebf7e465c admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:48.028875 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fdf65-8de3-40fc-93eb-3b7ebf7e465c admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:48.033498 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3a21b-4e9f-4dd5-bc26-97f45ee4c9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:48.035801 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3a21b-4e9f-4dd5-bc26-97f45ee4c9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:48.035801 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3a21b-4e9f-4dd5-bc26-97f45ee4c9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:48.035801 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3a21b-4e9f-4dd5-bc26-97f45ee4c9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:48.036633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3a21b-4e9f-4dd5-bc26-97f45ee4c9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:48.038697 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3a21b-4e9f-4dd5-bc26-97f45ee4c9f0 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:48.052682 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1220/2449] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:13:48.072061 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ef3cb-1a3e-409b-8234-1a84e17dd7a8 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:48.084876 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ef3cb-1a3e-409b-8234-1a84e17dd7a8 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:48.090109 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e63b98-f1ac-4135-9c5e-05dcfcf7a7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:48.090815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e63b98-f1ac-4135-9c5e-05dcfcf7a7f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:48.091103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e63b98-f1ac-4135-9c5e-05dcfcf7a7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:48.091388 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e63b98-f1ac-4135-9c5e-05dcfcf7a7f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:48.092143 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e63b98-f1ac-4135-9c5e-05dcfcf7a7f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:48.094133 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e63b98-f1ac-4135-9c5e-05dcfcf7a7f6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:48.111119 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1230/2450] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:13:48.115297 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3a21b-4e9f-4dd5-bc26-97f45ee4c9f0 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:48.126415 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3a21b-4e9f-4dd5-bc26-97f45ee4c9f0 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:48.131214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cd903-be4a-429e-96d1-1a8cc354b8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:48.132106 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cd903-be4a-429e-96d1-1a8cc354b8d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:48.132390 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cd903-be4a-429e-96d1-1a8cc354b8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:48.132700 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cd903-be4a-429e-96d1-1a8cc354b8d9 admin admin] PATH_INFO: `/v3/projects/0f482456faa34f7ca44745fa78c552e3/users/e4aba041aabe48219954156b2e480467/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:48.151631 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731cd903-be4a-429e-96d1-1a8cc354b8d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f482456faa34f7ca44745fa78c552e3, user_id=e4aba041aabe48219954156b2e480467, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:48.154338 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731cd903-be4a-429e-96d1-1a8cc354b8d9 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:48.170274 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1221/2451] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:13:48 2022] PUT /identity/v3/projects/0f482456faa34f7ca44745fa78c552e3/users/e4aba041aabe48219954156b2e480467/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:13:48.187636 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51856d-95c4-40cd-b4b6-525a47dbb077 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:48.187941 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51856d-95c4-40cd-b4b6-525a47dbb077 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:48.188266 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51856d-95c4-40cd-b4b6-525a47dbb077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:48.224794 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-af51856d-95c4-40cd-b4b6-525a47dbb077 None None] MFA Rules not processed for user `e4aba041aabe48219954156b2e480467`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:13:48.226066 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-af51856d-95c4-40cd-b4b6-525a47dbb077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:48.338857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1231/2452] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:13:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:13:48.343316 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cd903-be4a-429e-96d1-1a8cc354b8d9 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:48.438149 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cd903-be4a-429e-96d1-1a8cc354b8d9 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:48.443233 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ff45b-fb6c-48ec-aebd-b8e3c0ee38e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:48.443900 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ff45b-fb6c-48ec-aebd-b8e3c0ee38e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:48.444191 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ff45b-fb6c-48ec-aebd-b8e3c0ee38e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:48.444501 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ff45b-fb6c-48ec-aebd-b8e3c0ee38e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:48.445732 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ff45b-fb6c-48ec-aebd-b8e3c0ee38e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:48.448042 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ff45b-fb6c-48ec-aebd-b8e3c0ee38e5 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:48.452305 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:48.485848 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1222/2453] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:13:48 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:13:48.487194 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51856d-95c4-40cd-b4b6-525a47dbb077 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:48.499835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51856d-95c4-40cd-b4b6-525a47dbb077 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:48.609672 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e00015-230b-43ca-9626-dc6c44afd4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:48.610915 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e00015-230b-43ca-9626-dc6c44afd4f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:48.611530 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e00015-230b-43ca-9626-dc6c44afd4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:48.613263 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e00015-230b-43ca-9626-dc6c44afd4f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:48.614323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e00015-230b-43ca-9626-dc6c44afd4f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:48.617090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e00015-230b-43ca-9626-dc6c44afd4f0 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:48.658367 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ff45b-fb6c-48ec-aebd-b8e3c0ee38e5 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:48.659943 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1232/2454] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:13:48 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:13:48.681905 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ff45b-fb6c-48ec-aebd-b8e3c0ee38e5 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:48.696219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34a388-2448-47ca-8e86-e85a3530235b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:48.697644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34a388-2448-47ca-8e86-e85a3530235b admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:48.698310 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34a388-2448-47ca-8e86-e85a3530235b admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:48.698945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34a388-2448-47ca-8e86-e85a3530235b admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:48.700544 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34a388-2448-47ca-8e86-e85a3530235b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:48.704378 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34a388-2448-47ca-8e86-e85a3530235b admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:48.727528 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1223/2455] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:13:48.731296 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e00015-230b-43ca-9626-dc6c44afd4f0 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:48.742334 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e00015-230b-43ca-9626-dc6c44afd4f0 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:48.747137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475c764-9511-4bae-9e7f-bba46efbf542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:48.747813 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475c764-9511-4bae-9e7f-bba46efbf542 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:48.748101 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475c764-9511-4bae-9e7f-bba46efbf542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:48.748382 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475c764-9511-4bae-9e7f-bba46efbf542 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:48.749257 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475c764-9511-4bae-9e7f-bba46efbf542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:48.751025 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475c764-9511-4bae-9e7f-bba46efbf542 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:48.765418 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1233/2456] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:13:48.772699 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34a388-2448-47ca-8e86-e85a3530235b admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:48.784603 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34a388-2448-47ca-8e86-e85a3530235b admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:48.789412 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039b994-6824-4f0d-b3bd-4431321b7ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:48.790301 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039b994-6824-4f0d-b3bd-4431321b7ec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:48.790587 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039b994-6824-4f0d-b3bd-4431321b7ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:48.790860 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039b994-6824-4f0d-b3bd-4431321b7ec3 admin admin] PATH_INFO: `/v3/projects/c230b153a5894b868cccf57cab694b20/users/8b46db694ce3444a9c3bfb370b625dd8/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:48.807886 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039b994-6824-4f0d-b3bd-4431321b7ec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c230b153a5894b868cccf57cab694b20, user_id=8b46db694ce3444a9c3bfb370b625dd8, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:48.810845 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039b994-6824-4f0d-b3bd-4431321b7ec3 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:48.831070 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1224/2457] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:13:48 2022] PUT /identity/v3/projects/c230b153a5894b868cccf57cab694b20/users/8b46db694ce3444a9c3bfb370b625dd8/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:13:48.841310 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b6170-591c-45ab-8b54-ec0643457f12 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:48.841647 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b6170-591c-45ab-8b54-ec0643457f12 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:48.841996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b6170-591c-45ab-8b54-ec0643457f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:48.890963 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-1f6b6170-591c-45ab-8b54-ec0643457f12 None None] MFA Rules not processed for user `8b46db694ce3444a9c3bfb370b625dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:13:48.892299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1f6b6170-591c-45ab-8b54-ec0643457f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:48.919854 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:48.999385 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1234/2458] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:13:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:13:49.005169 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039b994-6824-4f0d-b3bd-4431321b7ec3 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:49.114041 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039b994-6824-4f0d-b3bd-4431321b7ec3 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:49.120042 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20247837-a120-4c18-bacf-f848a32030e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:49.120912 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20247837-a120-4c18-bacf-f848a32030e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:49.121322 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20247837-a120-4c18-bacf-f848a32030e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:49.121707 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20247837-a120-4c18-bacf-f848a32030e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:49.122512 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20247837-a120-4c18-bacf-f848a32030e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:49.125756 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20247837-a120-4c18-bacf-f848a32030e6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:49.168448 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1225/2459] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:13:49 2022] POST /identity/v3/projects => generated 383 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:13:49.173864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b6170-591c-45ab-8b54-ec0643457f12 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:49.188179 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b6170-591c-45ab-8b54-ec0643457f12 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:49.259984 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e621f73-db12-4188-956a-958f574bd250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:49.260841 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e621f73-db12-4188-956a-958f574bd250 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:49.261134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e621f73-db12-4188-956a-958f574bd250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:49.261415 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e621f73-db12-4188-956a-958f574bd250 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:49.262129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e621f73-db12-4188-956a-958f574bd250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:49.264075 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e621f73-db12-4188-956a-958f574bd250 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:49.290375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1235/2460] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:13:49 2022] POST /identity/v3/users => generated 298 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:13:49.298851 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20247837-a120-4c18-bacf-f848a32030e6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:49.311955 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20247837-a120-4c18-bacf-f848a32030e6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:49.326817 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19e20a-b193-4583-b265-1a284bb96b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:49.327519 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19e20a-b193-4583-b265-1a284bb96b58 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:49.327809 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19e20a-b193-4583-b265-1a284bb96b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:49.328072 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19e20a-b193-4583-b265-1a284bb96b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:49.328893 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19e20a-b193-4583-b265-1a284bb96b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:49.330672 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19e20a-b193-4583-b265-1a284bb96b58 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:49.348447 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1226/2461] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:13:49.352054 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e621f73-db12-4188-956a-958f574bd250 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:49.370020 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e621f73-db12-4188-956a-958f574bd250 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:49.376937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf253b-c031-4b07-9a6a-0436828282b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:49.378495 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf253b-c031-4b07-9a6a-0436828282b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:49.378996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf253b-c031-4b07-9a6a-0436828282b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:49.379499 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf253b-c031-4b07-9a6a-0436828282b2 admin admin] PATH_INFO: `/v3/projects/24ac87278f764f72b9058025a3e46567/users/58169331c4294b2b82339ef3da09d106/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:49.399287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf253b-c031-4b07-9a6a-0436828282b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24ac87278f764f72b9058025a3e46567, user_id=58169331c4294b2b82339ef3da09d106, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:49.402047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf253b-c031-4b07-9a6a-0436828282b2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:49.431374 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1236/2462] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:13:49 2022] PUT /identity/v3/projects/24ac87278f764f72b9058025a3e46567/users/58169331c4294b2b82339ef3da09d106/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:13:49.438069 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19e20a-b193-4583-b265-1a284bb96b58 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:49.449572 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19e20a-b193-4583-b265-1a284bb96b58 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:49.535375 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88e20f-1726-4f4a-b3fe-b96c8bd9cfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:49.535974 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88e20f-1726-4f4a-b3fe-b96c8bd9cfd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:49.536260 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88e20f-1726-4f4a-b3fe-b96c8bd9cfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:49.536578 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88e20f-1726-4f4a-b3fe-b96c8bd9cfd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:49.537326 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88e20f-1726-4f4a-b3fe-b96c8bd9cfd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:49.539054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88e20f-1726-4f4a-b3fe-b96c8bd9cfd6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:49.557065 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1227/2463] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:13:49.558650 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf253b-c031-4b07-9a6a-0436828282b2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:49.570498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf253b-c031-4b07-9a6a-0436828282b2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:49.579690 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb163d-ac59-47c9-9f54-56322488ed99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:49.580730 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb163d-ac59-47c9-9f54-56322488ed99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:49.581008 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb163d-ac59-47c9-9f54-56322488ed99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:49.581274 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb163d-ac59-47c9-9f54-56322488ed99 admin admin] PATH_INFO: `/v3/projects/24ac87278f764f72b9058025a3e46567/users/58169331c4294b2b82339ef3da09d106/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:49.583332 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb163d-ac59-47c9-9f54-56322488ed99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24ac87278f764f72b9058025a3e46567, user_id=58169331c4294b2b82339ef3da09d106, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:49.586577 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb163d-ac59-47c9-9f54-56322488ed99 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:49.601902 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1237/2464] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:13:49 2022] PUT /identity/v3/projects/24ac87278f764f72b9058025a3e46567/users/58169331c4294b2b82339ef3da09d106/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:13:49.615267 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cc721-ec2a-4ed3-8ef5-ae7018b06911 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:49.615900 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cc721-ec2a-4ed3-8ef5-ae7018b06911 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:49.616181 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cc721-ec2a-4ed3-8ef5-ae7018b06911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:49.649752 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8a6cc721-ec2a-4ed3-8ef5-ae7018b06911 None None] MFA Rules not processed for user `58169331c4294b2b82339ef3da09d106`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:13:49.651086 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8a6cc721-ec2a-4ed3-8ef5-ae7018b06911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:49.663304 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:49.763050 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1228/2465] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:13:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:13:49.777632 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb163d-ac59-47c9-9f54-56322488ed99 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:49.780113 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7deb163d-ac59-47c9-9f54-56322488ed99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:49.896057 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb163d-ac59-47c9-9f54-56322488ed99 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:49.906899 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29856aa8-293a-4c5b-8724-d7929174f47c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:49.907578 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29856aa8-293a-4c5b-8724-d7929174f47c service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:49.907863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29856aa8-293a-4c5b-8724-d7929174f47c service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:49.908142 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29856aa8-293a-4c5b-8724-d7929174f47c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:49.951273 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:50.009672 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29856aa8-293a-4c5b-8724-d7929174f47c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:50.013650 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29856aa8-293a-4c5b-8724-d7929174f47c service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:50.041035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1238/2466] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:13:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:13:51.793865 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cc721-ec2a-4ed3-8ef5-ae7018b06911 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:51.796131 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8a6cc721-ec2a-4ed3-8ef5-ae7018b06911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:51.814154 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cc721-ec2a-4ed3-8ef5-ae7018b06911 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:51.817947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550bcc09-17c8-4b4b-b167-3efe9c3a061d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:51.818620 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bcc09-17c8-4b4b-b167-3efe9c3a061d service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:51.818904 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bcc09-17c8-4b4b-b167-3efe9c3a061d service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:51.819185 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bcc09-17c8-4b4b-b167-3efe9c3a061d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:51.918252 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550bcc09-17c8-4b4b-b167-3efe9c3a061d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:51.919988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550bcc09-17c8-4b4b-b167-3efe9c3a061d service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:51.940452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1229/2467] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:13:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:13:52.694627 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29856aa8-293a-4c5b-8724-d7929174f47c service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:52.703953 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29856aa8-293a-4c5b-8724-d7929174f47c service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:52.707928 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f3a2d-5635-4ec4-9f0e-9b2ce0952abc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:52.708742 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f3a2d-5635-4ec4-9f0e-9b2ce0952abc service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:52.709098 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f3a2d-5635-4ec4-9f0e-9b2ce0952abc service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:52.709440 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f3a2d-5635-4ec4-9f0e-9b2ce0952abc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:52.723028 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f3a2d-5635-4ec4-9f0e-9b2ce0952abc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:52.724543 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f3a2d-5635-4ec4-9f0e-9b2ce0952abc service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:52.737059 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1239/2468] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:13:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:13:55.176122 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffcc28-8577-4acc-a859-c7ca8d5e6fa3 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:55.176541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffcc28-8577-4acc-a859-c7ca8d5e6fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:55.176711 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffcc28-8577-4acc-a859-c7ca8d5e6fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:55.194070 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-9bffcc28-8577-4acc-a859-c7ca8d5e6fa3 None None] MFA Rules not processed for user `5fc2803fed254f3b8a280df51891ec0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:13:55.195299 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9bffcc28-8577-4acc-a859-c7ca8d5e6fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:55.263949 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1230/2469] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:13:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:13:56.701970 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f3a2d-5635-4ec4-9f0e-9b2ce0952abc service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:56.772716 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f3a2d-5635-4ec4-9f0e-9b2ce0952abc service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:56.781155 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afbf2a9-84b1-4303-9223-34ba0e90a823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:56.782227 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afbf2a9-84b1-4303-9223-34ba0e90a823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:56.782545 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afbf2a9-84b1-4303-9223-34ba0e90a823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:56.782789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afbf2a9-84b1-4303-9223-34ba0e90a823 admin admin] PATH_INFO: `/v3/users/e4aba041aabe48219954156b2e480467` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:56.784230 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afbf2a9-84b1-4303-9223-34ba0e90a823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4aba041aabe48219954156b2e480467)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:56.786264 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afbf2a9-84b1-4303-9223-34ba0e90a823 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:56.840816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6afbf2a9-84b1-4303-9223-34ba0e90a823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4aba041aabe48219954156b2e480467'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:56.850109 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6afbf2a9-84b1-4303-9223-34ba0e90a823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4aba041aabe48219954156b2e480467'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:56.850930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6afbf2a9-84b1-4303-9223-34ba0e90a823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4aba041aabe48219954156b2e480467'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:56.863867 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6afbf2a9-84b1-4303-9223-34ba0e90a823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4aba041aabe48219954156b2e480467'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:56.872687 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6afbf2a9-84b1-4303-9223-34ba0e90a823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4aba041aabe48219954156b2e480467'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:56.879149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1240/2470] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:13:56 2022] DELETE /identity/v3/users/e4aba041aabe48219954156b2e480467 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:13:56.883979 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452f4be-5bdb-4a93-8da3-cd7e04a8aff9 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:56.884940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452f4be-5bdb-4a93-8da3-cd7e04a8aff9 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:56.885723 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452f4be-5bdb-4a93-8da3-cd7e04a8aff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:56.913542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a452f4be-5bdb-4a93-8da3-cd7e04a8aff9 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:13:56.914951 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a452f4be-5bdb-4a93-8da3-cd7e04a8aff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:56.972289 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:57.013113 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1231/2471] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:13:57.067506 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afbf2a9-84b1-4303-9223-34ba0e90a823 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:57.069963 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6afbf2a9-84b1-4303-9223-34ba0e90a823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:57.122110 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:57.174390 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afbf2a9-84b1-4303-9223-34ba0e90a823 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:57.181367 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeea2a7-42a6-42f9-86dc-73ac85f16f84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:57.182139 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeea2a7-42a6-42f9-86dc-73ac85f16f84 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:57.182500 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeea2a7-42a6-42f9-86dc-73ac85f16f84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:57.182865 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeea2a7-42a6-42f9-86dc-73ac85f16f84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:57.200439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92420b-6076-4d12-aff5-d8f89161c5f2 None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:57.200789 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92420b-6076-4d12-aff5-d8f89161c5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:57.201069 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92420b-6076-4d12-aff5-d8f89161c5f2 None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:57.202659 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1232/2472] 10.222.0.35 () {54 vars in 921 bytes} [Thu May 19 22:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 22:13:57.209654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e89c7a-9d82-48b7-9ab1-f0119de83a40 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:57.209941 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e89c7a-9d82-48b7-9ab1-f0119de83a40 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:57.210220 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e89c7a-9d82-48b7-9ab1-f0119de83a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:57.218284 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeea2a7-42a6-42f9-86dc-73ac85f16f84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:57.220134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeea2a7-42a6-42f9-86dc-73ac85f16f84 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:57.232303 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1241/2473] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:13:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:13:57.240719 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a1e89c7a-9d82-48b7-9ab1-f0119de83a40 None None] MFA Rules not processed for user `902ca8f1d59547a0ab187b4748311f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:13:57.241831 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a1e89c7a-9d82-48b7-9ab1-f0119de83a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:57.321603 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1233/2474] 10.222.0.35 () {58 vars in 1018 bytes} [Thu May 19 22:13:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:13:57.335132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeea2a7-42a6-42f9-86dc-73ac85f16f84 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:57.337188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-faeea2a7-42a6-42f9-86dc-73ac85f16f84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:57.413584 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeea2a7-42a6-42f9-86dc-73ac85f16f84 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:57.418626 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c148d73-f352-440d-9e89-7efe650afe5b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf64f4ec145742d78eee6c4a447515dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:57.419511 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c148d73-f352-440d-9e89-7efe650afe5b service glance] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:57.419811 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c148d73-f352-440d-9e89-7efe650afe5b service glance] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:57.420092 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c148d73-f352-440d-9e89-7efe650afe5b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:57.432902 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c148d73-f352-440d-9e89-7efe650afe5b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:57.434660 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c148d73-f352-440d-9e89-7efe650afe5b service glance] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:57.447513 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1242/2475] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:13:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:13:57.526466 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bf66d-b984-4e51-980c-c72095cb761d None None] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:57.526750 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bf66d-b984-4e51-980c-c72095cb761d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:57.527062 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bf66d-b984-4e51-980c-c72095cb761d None None] PATH_INFO: `/` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:57.528530 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1234/2476] 10.222.0.35 () {54 vars in 921 bytes} [Thu May 19 22:13:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:13:57.534635 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb3a0a-a115-4527-82e4-ce5bc24b3a10 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:57.535227 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb3a0a-a115-4527-82e4-ce5bc24b3a10 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:57.535227 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb3a0a-a115-4527-82e4-ce5bc24b3a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:57.560186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-2eeb3a0a-a115-4527-82e4-ce5bc24b3a10 None None] MFA Rules not processed for user `a571d6fe63334552b532aae15299ef9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:13:57.562801 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2eeb3a0a-a115-4527-82e4-ce5bc24b3a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:57.571745 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1243/2477] 10.222.0.35 () {58 vars in 1018 bytes} [Thu May 19 22:13:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:13:57.583985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579bf66d-b984-4e51-980c-c72095cb761d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:57.586218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-579bf66d-b984-4e51-980c-c72095cb761d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:57.601603 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579bf66d-b984-4e51-980c-c72095cb761d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:57.605434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725ab36-c66f-46de-8922-916da4548e50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:57.606256 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725ab36-c66f-46de-8922-916da4548e50 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:57.606540 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725ab36-c66f-46de-8922-916da4548e50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:57.606813 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725ab36-c66f-46de-8922-916da4548e50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:57.618930 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725ab36-c66f-46de-8922-916da4548e50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:57.620509 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725ab36-c66f-46de-8922-916da4548e50 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:57.630863 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1235/2478] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:13:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:13:57.729492 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbd5c5-4cf8-467a-a6ba-0dae2f4b34c0 None None] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:57.730059 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbd5c5-4cf8-467a-a6ba-0dae2f4b34c0 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:57.730059 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbd5c5-4cf8-467a-a6ba-0dae2f4b34c0 None None] PATH_INFO: `/` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:57.731849 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1244/2479] 10.222.0.35 () {54 vars in 921 bytes} [Thu May 19 22:13:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 22:13:57.738463 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07467bfe-a9d0-4583-9205-ccb267200f42 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:57.738830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07467bfe-a9d0-4583-9205-ccb267200f42 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:57.739293 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07467bfe-a9d0-4583-9205-ccb267200f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:57.759320 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-07467bfe-a9d0-4583-9205-ccb267200f42 None None] MFA Rules not processed for user `902ca8f1d59547a0ab187b4748311f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:13:57.760821 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-07467bfe-a9d0-4583-9205-ccb267200f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:57.779180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1236/2480] 10.222.0.35 () {58 vars in 1018 bytes} [Thu May 19 22:13:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:13:57.789219 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbd5c5-4cf8-467a-a6ba-0dae2f4b34c0 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:57.801886 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbd5c5-4cf8-467a-a6ba-0dae2f4b34c0 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:57.806124 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160b836-2747-47df-9fa4-0c08b2634fca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:57.807346 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160b836-2747-47df-9fa4-0c08b2634fca service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:57.807346 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160b836-2747-47df-9fa4-0c08b2634fca service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:57.807571 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160b836-2747-47df-9fa4-0c08b2634fca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:57.824671 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160b836-2747-47df-9fa4-0c08b2634fca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:57.831670 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160b836-2747-47df-9fa4-0c08b2634fca service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:57.850684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1245/2481] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:13:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:13:57.852744 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07467bfe-a9d0-4583-9205-ccb267200f42 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:57.865879 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-07467bfe-a9d0-4583-9205-ccb267200f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:57.881610 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07467bfe-a9d0-4583-9205-ccb267200f42 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:57.888301 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211a7d9-0df3-4e4a-8c03-485ec6eb41cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:57.889326 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211a7d9-0df3-4e4a-8c03-485ec6eb41cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:57.890426 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211a7d9-0df3-4e4a-8c03-485ec6eb41cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:57.891172 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211a7d9-0df3-4e4a-8c03-485ec6eb41cc admin admin] PATH_INFO: `/v3/projects/0f482456faa34f7ca44745fa78c552e3` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:57.892771 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211a7d9-0df3-4e4a-8c03-485ec6eb41cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f482456faa34f7ca44745fa78c552e3)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:57.894884 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211a7d9-0df3-4e4a-8c03-485ec6eb41cc admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:57.962673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1211a7d9-0df3-4e4a-8c03-485ec6eb41cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f482456faa34f7ca44745fa78c552e3', 'request_id': 'req-1211a7d9-0df3-4e4a-8c03-485ec6eb41cc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:57.970391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1211a7d9-0df3-4e4a-8c03-485ec6eb41cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f482456faa34f7ca44745fa78c552e3', 'request_id': 'req-1211a7d9-0df3-4e4a-8c03-485ec6eb41cc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:57.981091 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1211a7d9-0df3-4e4a-8c03-485ec6eb41cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f482456faa34f7ca44745fa78c552e3', 'request_id': 'req-1211a7d9-0df3-4e4a-8c03-485ec6eb41cc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:58.002291 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1211a7d9-0df3-4e4a-8c03-485ec6eb41cc admin admin] The token cache is being invalidate because project 0f482456faa34f7ca44745fa78c552e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:13:58.002590 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1211a7d9-0df3-4e4a-8c03-485ec6eb41cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:58.004512 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-1211a7d9-0df3-4e4a-8c03-485ec6eb41cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:58.009701 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1237/2482] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:13:57 2022] DELETE /identity/v3/projects/0f482456faa34f7ca44745fa78c552e3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:13:58.010773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160b836-2747-47df-9fa4-0c08b2634fca service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:58.025319 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160b836-2747-47df-9fa4-0c08b2634fca service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:58.124033 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129a86e-5e0b-4a3e-ab50-b59ba0f839ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:58.125304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129a86e-5e0b-4a3e-ab50-b59ba0f839ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:58.125587 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129a86e-5e0b-4a3e-ab50-b59ba0f839ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:58.125862 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129a86e-5e0b-4a3e-ab50-b59ba0f839ea admin admin] PATH_INFO: `/v3/users/8b46db694ce3444a9c3bfb370b625dd8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:58.127459 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129a86e-5e0b-4a3e-ab50-b59ba0f839ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b46db694ce3444a9c3bfb370b625dd8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:58.129533 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129a86e-5e0b-4a3e-ab50-b59ba0f839ea admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:58.249767 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a129a86e-5e0b-4a3e-ab50-b59ba0f839ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b46db694ce3444a9c3bfb370b625dd8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:58.268374 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a129a86e-5e0b-4a3e-ab50-b59ba0f839ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b46db694ce3444a9c3bfb370b625dd8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:58.269604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a129a86e-5e0b-4a3e-ab50-b59ba0f839ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b46db694ce3444a9c3bfb370b625dd8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:58.271805 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:58.291430 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a129a86e-5e0b-4a3e-ab50-b59ba0f839ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b46db694ce3444a9c3bfb370b625dd8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:58.308215 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a129a86e-5e0b-4a3e-ab50-b59ba0f839ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b46db694ce3444a9c3bfb370b625dd8'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:58.327595 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1246/2483] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:13:58 2022] DELETE /identity/v3/users/8b46db694ce3444a9c3bfb370b625dd8 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:13:58.891432 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211a7d9-0df3-4e4a-8c03-485ec6eb41cc admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:58.892954 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1211a7d9-0df3-4e4a-8c03-485ec6eb41cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:58.908066 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211a7d9-0df3-4e4a-8c03-485ec6eb41cc admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:58.965916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:13:59.001018 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd887546-2cda-488d-ab3c-5eb8ab8b8566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:59.001924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd887546-2cda-488d-ab3c-5eb8ab8b8566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:59.002233 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd887546-2cda-488d-ab3c-5eb8ab8b8566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:59.002515 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd887546-2cda-488d-ab3c-5eb8ab8b8566 admin admin] PATH_INFO: `/v3/projects/c230b153a5894b868cccf57cab694b20` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:59.003776 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd887546-2cda-488d-ab3c-5eb8ab8b8566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c230b153a5894b868cccf57cab694b20)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:59.005852 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd887546-2cda-488d-ab3c-5eb8ab8b8566 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:59.090333 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cd887546-2cda-488d-ab3c-5eb8ab8b8566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c230b153a5894b868cccf57cab694b20', 'request_id': 'req-cd887546-2cda-488d-ab3c-5eb8ab8b8566'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:59.098729 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cd887546-2cda-488d-ab3c-5eb8ab8b8566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c230b153a5894b868cccf57cab694b20', 'request_id': 'req-cd887546-2cda-488d-ab3c-5eb8ab8b8566'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:59.112083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cd887546-2cda-488d-ab3c-5eb8ab8b8566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c230b153a5894b868cccf57cab694b20', 'request_id': 'req-cd887546-2cda-488d-ab3c-5eb8ab8b8566'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:59.127425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cd887546-2cda-488d-ab3c-5eb8ab8b8566 admin admin] The token cache is being invalidate because project c230b153a5894b868cccf57cab694b20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:13:59.127739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cd887546-2cda-488d-ab3c-5eb8ab8b8566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:59.128547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-cd887546-2cda-488d-ab3c-5eb8ab8b8566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:59.130640 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1238/2484] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:13:58 2022] DELETE /identity/v3/projects/c230b153a5894b868cccf57cab694b20 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:13:59.137238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129a86e-5e0b-4a3e-ab50-b59ba0f839ea admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:13:59.140763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a129a86e-5e0b-4a3e-ab50-b59ba0f839ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:13:59.156020 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129a86e-5e0b-4a3e-ab50-b59ba0f839ea admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:13:59.250158 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b6e8b-8d19-4d7a-bc49-692ed89da263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:13:59.251931 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b6e8b-8d19-4d7a-bc49-692ed89da263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:13:59.252508 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b6e8b-8d19-4d7a-bc49-692ed89da263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:13:59.252978 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b6e8b-8d19-4d7a-bc49-692ed89da263 admin admin] PATH_INFO: `/v3/users/58169331c4294b2b82339ef3da09d106` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:13:59.255132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b6e8b-8d19-4d7a-bc49-692ed89da263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58169331c4294b2b82339ef3da09d106)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:13:59.257249 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b6e8b-8d19-4d7a-bc49-692ed89da263 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:13:59.328919 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-344b6e8b-8d19-4d7a-bc49-692ed89da263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58169331c4294b2b82339ef3da09d106'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:59.343875 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-344b6e8b-8d19-4d7a-bc49-692ed89da263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58169331c4294b2b82339ef3da09d106'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:59.347235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-344b6e8b-8d19-4d7a-bc49-692ed89da263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58169331c4294b2b82339ef3da09d106'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:59.362404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-344b6e8b-8d19-4d7a-bc49-692ed89da263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58169331c4294b2b82339ef3da09d106'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:59.386189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-344b6e8b-8d19-4d7a-bc49-692ed89da263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58169331c4294b2b82339ef3da09d106'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:13:59.395466 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1247/2485] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:13:59 2022] DELETE /identity/v3/users/58169331c4294b2b82339ef3da09d106 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:14:00.057362 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae3c07-8e14-41ac-a3b7-ffe0831c2850 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:00.057856 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae3c07-8e14-41ac-a3b7-ffe0831c2850 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:00.057950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae3c07-8e14-41ac-a3b7-ffe0831c2850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:00.084486 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-13ae3c07-8e14-41ac-a3b7-ffe0831c2850 None None] MFA Rules not processed for user `6d4c4b75552b4c739079f328a6efba40`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:14:00.085720 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-13ae3c07-8e14-41ac-a3b7-ffe0831c2850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:00.148799 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1239/2486] 10.222.0.35 () {58 vars in 1009 bytes} [Thu May 19 22:14:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:14:00.161666 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b6e8b-8d19-4d7a-bc49-692ed89da263 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:00.163256 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-344b6e8b-8d19-4d7a-bc49-692ed89da263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:00.236663 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:14:00.264933 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b6e8b-8d19-4d7a-bc49-692ed89da263 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:00.271433 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae3c07-8e14-41ac-a3b7-ffe0831c2850 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:00.273151 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-13ae3c07-8e14-41ac-a3b7-ffe0831c2850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:00.276143 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd9a4e-04c6-4f26-8816-ed799ec2da60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a4208619f84f16b735871ee114e660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:00.277122 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd9a4e-04c6-4f26-8816-ed799ec2da60 service swift] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:00.277625 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd9a4e-04c6-4f26-8816-ed799ec2da60 service swift] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:00.278091 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd9a4e-04c6-4f26-8816-ed799ec2da60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:00.289681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd9a4e-04c6-4f26-8816-ed799ec2da60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:00.292519 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd9a4e-04c6-4f26-8816-ed799ec2da60 service swift] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:00.304178 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1248/2487] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 22:14:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 22:14:00.376228 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae3c07-8e14-41ac-a3b7-ffe0831c2850 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:00.381374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18dadd-dfc1-4c51-864e-351193b3ea31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:00.382389 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18dadd-dfc1-4c51-864e-351193b3ea31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:00.382763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18dadd-dfc1-4c51-864e-351193b3ea31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:00.383107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18dadd-dfc1-4c51-864e-351193b3ea31 admin admin] PATH_INFO: `/v3/projects/24ac87278f764f72b9058025a3e46567` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:00.384674 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18dadd-dfc1-4c51-864e-351193b3ea31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24ac87278f764f72b9058025a3e46567)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:00.387056 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18dadd-dfc1-4c51-864e-351193b3ea31 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:00.412858 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:14:00.458527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-be18dadd-dfc1-4c51-864e-351193b3ea31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24ac87278f764f72b9058025a3e46567', 'request_id': 'req-be18dadd-dfc1-4c51-864e-351193b3ea31'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:00.465772 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-be18dadd-dfc1-4c51-864e-351193b3ea31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24ac87278f764f72b9058025a3e46567', 'request_id': 'req-be18dadd-dfc1-4c51-864e-351193b3ea31'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:00.475238 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-be18dadd-dfc1-4c51-864e-351193b3ea31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24ac87278f764f72b9058025a3e46567', 'request_id': 'req-be18dadd-dfc1-4c51-864e-351193b3ea31'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:00.487954 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-be18dadd-dfc1-4c51-864e-351193b3ea31 admin admin] The token cache is being invalidate because project 24ac87278f764f72b9058025a3e46567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:14:00.488604 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-be18dadd-dfc1-4c51-864e-351193b3ea31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:00.489649 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-be18dadd-dfc1-4c51-864e-351193b3ea31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:00.491445 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1240/2488] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:14:00 2022] DELETE /identity/v3/projects/24ac87278f764f72b9058025a3e46567 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:14:00.496566 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29b4ec-42e0-400b-bd4e-4a9b859b9ea1 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:00.496861 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29b4ec-42e0-400b-bd4e-4a9b859b9ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:00.497143 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29b4ec-42e0-400b-bd4e-4a9b859b9ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:00.523345 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-0f29b4ec-42e0-400b-bd4e-4a9b859b9ea1 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:14:00.524830 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0f29b4ec-42e0-400b-bd4e-4a9b859b9ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:00.591097 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1249/2489] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:14:00.599660 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c515f-b6b8-42c7-a5f5-48228a9c2034 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:00.599947 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c515f-b6b8-42c7-a5f5-48228a9c2034 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:00.600234 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c515f-b6b8-42c7-a5f5-48228a9c2034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:00.620451 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-828c515f-b6b8-42c7-a5f5-48228a9c2034 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:14:00.621732 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-828c515f-b6b8-42c7-a5f5-48228a9c2034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:00.630477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1241/2490] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:14:00.634717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29b4ec-42e0-400b-bd4e-4a9b859b9ea1 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:00.646208 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29b4ec-42e0-400b-bd4e-4a9b859b9ea1 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:00.651011 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874713e-f6dd-4797-8d09-8d7d8e4134f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:00.651715 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874713e-f6dd-4797-8d09-8d7d8e4134f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:00.651999 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874713e-f6dd-4797-8d09-8d7d8e4134f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:00.652282 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874713e-f6dd-4797-8d09-8d7d8e4134f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:00.653298 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874713e-f6dd-4797-8d09-8d7d8e4134f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:14:00.653678 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874713e-f6dd-4797-8d09-8d7d8e4134f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:00.655301 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874713e-f6dd-4797-8d09-8d7d8e4134f4 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:00.667838 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1250/2491] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:14:00.673179 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c515f-b6b8-42c7-a5f5-48228a9c2034 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:00.682724 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c515f-b6b8-42c7-a5f5-48228a9c2034 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:00.688455 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6db9b-a1ad-4ff8-bf74-244ae0ccc962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:00.689123 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6db9b-a1ad-4ff8-bf74-244ae0ccc962 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:00.689410 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6db9b-a1ad-4ff8-bf74-244ae0ccc962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:00.689687 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6db9b-a1ad-4ff8-bf74-244ae0ccc962 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:00.690416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c6db9b-a1ad-4ff8-bf74-244ae0ccc962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:00.692370 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c6db9b-a1ad-4ff8-bf74-244ae0ccc962 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:00.719757 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1242/2492] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:14:00 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:14:00.723932 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874713e-f6dd-4797-8d09-8d7d8e4134f4 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:00.734781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874713e-f6dd-4797-8d09-8d7d8e4134f4 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:00.791863 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7beaa-78ea-4013-bf93-5d43ee381832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:00.792588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7beaa-78ea-4013-bf93-5d43ee381832 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:00.792875 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7beaa-78ea-4013-bf93-5d43ee381832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:00.793155 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7beaa-78ea-4013-bf93-5d43ee381832 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:00.802602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b7beaa-78ea-4013-bf93-5d43ee381832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:00.804646 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b7beaa-78ea-4013-bf93-5d43ee381832 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:00.825633 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1251/2493] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:14:00 2022] POST /identity/v3/users => generated 282 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:14:00.829991 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6db9b-a1ad-4ff8-bf74-244ae0ccc962 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:00.840389 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6db9b-a1ad-4ff8-bf74-244ae0ccc962 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:00.845120 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e828912-cf29-4ef2-bd2f-f22baea45b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:00.845808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e828912-cf29-4ef2-bd2f-f22baea45b87 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:00.846099 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e828912-cf29-4ef2-bd2f-f22baea45b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:00.846387 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e828912-cf29-4ef2-bd2f-f22baea45b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:00.847157 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e828912-cf29-4ef2-bd2f-f22baea45b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:00.848820 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e828912-cf29-4ef2-bd2f-f22baea45b87 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:00.861023 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1243/2494] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:14:00.865048 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7beaa-78ea-4013-bf93-5d43ee381832 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:00.876290 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7beaa-78ea-4013-bf93-5d43ee381832 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:00.881186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e75bf2-d065-477a-9d40-48631835b074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:00.882077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e75bf2-d065-477a-9d40-48631835b074 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:00.882174 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e75bf2-d065-477a-9d40-48631835b074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:00.882401 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e75bf2-d065-477a-9d40-48631835b074 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:00.883130 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e75bf2-d065-477a-9d40-48631835b074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:00.884780 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e75bf2-d065-477a-9d40-48631835b074 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:00.895873 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1252/2495] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:14:00.907569 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e828912-cf29-4ef2-bd2f-f22baea45b87 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:00.918099 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e828912-cf29-4ef2-bd2f-f22baea45b87 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:00.923885 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c82c83-bcba-44ad-90b2-4c43be0842af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:00.924842 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c82c83-bcba-44ad-90b2-4c43be0842af admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:00.925126 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c82c83-bcba-44ad-90b2-4c43be0842af admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:00.925403 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c82c83-bcba-44ad-90b2-4c43be0842af admin admin] PATH_INFO: `/v3/projects/feca8fbfe1994cf0b6b904db0b04f910/users/a0d14e23201c489aa9cc768c799d2568/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:00.940687 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c82c83-bcba-44ad-90b2-4c43be0842af admin admin] RBAC: Authorizing `identity:create_grant(project_id=feca8fbfe1994cf0b6b904db0b04f910, user_id=a0d14e23201c489aa9cc768c799d2568, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:00.943353 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c82c83-bcba-44ad-90b2-4c43be0842af admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:00.958247 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1244/2496] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:14:00 2022] PUT /identity/v3/projects/feca8fbfe1994cf0b6b904db0b04f910/users/a0d14e23201c489aa9cc768c799d2568/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:14:00.970186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0f4e6-d7f2-43db-9270-fb97b3facbe9 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:00.970488 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0f4e6-d7f2-43db-9270-fb97b3facbe9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:00.970774 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0f4e6-d7f2-43db-9270-fb97b3facbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:00.998045 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-7da0f4e6-d7f2-43db-9270-fb97b3facbe9 None None] MFA Rules not processed for user `a0d14e23201c489aa9cc768c799d2568`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:14:00.999857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7da0f4e6-d7f2-43db-9270-fb97b3facbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:01.049498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:14:01.077953 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1253/2497] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:14:00 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:14:01.089242 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c82c83-bcba-44ad-90b2-4c43be0842af admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:01.090926 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e9c82c83-bcba-44ad-90b2-4c43be0842af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:01.150708 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c82c83-bcba-44ad-90b2-4c43be0842af admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:01.154293 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242ff06-60e6-4888-8d54-f4d497dff6e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:01.155458 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242ff06-60e6-4888-8d54-f4d497dff6e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:01.155737 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242ff06-60e6-4888-8d54-f4d497dff6e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:01.156014 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242ff06-60e6-4888-8d54-f4d497dff6e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:01.165293 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242ff06-60e6-4888-8d54-f4d497dff6e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:01.166756 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242ff06-60e6-4888-8d54-f4d497dff6e7 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:01.176956 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1245/2498] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:14:01 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:14:11.074889 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=10 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:14:11.177814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:DELETE=7,keystone:SELECT=68,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:14:23.246299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b36ec6-9a6c-451e-a90f-755c4cc2ba64 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:23.246299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b36ec6-9a6c-451e-a90f-755c4cc2ba64 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:23.246299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b36ec6-9a6c-451e-a90f-755c4cc2ba64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:23.265378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-50b36ec6-9a6c-451e-a90f-755c4cc2ba64 None None] MFA Rules not processed for user `6d4c4b75552b4c739079f328a6efba40`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:14:23.267093 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-50b36ec6-9a6c-451e-a90f-755c4cc2ba64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:23.333810 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1254/2499] 10.222.0.35 () {58 vars in 967 bytes} [Thu May 19 22:14:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:14:23.348313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242ff06-60e6-4888-8d54-f4d497dff6e7 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:23.350105 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-e242ff06-60e6-4888-8d54-f4d497dff6e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:23.448737 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242ff06-60e6-4888-8d54-f4d497dff6e7 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:23.455029 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec704820-4383-4a39-9fd7-8af29ce82beb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a4208619f84f16b735871ee114e660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:23.456202 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec704820-4383-4a39-9fd7-8af29ce82beb service swift] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:23.456688 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec704820-4383-4a39-9fd7-8af29ce82beb service swift] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:23.456810 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec704820-4383-4a39-9fd7-8af29ce82beb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:23.467114 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec704820-4383-4a39-9fd7-8af29ce82beb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:23.469856 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec704820-4383-4a39-9fd7-8af29ce82beb service swift] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:23.479945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1246/2500] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 22:14:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 22:14:33.326017 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=25 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:14:33.476028 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=32 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:14:38.269763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b36ec6-9a6c-451e-a90f-755c4cc2ba64 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:38.351362 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b36ec6-9a6c-451e-a90f-755c4cc2ba64 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:38.356245 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f32ad-a921-4c1a-af27-3efb61ffd4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:38.357179 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f32ad-a921-4c1a-af27-3efb61ffd4b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:38.357697 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f32ad-a921-4c1a-af27-3efb61ffd4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:38.358060 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f32ad-a921-4c1a-af27-3efb61ffd4b5 admin admin] PATH_INFO: `/v3/users/a0d14e23201c489aa9cc768c799d2568` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:38.359431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f32ad-a921-4c1a-af27-3efb61ffd4b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0d14e23201c489aa9cc768c799d2568)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:38.362200 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f32ad-a921-4c1a-af27-3efb61ffd4b5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:38.429550 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7e6f32ad-a921-4c1a-af27-3efb61ffd4b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0d14e23201c489aa9cc768c799d2568'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:38.438393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7e6f32ad-a921-4c1a-af27-3efb61ffd4b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0d14e23201c489aa9cc768c799d2568'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:38.439174 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7e6f32ad-a921-4c1a-af27-3efb61ffd4b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0d14e23201c489aa9cc768c799d2568'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:38.458925 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7e6f32ad-a921-4c1a-af27-3efb61ffd4b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0d14e23201c489aa9cc768c799d2568'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:38.480298 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7e6f32ad-a921-4c1a-af27-3efb61ffd4b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0d14e23201c489aa9cc768c799d2568'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:38.487749 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1255/2501] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:14:38 2022] DELETE /identity/v3/users/a0d14e23201c489aa9cc768c799d2568 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:14:38.492357 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17253c8d-3fa7-4354-bb1e-7b34e1f2963d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:38.492849 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17253c8d-3fa7-4354-bb1e-7b34e1f2963d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:38.492959 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17253c8d-3fa7-4354-bb1e-7b34e1f2963d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:38.519596 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-17253c8d-3fa7-4354-bb1e-7b34e1f2963d None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:14:38.520799 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-17253c8d-3fa7-4354-bb1e-7b34e1f2963d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:38.589346 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1247/2502] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:14:38.599790 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f32ad-a921-4c1a-af27-3efb61ffd4b5 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:38.601251 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7e6f32ad-a921-4c1a-af27-3efb61ffd4b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:38.664178 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f32ad-a921-4c1a-af27-3efb61ffd4b5 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:38.668100 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39969b3-b31e-43c7-a554-d33bdea6fd48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:38.668819 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39969b3-b31e-43c7-a554-d33bdea6fd48 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:38.669106 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39969b3-b31e-43c7-a554-d33bdea6fd48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:38.669380 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39969b3-b31e-43c7-a554-d33bdea6fd48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:38.680500 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39969b3-b31e-43c7-a554-d33bdea6fd48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:38.681955 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39969b3-b31e-43c7-a554-d33bdea6fd48 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:38.691785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1256/2503] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:14:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:14:38.997314 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17253c8d-3fa7-4354-bb1e-7b34e1f2963d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:38.998769 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-17253c8d-3fa7-4354-bb1e-7b34e1f2963d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:39.012413 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17253c8d-3fa7-4354-bb1e-7b34e1f2963d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:39.017994 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374cfa16-7d50-454d-be1d-3c637d117522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:39.018874 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cfa16-7d50-454d-be1d-3c637d117522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:39.019194 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cfa16-7d50-454d-be1d-3c637d117522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:39.019477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cfa16-7d50-454d-be1d-3c637d117522 admin admin] PATH_INFO: `/v3/projects/feca8fbfe1994cf0b6b904db0b04f910` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:39.020963 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374cfa16-7d50-454d-be1d-3c637d117522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feca8fbfe1994cf0b6b904db0b04f910)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:39.022791 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374cfa16-7d50-454d-be1d-3c637d117522 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:39.072540 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-374cfa16-7d50-454d-be1d-3c637d117522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feca8fbfe1994cf0b6b904db0b04f910', 'request_id': 'req-374cfa16-7d50-454d-be1d-3c637d117522'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:39.078725 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-374cfa16-7d50-454d-be1d-3c637d117522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feca8fbfe1994cf0b6b904db0b04f910', 'request_id': 'req-374cfa16-7d50-454d-be1d-3c637d117522'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:39.089010 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-374cfa16-7d50-454d-be1d-3c637d117522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feca8fbfe1994cf0b6b904db0b04f910', 'request_id': 'req-374cfa16-7d50-454d-be1d-3c637d117522'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:39.101552 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-374cfa16-7d50-454d-be1d-3c637d117522 admin admin] The token cache is being invalidate because project feca8fbfe1994cf0b6b904db0b04f910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:14:39.101873 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-374cfa16-7d50-454d-be1d-3c637d117522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:39.102598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-374cfa16-7d50-454d-be1d-3c637d117522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:39.104141 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1248/2504] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:14:38 2022] DELETE /identity/v3/projects/feca8fbfe1994cf0b6b904db0b04f910 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:14:39.109244 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41131b-8258-47b0-8171-0ccc5a82a76b None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:39.109539 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41131b-8258-47b0-8171-0ccc5a82a76b None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:39.109821 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41131b-8258-47b0-8171-0ccc5a82a76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:39.128270 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-ee41131b-8258-47b0-8171-0ccc5a82a76b None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:14:39.129521 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ee41131b-8258-47b0-8171-0ccc5a82a76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:39.149769 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:14:39.204868 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1257/2505] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:14:39.212651 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab1f08-4911-4de9-b522-2ce31ad205f7 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:39.212944 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab1f08-4911-4de9-b522-2ce31ad205f7 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:39.213227 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab1f08-4911-4de9-b522-2ce31ad205f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:39.231981 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8bab1f08-4911-4de9-b522-2ce31ad205f7 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:14:39.233225 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8bab1f08-4911-4de9-b522-2ce31ad205f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:39.250548 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1249/2506] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:14:39.254933 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41131b-8258-47b0-8171-0ccc5a82a76b None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:39.264942 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41131b-8258-47b0-8171-0ccc5a82a76b None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:39.269523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa788c0-56fd-4f24-b145-482b41208928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:39.270171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa788c0-56fd-4f24-b145-482b41208928 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:39.270730 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa788c0-56fd-4f24-b145-482b41208928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:39.270730 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa788c0-56fd-4f24-b145-482b41208928 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:39.271414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa788c0-56fd-4f24-b145-482b41208928 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:14:39.271717 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa788c0-56fd-4f24-b145-482b41208928 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:39.273359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa788c0-56fd-4f24-b145-482b41208928 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:39.285568 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1258/2507] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:14:39.296665 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab1f08-4911-4de9-b522-2ce31ad205f7 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:39.307030 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab1f08-4911-4de9-b522-2ce31ad205f7 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:39.311745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74346f1e-b3e3-4421-8174-f9ff880229d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:39.312422 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74346f1e-b3e3-4421-8174-f9ff880229d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:39.312722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74346f1e-b3e3-4421-8174-f9ff880229d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:39.313006 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74346f1e-b3e3-4421-8174-f9ff880229d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:39.313769 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74346f1e-b3e3-4421-8174-f9ff880229d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:39.315693 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74346f1e-b3e3-4421-8174-f9ff880229d8 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:39.348541 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1250/2508] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:14:39 2022] POST /identity/v3/projects => generated 395 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:14:39.352681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa788c0-56fd-4f24-b145-482b41208928 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:39.363530 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa788c0-56fd-4f24-b145-482b41208928 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:39.430672 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8185ce-df17-45e3-a737-302f86856120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:39.431392 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8185ce-df17-45e3-a737-302f86856120 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:39.431685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8185ce-df17-45e3-a737-302f86856120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:39.431963 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8185ce-df17-45e3-a737-302f86856120 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:39.432697 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8185ce-df17-45e3-a737-302f86856120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:39.434645 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8185ce-df17-45e3-a737-302f86856120 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:39.473476 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1259/2509] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:14:39 2022] POST /identity/v3/users => generated 298 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:14:39.482199 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74346f1e-b3e3-4421-8174-f9ff880229d8 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:39.493170 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74346f1e-b3e3-4421-8174-f9ff880229d8 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:39.502204 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ae6cd-1e7c-49b4-9e4c-ebeed58f642e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:39.507790 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ae6cd-1e7c-49b4-9e4c-ebeed58f642e admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:39.508211 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ae6cd-1e7c-49b4-9e4c-ebeed58f642e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:39.508726 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ae6cd-1e7c-49b4-9e4c-ebeed58f642e admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:39.509585 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ae6cd-1e7c-49b4-9e4c-ebeed58f642e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:39.512037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ae6cd-1e7c-49b4-9e4c-ebeed58f642e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:39.524594 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1251/2510] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:14:39.528576 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8185ce-df17-45e3-a737-302f86856120 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:39.540254 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8185ce-df17-45e3-a737-302f86856120 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:39.546496 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252fac2-eaab-42bc-b278-ce156436f081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:39.548239 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252fac2-eaab-42bc-b278-ce156436f081 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:39.548588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252fac2-eaab-42bc-b278-ce156436f081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:39.549037 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252fac2-eaab-42bc-b278-ce156436f081 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:39.549877 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252fac2-eaab-42bc-b278-ce156436f081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:39.551670 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252fac2-eaab-42bc-b278-ce156436f081 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:39.566583 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1260/2511] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:14:39.570674 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ae6cd-1e7c-49b4-9e4c-ebeed58f642e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:39.582228 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ae6cd-1e7c-49b4-9e4c-ebeed58f642e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:39.588002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ae10d-476e-4807-9468-83b7a52c109d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:39.589217 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ae10d-476e-4807-9468-83b7a52c109d admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:39.589609 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ae10d-476e-4807-9468-83b7a52c109d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:39.590280 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ae10d-476e-4807-9468-83b7a52c109d admin admin] PATH_INFO: `/v3/projects/1696c8f902ed488691f6a111ea70bd88/users/0c5cca9373114b5f8157bf21327e3081/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:39.608549 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ae10d-476e-4807-9468-83b7a52c109d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1696c8f902ed488691f6a111ea70bd88, user_id=0c5cca9373114b5f8157bf21327e3081, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:39.612290 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ae10d-476e-4807-9468-83b7a52c109d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:39.625306 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1252/2512] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:14:39 2022] PUT /identity/v3/projects/1696c8f902ed488691f6a111ea70bd88/users/0c5cca9373114b5f8157bf21327e3081/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:14:39.635578 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99bd7d-5a91-4da6-98f7-f8f165516832 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:39.635873 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99bd7d-5a91-4da6-98f7-f8f165516832 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:39.636182 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99bd7d-5a91-4da6-98f7-f8f165516832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:39.667999 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-ac99bd7d-5a91-4da6-98f7-f8f165516832 None None] MFA Rules not processed for user `0c5cca9373114b5f8157bf21327e3081`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:14:39.669286 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ac99bd7d-5a91-4da6-98f7-f8f165516832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:39.737562 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1261/2513] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:14:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:14:39.750409 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ae10d-476e-4807-9468-83b7a52c109d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:39.752187 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-127ae10d-476e-4807-9468-83b7a52c109d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:39.775479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:14:39.814081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ae10d-476e-4807-9468-83b7a52c109d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:39.817970 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e9daf-69de-4f44-abd1-20ba5e507390 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:39.818629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e9daf-69de-4f44-abd1-20ba5e507390 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:39.818907 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e9daf-69de-4f44-abd1-20ba5e507390 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:39.819180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e9daf-69de-4f44-abd1-20ba5e507390 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:39.828341 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e9daf-69de-4f44-abd1-20ba5e507390 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:39.830597 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e9daf-69de-4f44-abd1-20ba5e507390 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:39.839818 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1253/2514] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:14:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:14:40.723787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99bd7d-5a91-4da6-98f7-f8f165516832 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:40.725221 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ac99bd7d-5a91-4da6-98f7-f8f165516832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:40.745130 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:14:40.786190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99bd7d-5a91-4da6-98f7-f8f165516832 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:40.789775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc984ee-c6d5-455d-8849-e691870adc66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:40.790420 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc984ee-c6d5-455d-8849-e691870adc66 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:40.790699 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc984ee-c6d5-455d-8849-e691870adc66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:40.790968 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc984ee-c6d5-455d-8849-e691870adc66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:40.792788 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-dbc984ee-c6d5-455d-8849-e691870adc66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:40.859307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc984ee-c6d5-455d-8849-e691870adc66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:40.860824 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc984ee-c6d5-455d-8849-e691870adc66 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:40.871088 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1262/2515] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:14:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:14:44.162699 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e9daf-69de-4f44-abd1-20ba5e507390 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:44.164161 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d37e9daf-69de-4f44-abd1-20ba5e507390 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:44.242834 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc984ee-c6d5-455d-8849-e691870adc66 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:44.248705 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-dbc984ee-c6d5-455d-8849-e691870adc66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:44.256260 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e9daf-69de-4f44-abd1-20ba5e507390 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:44.262677 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb69bd-6084-49b4-80a7-0c5a694cac08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1004beeeaed4af4a92c89ad31008b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:44.263345 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb69bd-6084-49b4-80a7-0c5a694cac08 service placement] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:44.263452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc984ee-c6d5-455d-8849-e691870adc66 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:44.263628 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb69bd-6084-49b4-80a7-0c5a694cac08 service placement] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:44.263906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb69bd-6084-49b4-80a7-0c5a694cac08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:44.265762 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2dfb69bd-6084-49b4-80a7-0c5a694cac08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:44.268253 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b58c6-d941-439b-80f6-c923fe84ae5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:44.269352 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b58c6-d941-439b-80f6-c923fe84ae5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:44.269700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b58c6-d941-439b-80f6-c923fe84ae5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:44.270072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b58c6-d941-439b-80f6-c923fe84ae5f admin admin] PATH_INFO: `/v3/users/8bd7f018e42d45a5bea3c9ffaa567496` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:44.271368 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b58c6-d941-439b-80f6-c923fe84ae5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bd7f018e42d45a5bea3c9ffaa567496)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:44.273540 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b58c6-d941-439b-80f6-c923fe84ae5f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:44.278466 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb69bd-6084-49b4-80a7-0c5a694cac08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:44.280058 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb69bd-6084-49b4-80a7-0c5a694cac08 service placement] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:44.290988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1254/2516] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:14:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:14:44.327072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c42b58c6-d941-439b-80f6-c923fe84ae5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bd7f018e42d45a5bea3c9ffaa567496'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:44.334030 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c42b58c6-d941-439b-80f6-c923fe84ae5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bd7f018e42d45a5bea3c9ffaa567496'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:44.334712 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c42b58c6-d941-439b-80f6-c923fe84ae5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bd7f018e42d45a5bea3c9ffaa567496'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:44.348001 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c42b58c6-d941-439b-80f6-c923fe84ae5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bd7f018e42d45a5bea3c9ffaa567496'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:44.356860 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c42b58c6-d941-439b-80f6-c923fe84ae5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bd7f018e42d45a5bea3c9ffaa567496'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:44.363898 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1263/2517] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:14:44 2022] DELETE /identity/v3/users/8bd7f018e42d45a5bea3c9ffaa567496 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:14:44.554097 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb69bd-6084-49b4-80a7-0c5a694cac08 service placement] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:44.575188 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb69bd-6084-49b4-80a7-0c5a694cac08 service placement] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:44.644305 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a7f73-2dd6-4fed-be03-ada84ff3f9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:44.645211 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a7f73-2dd6-4fed-be03-ada84ff3f9a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:44.645500 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a7f73-2dd6-4fed-be03-ada84ff3f9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:44.645771 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a7f73-2dd6-4fed-be03-ada84ff3f9a3 admin admin] PATH_INFO: `/v3/projects/a9e34091570646b4a49115ef60aa3687` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:44.646981 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a7f73-2dd6-4fed-be03-ada84ff3f9a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9e34091570646b4a49115ef60aa3687)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:44.648956 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a7f73-2dd6-4fed-be03-ada84ff3f9a3 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:44.700221 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ee7a7f73-2dd6-4fed-be03-ada84ff3f9a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9e34091570646b4a49115ef60aa3687', 'request_id': 'req-ee7a7f73-2dd6-4fed-be03-ada84ff3f9a3'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:44.707211 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ee7a7f73-2dd6-4fed-be03-ada84ff3f9a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9e34091570646b4a49115ef60aa3687', 'request_id': 'req-ee7a7f73-2dd6-4fed-be03-ada84ff3f9a3'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:44.708966 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:14:44.716065 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ee7a7f73-2dd6-4fed-be03-ada84ff3f9a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9e34091570646b4a49115ef60aa3687', 'request_id': 'req-ee7a7f73-2dd6-4fed-be03-ada84ff3f9a3'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:44.730597 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ee7a7f73-2dd6-4fed-be03-ada84ff3f9a3 admin admin] The token cache is being invalidate because project a9e34091570646b4a49115ef60aa3687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:14:44.730886 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ee7a7f73-2dd6-4fed-be03-ada84ff3f9a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:44.731691 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ee7a7f73-2dd6-4fed-be03-ada84ff3f9a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:44.733447 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1255/2518] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:14:44 2022] DELETE /identity/v3/projects/a9e34091570646b4a49115ef60aa3687 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:14:44.738346 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de27ea-d028-4aa4-97fc-02a82d62050c None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:44.738754 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de27ea-d028-4aa4-97fc-02a82d62050c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:44.739044 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de27ea-d028-4aa4-97fc-02a82d62050c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:44.756662 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c9de27ea-d028-4aa4-97fc-02a82d62050c None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:14:44.757800 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c9de27ea-d028-4aa4-97fc-02a82d62050c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:44.797848 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:14:44.826679 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1264/2519] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:14:44.835298 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ad8a0-1208-4d71-86b2-b420d17711e0 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:44.835584 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ad8a0-1208-4d71-86b2-b420d17711e0 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:44.835882 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ad8a0-1208-4d71-86b2-b420d17711e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:44.855122 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-135ad8a0-1208-4d71-86b2-b420d17711e0 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:14:44.856358 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-135ad8a0-1208-4d71-86b2-b420d17711e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:44.864450 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1256/2520] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:14:44.868845 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de27ea-d028-4aa4-97fc-02a82d62050c None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:44.879851 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de27ea-d028-4aa4-97fc-02a82d62050c None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:44.884723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddb0b1-0a42-44e7-928e-e9c0d312ca8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:44.885390 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddb0b1-0a42-44e7-928e-e9c0d312ca8b admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:44.885705 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddb0b1-0a42-44e7-928e-e9c0d312ca8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:44.885986 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddb0b1-0a42-44e7-928e-e9c0d312ca8b admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:44.887137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddb0b1-0a42-44e7-928e-e9c0d312ca8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:14:44.887590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddb0b1-0a42-44e7-928e-e9c0d312ca8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:44.889183 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddb0b1-0a42-44e7-928e-e9c0d312ca8b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:44.890590 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ad8a0-1208-4d71-86b2-b420d17711e0 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:44.892617 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-135ad8a0-1208-4d71-86b2-b420d17711e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:44.902532 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1265/2521] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:14:44.907861 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddb0b1-0a42-44e7-928e-e9c0d312ca8b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:44.909208 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ad8a0-1208-4d71-86b2-b420d17711e0 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:44.914028 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f92475-4730-49bf-8ce8-03b15c1bd89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:44.914913 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f92475-4730-49bf-8ce8-03b15c1bd89f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:44.915197 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f92475-4730-49bf-8ce8-03b15c1bd89f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:44.915478 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f92475-4730-49bf-8ce8-03b15c1bd89f admin admin] PATH_INFO: `/v3/users/0c5cca9373114b5f8157bf21327e3081` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:44.916730 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f92475-4730-49bf-8ce8-03b15c1bd89f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c5cca9373114b5f8157bf21327e3081)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:44.918678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f92475-4730-49bf-8ce8-03b15c1bd89f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:44.924623 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddb0b1-0a42-44e7-928e-e9c0d312ca8b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:44.929802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e452a9-0d9f-40d5-abc6-e41e7d1215b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:44.930500 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e452a9-0d9f-40d5-abc6-e41e7d1215b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:44.930789 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e452a9-0d9f-40d5-abc6-e41e7d1215b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:44.931071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e452a9-0d9f-40d5-abc6-e41e7d1215b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:44.931772 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e452a9-0d9f-40d5-abc6-e41e7d1215b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:44.934146 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e452a9-0d9f-40d5-abc6-e41e7d1215b6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:44.965482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1266/2522] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:14:44 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:14:44.966587 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e452a9-0d9f-40d5-abc6-e41e7d1215b6 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:44.973770 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c4f92475-4730-49bf-8ce8-03b15c1bd89f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c5cca9373114b5f8157bf21327e3081'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:44.982189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c4f92475-4730-49bf-8ce8-03b15c1bd89f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c5cca9373114b5f8157bf21327e3081'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:44.995342 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c4f92475-4730-49bf-8ce8-03b15c1bd89f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c5cca9373114b5f8157bf21327e3081'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:44.996064 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c4f92475-4730-49bf-8ce8-03b15c1bd89f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c5cca9373114b5f8157bf21327e3081'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:44.997091 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-c4f92475-4730-49bf-8ce8-03b15c1bd89f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c5cca9373114b5f8157bf21327e3081'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:45.009339 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1257/2523] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:14:44 2022] DELETE /identity/v3/users/0c5cca9373114b5f8157bf21327e3081 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:14:45.013812 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e290fd-996b-4f2c-8a3e-a1a0088a0e17 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:45.014103 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e290fd-996b-4f2c-8a3e-a1a0088a0e17 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:45.014384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e290fd-996b-4f2c-8a3e-a1a0088a0e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:45.034389 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-80e290fd-996b-4f2c-8a3e-a1a0088a0e17 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:14:45.035639 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-80e290fd-996b-4f2c-8a3e-a1a0088a0e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:45.046898 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e452a9-0d9f-40d5-abc6-e41e7d1215b6 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:45.100686 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1258/2524] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:14:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:14:45.106518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77316f67-fe50-454b-80a3-8d6a652865d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:45.107160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77316f67-fe50-454b-80a3-8d6a652865d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:45.107451 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77316f67-fe50-454b-80a3-8d6a652865d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:45.107732 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77316f67-fe50-454b-80a3-8d6a652865d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:45.108446 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77316f67-fe50-454b-80a3-8d6a652865d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:45.110990 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77316f67-fe50-454b-80a3-8d6a652865d7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:45.113831 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e290fd-996b-4f2c-8a3e-a1a0088a0e17 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:45.115216 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-80e290fd-996b-4f2c-8a3e-a1a0088a0e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:45.131304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1267/2525] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:14:44 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:14:45.135555 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77316f67-fe50-454b-80a3-8d6a652865d7 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:45.137610 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-77316f67-fe50-454b-80a3-8d6a652865d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:45.149313 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77316f67-fe50-454b-80a3-8d6a652865d7 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:45.154192 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d9c9c-7dbf-4cad-9c28-0919c04b4b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:45.154991 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d9c9c-7dbf-4cad-9c28-0919c04b4b67 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:45.155277 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d9c9c-7dbf-4cad-9c28-0919c04b4b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:45.155560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d9c9c-7dbf-4cad-9c28-0919c04b4b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:45.156311 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d9c9c-7dbf-4cad-9c28-0919c04b4b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:45.158710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d9c9c-7dbf-4cad-9c28-0919c04b4b67 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:45.169140 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1268/2526] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:14:45.173242 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d9c9c-7dbf-4cad-9c28-0919c04b4b67 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:45.176663 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:14:45.181220 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e290fd-996b-4f2c-8a3e-a1a0088a0e17 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:45.183707 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d9c9c-7dbf-4cad-9c28-0919c04b4b67 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:45.185784 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a70323-2093-456a-88e6-e09dcc7ae98e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:45.186675 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a70323-2093-456a-88e6-e09dcc7ae98e service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:45.187384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a70323-2093-456a-88e6-e09dcc7ae98e service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:45.187864 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a70323-2093-456a-88e6-e09dcc7ae98e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:45.190762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b389f86-e9ad-48f5-95cf-fd13cb0eb362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:45.191632 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b389f86-e9ad-48f5-95cf-fd13cb0eb362 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:45.191838 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b389f86-e9ad-48f5-95cf-fd13cb0eb362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:45.192178 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b389f86-e9ad-48f5-95cf-fd13cb0eb362 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:45.192883 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b389f86-e9ad-48f5-95cf-fd13cb0eb362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:45.194698 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b389f86-e9ad-48f5-95cf-fd13cb0eb362 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:45.199965 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a70323-2093-456a-88e6-e09dcc7ae98e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:45.201456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a70323-2093-456a-88e6-e09dcc7ae98e service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:45.207269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1269/2527] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:14:45.211357 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b389f86-e9ad-48f5-95cf-fd13cb0eb362 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:45.212784 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1259/2528] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:14:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:14:45.221588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b389f86-e9ad-48f5-95cf-fd13cb0eb362 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:45.226350 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16483f5e-ef79-4d6d-8579-3548c3627458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:45.227265 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16483f5e-ef79-4d6d-8579-3548c3627458 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:45.227542 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16483f5e-ef79-4d6d-8579-3548c3627458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:45.228007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16483f5e-ef79-4d6d-8579-3548c3627458 admin admin] PATH_INFO: `/v3/projects/84463fa9b03248e8a301f8730924b867/users/d00deebf710649f69bde3502c943dc9b/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:45.244354 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16483f5e-ef79-4d6d-8579-3548c3627458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84463fa9b03248e8a301f8730924b867, user_id=d00deebf710649f69bde3502c943dc9b, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:45.247259 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16483f5e-ef79-4d6d-8579-3548c3627458 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:45.250359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:14:45.263871 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1270/2529] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:14:45 2022] PUT /identity/v3/projects/84463fa9b03248e8a301f8730924b867/users/d00deebf710649f69bde3502c943dc9b/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:14:45.275255 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95749f68-9422-470e-88e6-3a1cb02918fd None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:45.276090 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95749f68-9422-470e-88e6-3a1cb02918fd None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:45.276376 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95749f68-9422-470e-88e6-3a1cb02918fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:45.308770 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-95749f68-9422-470e-88e6-3a1cb02918fd None None] MFA Rules not processed for user `d00deebf710649f69bde3502c943dc9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:14:45.310005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-95749f68-9422-470e-88e6-3a1cb02918fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:45.391153 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1260/2530] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:14:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:14:45.399724 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16483f5e-ef79-4d6d-8579-3548c3627458 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:45.401756 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-16483f5e-ef79-4d6d-8579-3548c3627458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:45.480684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16483f5e-ef79-4d6d-8579-3548c3627458 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:45.487301 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc8580-e370-472c-999e-35af354b82a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:45.487967 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc8580-e370-472c-999e-35af354b82a3 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:45.488252 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc8580-e370-472c-999e-35af354b82a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:45.488566 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc8580-e370-472c-999e-35af354b82a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:45.498321 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc8580-e370-472c-999e-35af354b82a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:45.500048 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc8580-e370-472c-999e-35af354b82a3 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:45.510927 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1271/2531] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:14:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:14:45.525734 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95749f68-9422-470e-88e6-3a1cb02918fd None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:45.527921 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-95749f68-9422-470e-88e6-3a1cb02918fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:45.616142 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95749f68-9422-470e-88e6-3a1cb02918fd None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:45.622128 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0907c95-54a4-41c5-9fdb-385f91c37a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:45.623355 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0907c95-54a4-41c5-9fdb-385f91c37a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:45.623712 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0907c95-54a4-41c5-9fdb-385f91c37a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:45.624174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0907c95-54a4-41c5-9fdb-385f91c37a44 admin admin] PATH_INFO: `/v3/projects/1696c8f902ed488691f6a111ea70bd88` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:45.625321 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0907c95-54a4-41c5-9fdb-385f91c37a44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1696c8f902ed488691f6a111ea70bd88)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:45.627383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0907c95-54a4-41c5-9fdb-385f91c37a44 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:45.690091 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b0907c95-54a4-41c5-9fdb-385f91c37a44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1696c8f902ed488691f6a111ea70bd88', 'request_id': 'req-b0907c95-54a4-41c5-9fdb-385f91c37a44'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:45.697077 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b0907c95-54a4-41c5-9fdb-385f91c37a44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1696c8f902ed488691f6a111ea70bd88', 'request_id': 'req-b0907c95-54a4-41c5-9fdb-385f91c37a44'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:45.707204 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b0907c95-54a4-41c5-9fdb-385f91c37a44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1696c8f902ed488691f6a111ea70bd88', 'request_id': 'req-b0907c95-54a4-41c5-9fdb-385f91c37a44'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:45.719081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b0907c95-54a4-41c5-9fdb-385f91c37a44 admin admin] The token cache is being invalidate because project 1696c8f902ed488691f6a111ea70bd88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:14:45.720100 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b0907c95-54a4-41c5-9fdb-385f91c37a44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:45.720888 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b0907c95-54a4-41c5-9fdb-385f91c37a44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:45.722629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1261/2532] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:14:45 2022] DELETE /identity/v3/projects/1696c8f902ed488691f6a111ea70bd88 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:14:50.820926 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc8580-e370-472c-999e-35af354b82a3 service nova] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:50.830909 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc8580-e370-472c-999e-35af354b82a3 service nova] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:50.889858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a0809-6231-45c7-a89e-049d65fc8d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:50.890726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a0809-6231-45c7-a89e-049d65fc8d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:50.891512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a0809-6231-45c7-a89e-049d65fc8d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:50.891787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a0809-6231-45c7-a89e-049d65fc8d2f admin admin] PATH_INFO: `/v3/users/d00deebf710649f69bde3502c943dc9b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:50.893034 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a0809-6231-45c7-a89e-049d65fc8d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d00deebf710649f69bde3502c943dc9b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:50.894962 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a0809-6231-45c7-a89e-049d65fc8d2f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:50.943257 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ac1a0809-6231-45c7-a89e-049d65fc8d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd00deebf710649f69bde3502c943dc9b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:50.949974 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ac1a0809-6231-45c7-a89e-049d65fc8d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd00deebf710649f69bde3502c943dc9b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:50.950640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ac1a0809-6231-45c7-a89e-049d65fc8d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd00deebf710649f69bde3502c943dc9b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:50.963641 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ac1a0809-6231-45c7-a89e-049d65fc8d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd00deebf710649f69bde3502c943dc9b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:50.972690 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ac1a0809-6231-45c7-a89e-049d65fc8d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd00deebf710649f69bde3502c943dc9b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:50.975295 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:14:50.980384 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1272/2533] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:14:50 2022] DELETE /identity/v3/users/d00deebf710649f69bde3502c943dc9b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:14:50.985576 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee50ab-27af-4c48-aeac-3ee2a2834a98 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:50.986074 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee50ab-27af-4c48-aeac-3ee2a2834a98 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:50.986171 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee50ab-27af-4c48-aeac-3ee2a2834a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:51.004058 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6aee50ab-27af-4c48-aeac-3ee2a2834a98 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:14:51.005308 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6aee50ab-27af-4c48-aeac-3ee2a2834a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:51.010817 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:14:51.073352 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1262/2534] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:14:51.084106 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a0809-6231-45c7-a89e-049d65fc8d2f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:51.085554 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ac1a0809-6231-45c7-a89e-049d65fc8d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:51.144820 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a0809-6231-45c7-a89e-049d65fc8d2f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:51.148469 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822ec34-913c-4f7d-b7df-491cb04436a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:51.149121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822ec34-913c-4f7d-b7df-491cb04436a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:51.149405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822ec34-913c-4f7d-b7df-491cb04436a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:51.149679 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822ec34-913c-4f7d-b7df-491cb04436a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:51.159499 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822ec34-913c-4f7d-b7df-491cb04436a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:51.161000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822ec34-913c-4f7d-b7df-491cb04436a5 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:51.171073 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1273/2535] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:14:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:14:51.452862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee50ab-27af-4c48-aeac-3ee2a2834a98 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:51.454890 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6aee50ab-27af-4c48-aeac-3ee2a2834a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:51.468853 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee50ab-27af-4c48-aeac-3ee2a2834a98 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:51.474441 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0696c-e7e5-40a5-903b-bfe04e89f09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:51.475401 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0696c-e7e5-40a5-903b-bfe04e89f09c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:51.475754 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0696c-e7e5-40a5-903b-bfe04e89f09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:51.476157 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0696c-e7e5-40a5-903b-bfe04e89f09c admin admin] PATH_INFO: `/v3/projects/84463fa9b03248e8a301f8730924b867` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:51.477588 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0696c-e7e5-40a5-903b-bfe04e89f09c admin admin] RBAC: Authorizing `identity:delete_project(project_id=84463fa9b03248e8a301f8730924b867)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:51.480901 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0696c-e7e5-40a5-903b-bfe04e89f09c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:51.532357 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-01c0696c-e7e5-40a5-903b-bfe04e89f09c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84463fa9b03248e8a301f8730924b867', 'request_id': 'req-01c0696c-e7e5-40a5-903b-bfe04e89f09c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:51.542132 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-01c0696c-e7e5-40a5-903b-bfe04e89f09c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84463fa9b03248e8a301f8730924b867', 'request_id': 'req-01c0696c-e7e5-40a5-903b-bfe04e89f09c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:51.550810 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-01c0696c-e7e5-40a5-903b-bfe04e89f09c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84463fa9b03248e8a301f8730924b867', 'request_id': 'req-01c0696c-e7e5-40a5-903b-bfe04e89f09c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:51.561605 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-01c0696c-e7e5-40a5-903b-bfe04e89f09c admin admin] The token cache is being invalidate because project 84463fa9b03248e8a301f8730924b867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:14:51.561914 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-01c0696c-e7e5-40a5-903b-bfe04e89f09c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:51.562616 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-01c0696c-e7e5-40a5-903b-bfe04e89f09c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:51.564867 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1263/2536] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:14:51 2022] DELETE /identity/v3/projects/84463fa9b03248e8a301f8730924b867 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:14:51.569702 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63af5dd-ef0c-4f0d-b765-6ebe57f40e59 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:51.569995 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63af5dd-ef0c-4f0d-b765-6ebe57f40e59 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:51.570275 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63af5dd-ef0c-4f0d-b765-6ebe57f40e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:51.588925 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e63af5dd-ef0c-4f0d-b765-6ebe57f40e59 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:14:51.590202 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e63af5dd-ef0c-4f0d-b765-6ebe57f40e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:51.652275 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1274/2537] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:14:51.659913 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e41259-4055-4ca8-8686-86ffe24371b9 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:51.660260 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e41259-4055-4ca8-8686-86ffe24371b9 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:51.660494 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e41259-4055-4ca8-8686-86ffe24371b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:51.679694 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-39e41259-4055-4ca8-8686-86ffe24371b9 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:14:51.680999 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-39e41259-4055-4ca8-8686-86ffe24371b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:51.689925 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1264/2538] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:14:51.694351 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63af5dd-ef0c-4f0d-b765-6ebe57f40e59 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:51.704258 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63af5dd-ef0c-4f0d-b765-6ebe57f40e59 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:51.709172 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edaafc-f5bf-4597-b528-2dc221460660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:51.709852 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edaafc-f5bf-4597-b528-2dc221460660 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:51.710139 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edaafc-f5bf-4597-b528-2dc221460660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:51.710418 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edaafc-f5bf-4597-b528-2dc221460660 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:51.711180 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7edaafc-f5bf-4597-b528-2dc221460660 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:14:51.711463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7edaafc-f5bf-4597-b528-2dc221460660 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:51.713129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7edaafc-f5bf-4597-b528-2dc221460660 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:51.725450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1275/2539] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:14:51.729875 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e41259-4055-4ca8-8686-86ffe24371b9 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:51.739987 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e41259-4055-4ca8-8686-86ffe24371b9 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:51.745152 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c4778-8127-4140-9400-a49d7c84f7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:51.745827 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c4778-8127-4140-9400-a49d7c84f7ee admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:51.746108 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c4778-8127-4140-9400-a49d7c84f7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:51.746387 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c4778-8127-4140-9400-a49d7c84f7ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:51.747118 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c4778-8127-4140-9400-a49d7c84f7ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:51.749119 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c4778-8127-4140-9400-a49d7c84f7ee admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:51.776664 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1265/2540] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:14:51 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:14:51.780786 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edaafc-f5bf-4597-b528-2dc221460660 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:51.791566 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edaafc-f5bf-4597-b528-2dc221460660 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:51.858558 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf14fe-af04-44f7-90a2-9afaad580ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:51.859235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf14fe-af04-44f7-90a2-9afaad580ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:51.859524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf14fe-af04-44f7-90a2-9afaad580ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:51.860445 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf14fe-af04-44f7-90a2-9afaad580ce2 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:51.861153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf14fe-af04-44f7-90a2-9afaad580ce2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:51.863100 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf14fe-af04-44f7-90a2-9afaad580ce2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:51.883664 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1276/2541] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:14:51 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:14:51.887982 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c4778-8127-4140-9400-a49d7c84f7ee admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:51.899124 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c4778-8127-4140-9400-a49d7c84f7ee admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:51.903999 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf7315-5339-42e6-9440-72769d9abf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:51.904744 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf7315-5339-42e6-9440-72769d9abf2a admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:51.905031 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf7315-5339-42e6-9440-72769d9abf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:51.905312 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf7315-5339-42e6-9440-72769d9abf2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:51.906239 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf7315-5339-42e6-9440-72769d9abf2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:51.908683 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf7315-5339-42e6-9440-72769d9abf2a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:51.919786 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1266/2542] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:14:51.924594 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf14fe-af04-44f7-90a2-9afaad580ce2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:51.934541 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf14fe-af04-44f7-90a2-9afaad580ce2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:51.939295 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9727fe-bcb2-49b4-b613-6888b15b49b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:51.940063 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9727fe-bcb2-49b4-b613-6888b15b49b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:51.940343 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9727fe-bcb2-49b4-b613-6888b15b49b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:51.940648 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9727fe-bcb2-49b4-b613-6888b15b49b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:51.941371 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9727fe-bcb2-49b4-b613-6888b15b49b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:51.942976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9727fe-bcb2-49b4-b613-6888b15b49b9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:51.956660 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1277/2543] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:14:51.961183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf7315-5339-42e6-9440-72769d9abf2a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:51.971857 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf7315-5339-42e6-9440-72769d9abf2a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:51.976460 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e368d-2c59-41a8-b57f-e7a944734ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:51.977350 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e368d-2c59-41a8-b57f-e7a944734ecc admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:51.977629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e368d-2c59-41a8-b57f-e7a944734ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:51.977928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e368d-2c59-41a8-b57f-e7a944734ecc admin admin] PATH_INFO: `/v3/projects/697bb4b14fbc4f619d3e6b3ebfc0f177/users/0bc7d1e1460f4da19f238a1e9e84cb12/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:51.992963 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e368d-2c59-41a8-b57f-e7a944734ecc admin admin] RBAC: Authorizing `identity:create_grant(project_id=697bb4b14fbc4f619d3e6b3ebfc0f177, user_id=0bc7d1e1460f4da19f238a1e9e84cb12, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:51.995594 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e368d-2c59-41a8-b57f-e7a944734ecc admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:52.009841 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1267/2544] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:14:51 2022] PUT /identity/v3/projects/697bb4b14fbc4f619d3e6b3ebfc0f177/users/0bc7d1e1460f4da19f238a1e9e84cb12/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:14:52.020487 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200696a5-ea4d-4664-9ad2-41b6949521b9 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:52.020788 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200696a5-ea4d-4664-9ad2-41b6949521b9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:52.021070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200696a5-ea4d-4664-9ad2-41b6949521b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:52.040204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:14:52.050958 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-200696a5-ea4d-4664-9ad2-41b6949521b9 None None] MFA Rules not processed for user `0bc7d1e1460f4da19f238a1e9e84cb12`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:14:52.052102 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-200696a5-ea4d-4664-9ad2-41b6949521b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:52.119611 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1278/2545] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:14:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:14:52.124251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e368d-2c59-41a8-b57f-e7a944734ecc admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:52.158581 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:14:52.192949 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e368d-2c59-41a8-b57f-e7a944734ecc admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:52.197810 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc51d7c-8c03-416f-82d8-610b44f7b89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:52.198483 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc51d7c-8c03-416f-82d8-610b44f7b89f admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:52.198766 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc51d7c-8c03-416f-82d8-610b44f7b89f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:52.199045 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc51d7c-8c03-416f-82d8-610b44f7b89f admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:52.199751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc51d7c-8c03-416f-82d8-610b44f7b89f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:52.201719 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc51d7c-8c03-416f-82d8-610b44f7b89f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:52.229557 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1268/2546] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:14:52 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:14:52.233848 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200696a5-ea4d-4664-9ad2-41b6949521b9 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:52.245526 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200696a5-ea4d-4664-9ad2-41b6949521b9 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:52.308385 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e5462-1194-470c-aecb-3e51c1f56238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:52.309020 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e5462-1194-470c-aecb-3e51c1f56238 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:52.309311 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e5462-1194-470c-aecb-3e51c1f56238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:52.309590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e5462-1194-470c-aecb-3e51c1f56238 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:52.310278 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e5462-1194-470c-aecb-3e51c1f56238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:52.312224 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e5462-1194-470c-aecb-3e51c1f56238 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:52.336076 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1279/2547] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:14:52 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:14:52.337286 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc51d7c-8c03-416f-82d8-610b44f7b89f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:52.347717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc51d7c-8c03-416f-82d8-610b44f7b89f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:52.352306 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb5379-2d62-46ff-b7a8-e9d2a087ad82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:52.353007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb5379-2d62-46ff-b7a8-e9d2a087ad82 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:52.353288 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb5379-2d62-46ff-b7a8-e9d2a087ad82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:52.353560 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb5379-2d62-46ff-b7a8-e9d2a087ad82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:52.354282 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb5379-2d62-46ff-b7a8-e9d2a087ad82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:52.355873 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb5379-2d62-46ff-b7a8-e9d2a087ad82 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:52.367368 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1269/2548] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:14:52.371750 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e5462-1194-470c-aecb-3e51c1f56238 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:52.382802 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e5462-1194-470c-aecb-3e51c1f56238 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:52.387869 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ae5e1-152f-4192-b186-df9dbd532d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:52.388801 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ae5e1-152f-4192-b186-df9dbd532d02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:52.389089 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ae5e1-152f-4192-b186-df9dbd532d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:52.389369 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ae5e1-152f-4192-b186-df9dbd532d02 admin admin] PATH_INFO: `/v3/projects/1a4005d62dbc4d30ab81fd9215427e97/users/9147216d8e264d30b60f29c431915ce7/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:52.404627 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ae5e1-152f-4192-b186-df9dbd532d02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a4005d62dbc4d30ab81fd9215427e97, user_id=9147216d8e264d30b60f29c431915ce7, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:52.407466 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ae5e1-152f-4192-b186-df9dbd532d02 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:52.420504 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1280/2549] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:14:52 2022] PUT /identity/v3/projects/1a4005d62dbc4d30ab81fd9215427e97/users/9147216d8e264d30b60f29c431915ce7/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:14:52.425083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb5379-2d62-46ff-b7a8-e9d2a087ad82 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:52.435246 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb5379-2d62-46ff-b7a8-e9d2a087ad82 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:52.492397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71ae2e-2173-4985-8941-90febc133100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:52.493099 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71ae2e-2173-4985-8941-90febc133100 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:52.493384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71ae2e-2173-4985-8941-90febc133100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:52.493661 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71ae2e-2173-4985-8941-90febc133100 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:52.494397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71ae2e-2173-4985-8941-90febc133100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:52.495998 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71ae2e-2173-4985-8941-90febc133100 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:52.507335 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1270/2550] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:14:52.511724 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ae5e1-152f-4192-b186-df9dbd532d02 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:52.522404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ae5e1-152f-4192-b186-df9dbd532d02 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:52.527463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0d9f0-2e30-4fc0-bd86-ad5424634d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:52.528366 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0d9f0-2e30-4fc0-bd86-ad5424634d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:52.528805 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0d9f0-2e30-4fc0-bd86-ad5424634d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:52.528968 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0d9f0-2e30-4fc0-bd86-ad5424634d1a admin admin] PATH_INFO: `/v3/projects/1a4005d62dbc4d30ab81fd9215427e97/users/9147216d8e264d30b60f29c431915ce7/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:52.532553 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0d9f0-2e30-4fc0-bd86-ad5424634d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a4005d62dbc4d30ab81fd9215427e97, user_id=9147216d8e264d30b60f29c431915ce7, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:52.535239 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0d9f0-2e30-4fc0-bd86-ad5424634d1a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:52.546204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1281/2551] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:14:52 2022] PUT /identity/v3/projects/1a4005d62dbc4d30ab81fd9215427e97/users/9147216d8e264d30b60f29c431915ce7/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:14:52.558213 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d19037-c66b-493d-9497-cb54e9fc3203 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:52.558572 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d19037-c66b-493d-9497-cb54e9fc3203 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:52.558792 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d19037-c66b-493d-9497-cb54e9fc3203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:52.587481 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-14d19037-c66b-493d-9497-cb54e9fc3203 None None] MFA Rules not processed for user `9147216d8e264d30b60f29c431915ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:14:52.588739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-14d19037-c66b-493d-9497-cb54e9fc3203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:52.663929 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1271/2552] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:14:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:14:52.675732 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0d9f0-2e30-4fc0-bd86-ad5424634d1a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:52.677604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-33a0d9f0-2e30-4fc0-bd86-ad5424634d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:14:52.737704 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0d9f0-2e30-4fc0-bd86-ad5424634d1a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:52.741581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8d8b1-5592-4660-893c-9e2b7b2d0ebd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:52.742125 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8d8b1-5592-4660-893c-9e2b7b2d0ebd service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:52.742406 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8d8b1-5592-4660-893c-9e2b7b2d0ebd service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:52.742680 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8d8b1-5592-4660-893c-9e2b7b2d0ebd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:52.748844 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:14:52.753853 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8d8b1-5592-4660-893c-9e2b7b2d0ebd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:52.755762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8d8b1-5592-4660-893c-9e2b7b2d0ebd service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:52.765671 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1282/2553] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:14:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:14:52.841769 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d19037-c66b-493d-9497-cb54e9fc3203 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:52.852277 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d19037-c66b-493d-9497-cb54e9fc3203 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:52.855930 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4acb209-47c3-469e-8e3d-86d03f5e20d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:52.856618 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acb209-47c3-469e-8e3d-86d03f5e20d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:52.856906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acb209-47c3-469e-8e3d-86d03f5e20d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:52.857186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acb209-47c3-469e-8e3d-86d03f5e20d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:52.882837 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:14:52.924958 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4acb209-47c3-469e-8e3d-86d03f5e20d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:52.926445 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4acb209-47c3-469e-8e3d-86d03f5e20d1 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:52.935402 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1272/2554] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:14:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:14:59.768023 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8d8b1-5592-4660-893c-9e2b7b2d0ebd service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:14:59.836352 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8d8b1-5592-4660-893c-9e2b7b2d0ebd service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:14:59.841182 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de85e6-4948-4ac9-a9c2-adc8f238d94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:14:59.842082 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de85e6-4948-4ac9-a9c2-adc8f238d94d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:59.842371 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de85e6-4948-4ac9-a9c2-adc8f238d94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:59.842647 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de85e6-4948-4ac9-a9c2-adc8f238d94d admin admin] PATH_INFO: `/v3/users/0bc7d1e1460f4da19f238a1e9e84cb12` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:59.843945 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de85e6-4948-4ac9-a9c2-adc8f238d94d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bc7d1e1460f4da19f238a1e9e84cb12)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:14:59.846620 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de85e6-4948-4ac9-a9c2-adc8f238d94d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:14:59.902773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a7de85e6-4948-4ac9-a9c2-adc8f238d94d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bc7d1e1460f4da19f238a1e9e84cb12'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:59.913233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a7de85e6-4948-4ac9-a9c2-adc8f238d94d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bc7d1e1460f4da19f238a1e9e84cb12'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:59.913976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a7de85e6-4948-4ac9-a9c2-adc8f238d94d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bc7d1e1460f4da19f238a1e9e84cb12'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:59.926224 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a7de85e6-4948-4ac9-a9c2-adc8f238d94d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bc7d1e1460f4da19f238a1e9e84cb12'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:59.933601 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a7de85e6-4948-4ac9-a9c2-adc8f238d94d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bc7d1e1460f4da19f238a1e9e84cb12'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:14:59.939847 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1283/2555] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:14:59 2022] DELETE /identity/v3/users/0bc7d1e1460f4da19f238a1e9e84cb12 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:14:59.944680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d44ba-40dd-4147-8b51-29a3a924a26a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:14:59.945323 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d44ba-40dd-4147-8b51-29a3a924a26a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:14:59.945323 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d44ba-40dd-4147-8b51-29a3a924a26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:14:59.963406 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-9f7d44ba-40dd-4147-8b51-29a3a924a26a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:14:59.964656 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9f7d44ba-40dd-4147-8b51-29a3a924a26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:00.034432 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1273/2556] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:15:00.044100 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de85e6-4948-4ac9-a9c2-adc8f238d94d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:00.045612 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a7de85e6-4948-4ac9-a9c2-adc8f238d94d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:00.107002 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de85e6-4948-4ac9-a9c2-adc8f238d94d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:00.110974 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd76f09-7ac1-470f-bcab-ff280f0b2dbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:00.111639 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd76f09-7ac1-470f-bcab-ff280f0b2dbd service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:00.111917 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd76f09-7ac1-470f-bcab-ff280f0b2dbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:00.112221 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd76f09-7ac1-470f-bcab-ff280f0b2dbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:00.122052 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd76f09-7ac1-470f-bcab-ff280f0b2dbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:00.123499 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd76f09-7ac1-470f-bcab-ff280f0b2dbd service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:00.133627 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1284/2557] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:15:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:15:00.422636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d44ba-40dd-4147-8b51-29a3a924a26a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:00.424253 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9f7d44ba-40dd-4147-8b51-29a3a924a26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:00.436880 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d44ba-40dd-4147-8b51-29a3a924a26a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:00.442518 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fe899-b4a2-4439-b598-feceb0e70c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:00.443391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fe899-b4a2-4439-b598-feceb0e70c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:00.443675 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fe899-b4a2-4439-b598-feceb0e70c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:00.443960 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fe899-b4a2-4439-b598-feceb0e70c4c admin admin] PATH_INFO: `/v3/projects/697bb4b14fbc4f619d3e6b3ebfc0f177` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:00.445198 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96fe899-b4a2-4439-b598-feceb0e70c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=697bb4b14fbc4f619d3e6b3ebfc0f177)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:00.447177 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96fe899-b4a2-4439-b598-feceb0e70c4c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:00.498309 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b96fe899-b4a2-4439-b598-feceb0e70c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '697bb4b14fbc4f619d3e6b3ebfc0f177', 'request_id': 'req-b96fe899-b4a2-4439-b598-feceb0e70c4c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:00.505020 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b96fe899-b4a2-4439-b598-feceb0e70c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '697bb4b14fbc4f619d3e6b3ebfc0f177', 'request_id': 'req-b96fe899-b4a2-4439-b598-feceb0e70c4c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:00.512656 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b96fe899-b4a2-4439-b598-feceb0e70c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '697bb4b14fbc4f619d3e6b3ebfc0f177', 'request_id': 'req-b96fe899-b4a2-4439-b598-feceb0e70c4c'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:00.526377 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b96fe899-b4a2-4439-b598-feceb0e70c4c admin admin] The token cache is being invalidate because project 697bb4b14fbc4f619d3e6b3ebfc0f177 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:15:00.526668 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b96fe899-b4a2-4439-b598-feceb0e70c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:00.527338 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b96fe899-b4a2-4439-b598-feceb0e70c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:00.529020 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1274/2558] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:15:00 2022] DELETE /identity/v3/projects/697bb4b14fbc4f619d3e6b3ebfc0f177 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:15:00.533442 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd76f09-7ac1-470f-bcab-ff280f0b2dbd service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:00.543047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd76f09-7ac1-470f-bcab-ff280f0b2dbd service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:00.554994 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:15:00.603839 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce7315-628d-4e80-8dc9-992768a8fcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:00.604744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce7315-628d-4e80-8dc9-992768a8fcb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:00.605029 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce7315-628d-4e80-8dc9-992768a8fcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:00.605300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce7315-628d-4e80-8dc9-992768a8fcb6 admin admin] PATH_INFO: `/v3/users/9147216d8e264d30b60f29c431915ce7` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:00.606476 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce7315-628d-4e80-8dc9-992768a8fcb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9147216d8e264d30b60f29c431915ce7)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:00.608488 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce7315-628d-4e80-8dc9-992768a8fcb6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:00.663756 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f5ce7315-628d-4e80-8dc9-992768a8fcb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9147216d8e264d30b60f29c431915ce7'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:00.676134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f5ce7315-628d-4e80-8dc9-992768a8fcb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9147216d8e264d30b60f29c431915ce7'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:00.676952 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f5ce7315-628d-4e80-8dc9-992768a8fcb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9147216d8e264d30b60f29c431915ce7'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:00.691138 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f5ce7315-628d-4e80-8dc9-992768a8fcb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9147216d8e264d30b60f29c431915ce7'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:00.699562 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-f5ce7315-628d-4e80-8dc9-992768a8fcb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9147216d8e264d30b60f29c431915ce7'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:00.706835 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1285/2559] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:15:00 2022] DELETE /identity/v3/users/9147216d8e264d30b60f29c431915ce7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:15:00.989181 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fe899-b4a2-4439-b598-feceb0e70c4c admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:00.990702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b96fe899-b4a2-4439-b598-feceb0e70c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:01.004984 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fe899-b4a2-4439-b598-feceb0e70c4c admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:01.055592 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:15:01.069553 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df306c-2b37-4ee9-9ce5-af716c11f087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:01.070399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df306c-2b37-4ee9-9ce5-af716c11f087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:01.070672 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df306c-2b37-4ee9-9ce5-af716c11f087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:01.070953 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df306c-2b37-4ee9-9ce5-af716c11f087 admin admin] PATH_INFO: `/v3/projects/1a4005d62dbc4d30ab81fd9215427e97` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:01.072165 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df306c-2b37-4ee9-9ce5-af716c11f087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a4005d62dbc4d30ab81fd9215427e97)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:01.074168 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df306c-2b37-4ee9-9ce5-af716c11f087 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:01.123532 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-76df306c-2b37-4ee9-9ce5-af716c11f087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a4005d62dbc4d30ab81fd9215427e97', 'request_id': 'req-76df306c-2b37-4ee9-9ce5-af716c11f087'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:01.129697 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-76df306c-2b37-4ee9-9ce5-af716c11f087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a4005d62dbc4d30ab81fd9215427e97', 'request_id': 'req-76df306c-2b37-4ee9-9ce5-af716c11f087'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:01.138152 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-76df306c-2b37-4ee9-9ce5-af716c11f087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a4005d62dbc4d30ab81fd9215427e97', 'request_id': 'req-76df306c-2b37-4ee9-9ce5-af716c11f087'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:01.151329 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-76df306c-2b37-4ee9-9ce5-af716c11f087 admin admin] The token cache is being invalidate because project 1a4005d62dbc4d30ab81fd9215427e97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:15:01.151628 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-76df306c-2b37-4ee9-9ce5-af716c11f087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:01.152300 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-76df306c-2b37-4ee9-9ce5-af716c11f087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:01.153894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1275/2560] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:15:00 2022] DELETE /identity/v3/projects/1a4005d62dbc4d30ab81fd9215427e97 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:15:01.159600 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f49f14-9e7b-4a51-88d9-3ef9da91c606 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:01.160099 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f49f14-9e7b-4a51-88d9-3ef9da91c606 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:01.160212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f49f14-9e7b-4a51-88d9-3ef9da91c606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:01.178264 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-d8f49f14-9e7b-4a51-88d9-3ef9da91c606 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:15:01.179469 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d8f49f14-9e7b-4a51-88d9-3ef9da91c606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:01.240110 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1286/2561] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:15:01.248335 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f515b-2833-4f98-9163-139c1664116a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:01.248658 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f515b-2833-4f98-9163-139c1664116a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:01.248940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f515b-2833-4f98-9163-139c1664116a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:01.268692 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-103f515b-2833-4f98-9163-139c1664116a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:15:01.269909 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-103f515b-2833-4f98-9163-139c1664116a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:01.277796 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1276/2562] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:15:01.282791 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f49f14-9e7b-4a51-88d9-3ef9da91c606 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:01.292529 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f49f14-9e7b-4a51-88d9-3ef9da91c606 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:01.299211 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f20d2-0a54-4f81-9834-56a390967fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:01.299905 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f20d2-0a54-4f81-9834-56a390967fab admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:01.300192 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f20d2-0a54-4f81-9834-56a390967fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:01.300510 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f20d2-0a54-4f81-9834-56a390967fab admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:01.301256 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f20d2-0a54-4f81-9834-56a390967fab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:15:01.301566 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f20d2-0a54-4f81-9834-56a390967fab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:01.303217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f20d2-0a54-4f81-9834-56a390967fab admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:01.315851 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1287/2563] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:15:01.320383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f515b-2833-4f98-9163-139c1664116a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:01.330272 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f515b-2833-4f98-9163-139c1664116a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:01.334956 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16dc29-c98c-4188-97d9-b8f1f8fb5a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:01.335615 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16dc29-c98c-4188-97d9-b8f1f8fb5a7d admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:01.335898 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16dc29-c98c-4188-97d9-b8f1f8fb5a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:01.336177 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16dc29-c98c-4188-97d9-b8f1f8fb5a7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:01.336906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16dc29-c98c-4188-97d9-b8f1f8fb5a7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:01.338810 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16dc29-c98c-4188-97d9-b8f1f8fb5a7d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:01.366743 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1277/2564] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:15:01 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:15:01.370997 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f20d2-0a54-4f81-9834-56a390967fab admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:01.381388 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f20d2-0a54-4f81-9834-56a390967fab admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:01.401302 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:15:01.442734 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a5125-6a21-4ae1-b276-3355c5cf230a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:01.443411 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a5125-6a21-4ae1-b276-3355c5cf230a admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:01.443696 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a5125-6a21-4ae1-b276-3355c5cf230a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:01.443975 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a5125-6a21-4ae1-b276-3355c5cf230a admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:01.444713 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a5125-6a21-4ae1-b276-3355c5cf230a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:01.446636 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a5125-6a21-4ae1-b276-3355c5cf230a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:01.468279 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1288/2565] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:15:01 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:15:01.472852 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16dc29-c98c-4188-97d9-b8f1f8fb5a7d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:01.483161 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16dc29-c98c-4188-97d9-b8f1f8fb5a7d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:01.488515 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603bca7-fa4a-432c-8ad9-95ca9b3c7df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:01.489174 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603bca7-fa4a-432c-8ad9-95ca9b3c7df0 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:01.489461 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603bca7-fa4a-432c-8ad9-95ca9b3c7df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:01.489744 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603bca7-fa4a-432c-8ad9-95ca9b3c7df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:01.490473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603bca7-fa4a-432c-8ad9-95ca9b3c7df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:01.492080 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603bca7-fa4a-432c-8ad9-95ca9b3c7df0 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:01.503121 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1278/2566] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:15:01.507577 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a5125-6a21-4ae1-b276-3355c5cf230a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:01.518164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a5125-6a21-4ae1-b276-3355c5cf230a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:01.522888 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3bce9-f8dd-4694-8b94-9e1245ad0c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:01.523540 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3bce9-f8dd-4694-8b94-9e1245ad0c67 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:01.523824 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3bce9-f8dd-4694-8b94-9e1245ad0c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:01.524099 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3bce9-f8dd-4694-8b94-9e1245ad0c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:01.524947 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3bce9-f8dd-4694-8b94-9e1245ad0c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:01.526484 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3bce9-f8dd-4694-8b94-9e1245ad0c67 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:01.536685 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1289/2567] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:15:01.540842 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603bca7-fa4a-432c-8ad9-95ca9b3c7df0 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:01.551742 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603bca7-fa4a-432c-8ad9-95ca9b3c7df0 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:01.558265 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64401424-0b1b-4ed8-8f22-fda6a85c1295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:01.559596 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64401424-0b1b-4ed8-8f22-fda6a85c1295 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:01.560118 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64401424-0b1b-4ed8-8f22-fda6a85c1295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:01.560760 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64401424-0b1b-4ed8-8f22-fda6a85c1295 admin admin] PATH_INFO: `/v3/projects/6a372c4ac79847d99441cfa4f862d57a/users/b327e86b788a4ef8a973e44303649451/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:01.578075 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64401424-0b1b-4ed8-8f22-fda6a85c1295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a372c4ac79847d99441cfa4f862d57a, user_id=b327e86b788a4ef8a973e44303649451, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:01.580736 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64401424-0b1b-4ed8-8f22-fda6a85c1295 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:01.594397 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1279/2568] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:15:01 2022] PUT /identity/v3/projects/6a372c4ac79847d99441cfa4f862d57a/users/b327e86b788a4ef8a973e44303649451/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:15:01.604706 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182d090-5166-45f4-90f1-0402a23d5ca5 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:01.605003 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182d090-5166-45f4-90f1-0402a23d5ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:01.605298 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182d090-5166-45f4-90f1-0402a23d5ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:01.633125 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e182d090-5166-45f4-90f1-0402a23d5ca5 None None] MFA Rules not processed for user `b327e86b788a4ef8a973e44303649451`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:15:01.634362 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e182d090-5166-45f4-90f1-0402a23d5ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:01.703851 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1290/2569] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:15:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:15:01.708480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64401424-0b1b-4ed8-8f22-fda6a85c1295 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:01.780416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64401424-0b1b-4ed8-8f22-fda6a85c1295 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:01.785750 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df245880-204f-4748-af9b-b818fe05cf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:01.786418 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df245880-204f-4748-af9b-b818fe05cf45 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:01.786702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df245880-204f-4748-af9b-b818fe05cf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:01.786979 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df245880-204f-4748-af9b-b818fe05cf45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:01.787684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df245880-204f-4748-af9b-b818fe05cf45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:01.789634 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df245880-204f-4748-af9b-b818fe05cf45 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:01.809598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:15:01.816226 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1280/2570] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:15:01 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:15:01.820987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182d090-5166-45f4-90f1-0402a23d5ca5 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:01.833167 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182d090-5166-45f4-90f1-0402a23d5ca5 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:01.892783 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a83512-d8c8-47a0-9c60-adca072d12f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:01.893464 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a83512-d8c8-47a0-9c60-adca072d12f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:01.893751 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a83512-d8c8-47a0-9c60-adca072d12f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:01.894029 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a83512-d8c8-47a0-9c60-adca072d12f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:01.894726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a83512-d8c8-47a0-9c60-adca072d12f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:01.896682 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a83512-d8c8-47a0-9c60-adca072d12f8 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:01.919173 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1291/2571] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:15:01 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:15:01.923510 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df245880-204f-4748-af9b-b818fe05cf45 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:01.934105 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df245880-204f-4748-af9b-b818fe05cf45 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:01.938979 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34f4a7-829f-49fc-9561-f28ee3ec5bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:01.939640 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34f4a7-829f-49fc-9561-f28ee3ec5bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:01.939923 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34f4a7-829f-49fc-9561-f28ee3ec5bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:01.940198 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34f4a7-829f-49fc-9561-f28ee3ec5bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:01.940967 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34f4a7-829f-49fc-9561-f28ee3ec5bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:01.942567 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34f4a7-829f-49fc-9561-f28ee3ec5bc2 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:01.953005 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1281/2572] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:15:01.957989 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a83512-d8c8-47a0-9c60-adca072d12f8 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:01.968320 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a83512-d8c8-47a0-9c60-adca072d12f8 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:01.976328 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fbd62-1ff0-4152-bf11-22e4792433c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:01.977278 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fbd62-1ff0-4152-bf11-22e4792433c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:01.977559 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fbd62-1ff0-4152-bf11-22e4792433c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:01.977830 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fbd62-1ff0-4152-bf11-22e4792433c6 admin admin] PATH_INFO: `/v3/projects/b6774f19aa5b4700baf43407b11e99b3/users/29cf7e4e01cc49aebe6e0450ecb6052f/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:01.993076 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2fbd62-1ff0-4152-bf11-22e4792433c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6774f19aa5b4700baf43407b11e99b3, user_id=29cf7e4e01cc49aebe6e0450ecb6052f, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:01.995712 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2fbd62-1ff0-4152-bf11-22e4792433c6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:01.998756 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:15:02.012175 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1292/2573] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:15:01 2022] PUT /identity/v3/projects/b6774f19aa5b4700baf43407b11e99b3/users/29cf7e4e01cc49aebe6e0450ecb6052f/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:15:02.016710 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34f4a7-829f-49fc-9561-f28ee3ec5bc2 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:02.028355 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34f4a7-829f-49fc-9561-f28ee3ec5bc2 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:02.090020 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2189ea-771c-4233-bd28-ecea88a5effd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:02.090609 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2189ea-771c-4233-bd28-ecea88a5effd admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:02.090896 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2189ea-771c-4233-bd28-ecea88a5effd admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:02.091177 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2189ea-771c-4233-bd28-ecea88a5effd admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:02.091910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2189ea-771c-4233-bd28-ecea88a5effd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:02.093569 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2189ea-771c-4233-bd28-ecea88a5effd admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:02.105926 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1282/2574] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:15:02.110110 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fbd62-1ff0-4152-bf11-22e4792433c6 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:02.120434 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fbd62-1ff0-4152-bf11-22e4792433c6 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:02.125103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f06a6-91ba-4ca7-bb8e-c9bc1fd5d2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:02.134268 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f06a6-91ba-4ca7-bb8e-c9bc1fd5d2f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:02.134554 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f06a6-91ba-4ca7-bb8e-c9bc1fd5d2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:02.134831 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f06a6-91ba-4ca7-bb8e-c9bc1fd5d2f2 admin admin] PATH_INFO: `/v3/projects/b6774f19aa5b4700baf43407b11e99b3/users/29cf7e4e01cc49aebe6e0450ecb6052f/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:02.137374 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f06a6-91ba-4ca7-bb8e-c9bc1fd5d2f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6774f19aa5b4700baf43407b11e99b3, user_id=29cf7e4e01cc49aebe6e0450ecb6052f, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:02.140048 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f06a6-91ba-4ca7-bb8e-c9bc1fd5d2f2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:02.151798 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1293/2575] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:15:02 2022] PUT /identity/v3/projects/b6774f19aa5b4700baf43407b11e99b3/users/29cf7e4e01cc49aebe6e0450ecb6052f/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:15:02.163705 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05440f-6a56-457a-a4a4-96cb53d57687 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:02.163994 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05440f-6a56-457a-a4a4-96cb53d57687 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:02.164272 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05440f-6a56-457a-a4a4-96cb53d57687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:02.192680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-ab05440f-6a56-457a-a4a4-96cb53d57687 None None] MFA Rules not processed for user `29cf7e4e01cc49aebe6e0450ecb6052f`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:15:02.193911 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ab05440f-6a56-457a-a4a4-96cb53d57687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:02.265556 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1283/2576] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:15:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:15:02.279202 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f06a6-91ba-4ca7-bb8e-c9bc1fd5d2f2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:02.281019 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-707f06a6-91ba-4ca7-bb8e-c9bc1fd5d2f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:02.346609 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f06a6-91ba-4ca7-bb8e-c9bc1fd5d2f2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:02.350386 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155fa33-5c4b-4e02-9491-38ec232be861 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:02.351048 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155fa33-5c4b-4e02-9491-38ec232be861 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:02.351336 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155fa33-5c4b-4e02-9491-38ec232be861 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:02.351618 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155fa33-5c4b-4e02-9491-38ec232be861 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:02.361225 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155fa33-5c4b-4e02-9491-38ec232be861 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:02.362675 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155fa33-5c4b-4e02-9491-38ec232be861 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:02.372612 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1294/2577] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:15:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:15:02.407458 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05440f-6a56-457a-a4a4-96cb53d57687 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:02.471595 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05440f-6a56-457a-a4a4-96cb53d57687 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:02.476109 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78170382-fe14-4088-a2d0-aee6c638745f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:02.477011 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78170382-fe14-4088-a2d0-aee6c638745f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:02.477294 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78170382-fe14-4088-a2d0-aee6c638745f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:02.477570 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78170382-fe14-4088-a2d0-aee6c638745f admin admin] PATH_INFO: `/v3/users/b327e86b788a4ef8a973e44303649451` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:02.478753 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78170382-fe14-4088-a2d0-aee6c638745f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b327e86b788a4ef8a973e44303649451)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:02.480769 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78170382-fe14-4088-a2d0-aee6c638745f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:02.494778 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:15:02.531283 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-78170382-fe14-4088-a2d0-aee6c638745f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b327e86b788a4ef8a973e44303649451'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:02.538941 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-78170382-fe14-4088-a2d0-aee6c638745f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b327e86b788a4ef8a973e44303649451'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:02.552149 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-78170382-fe14-4088-a2d0-aee6c638745f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b327e86b788a4ef8a973e44303649451'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:02.553017 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-78170382-fe14-4088-a2d0-aee6c638745f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b327e86b788a4ef8a973e44303649451'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:02.553696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-78170382-fe14-4088-a2d0-aee6c638745f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b327e86b788a4ef8a973e44303649451'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:02.567077 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1284/2578] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:15:02 2022] DELETE /identity/v3/users/b327e86b788a4ef8a973e44303649451 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:15:02.571613 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abb454-de55-4cf6-9036-5ec3a5f16e78 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:02.571906 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abb454-de55-4cf6-9036-5ec3a5f16e78 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:02.572188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abb454-de55-4cf6-9036-5ec3a5f16e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:02.590026 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-15abb454-de55-4cf6-9036-5ec3a5f16e78 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:15:02.591233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-15abb454-de55-4cf6-9036-5ec3a5f16e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:02.664997 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1295/2579] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:15:02.675289 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78170382-fe14-4088-a2d0-aee6c638745f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:02.676795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-78170382-fe14-4088-a2d0-aee6c638745f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:02.736728 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78170382-fe14-4088-a2d0-aee6c638745f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:02.740445 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5b297-bbd1-4642-9f0d-85d754ffd9da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:02.741100 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5b297-bbd1-4642-9f0d-85d754ffd9da service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:02.741385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5b297-bbd1-4642-9f0d-85d754ffd9da service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:02.741666 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5b297-bbd1-4642-9f0d-85d754ffd9da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:02.750938 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5b297-bbd1-4642-9f0d-85d754ffd9da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:02.752463 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5b297-bbd1-4642-9f0d-85d754ffd9da service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:02.763415 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1285/2580] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:15:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:15:03.043992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abb454-de55-4cf6-9036-5ec3a5f16e78 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:03.045546 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-15abb454-de55-4cf6-9036-5ec3a5f16e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:03.064232 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abb454-de55-4cf6-9036-5ec3a5f16e78 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:03.069277 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d42301-24a5-4cbc-b11e-08d2f4a1fd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:03.070173 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d42301-24a5-4cbc-b11e-08d2f4a1fd1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:03.070452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d42301-24a5-4cbc-b11e-08d2f4a1fd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:03.070731 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d42301-24a5-4cbc-b11e-08d2f4a1fd1b admin admin] PATH_INFO: `/v3/projects/6a372c4ac79847d99441cfa4f862d57a` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:03.071939 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d42301-24a5-4cbc-b11e-08d2f4a1fd1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a372c4ac79847d99441cfa4f862d57a)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:03.073932 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d42301-24a5-4cbc-b11e-08d2f4a1fd1b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:03.132135 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b1d42301-24a5-4cbc-b11e-08d2f4a1fd1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a372c4ac79847d99441cfa4f862d57a', 'request_id': 'req-b1d42301-24a5-4cbc-b11e-08d2f4a1fd1b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:03.140000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b1d42301-24a5-4cbc-b11e-08d2f4a1fd1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a372c4ac79847d99441cfa4f862d57a', 'request_id': 'req-b1d42301-24a5-4cbc-b11e-08d2f4a1fd1b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:03.146055 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b1d42301-24a5-4cbc-b11e-08d2f4a1fd1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a372c4ac79847d99441cfa4f862d57a', 'request_id': 'req-b1d42301-24a5-4cbc-b11e-08d2f4a1fd1b'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:03.157729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b1d42301-24a5-4cbc-b11e-08d2f4a1fd1b admin admin] The token cache is being invalidate because project 6a372c4ac79847d99441cfa4f862d57a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:15:03.158016 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b1d42301-24a5-4cbc-b11e-08d2f4a1fd1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:03.158714 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-b1d42301-24a5-4cbc-b11e-08d2f4a1fd1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:03.160331 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1296/2581] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:15:03 2022] DELETE /identity/v3/projects/6a372c4ac79847d99441cfa4f862d57a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:15:03.164577 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5b297-bbd1-4642-9f0d-85d754ffd9da service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:03.175705 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5b297-bbd1-4642-9f0d-85d754ffd9da service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:03.233544 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec3beb-6d7e-4102-999f-f9d94a187825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:03.234463 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec3beb-6d7e-4102-999f-f9d94a187825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:03.234743 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec3beb-6d7e-4102-999f-f9d94a187825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:03.235669 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec3beb-6d7e-4102-999f-f9d94a187825 admin admin] PATH_INFO: `/v3/users/29cf7e4e01cc49aebe6e0450ecb6052f` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:03.236905 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec3beb-6d7e-4102-999f-f9d94a187825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29cf7e4e01cc49aebe6e0450ecb6052f)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:03.238821 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec3beb-6d7e-4102-999f-f9d94a187825 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:03.275161 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:15:03.287573 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-65ec3beb-6d7e-4102-999f-f9d94a187825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29cf7e4e01cc49aebe6e0450ecb6052f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:03.294964 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-65ec3beb-6d7e-4102-999f-f9d94a187825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29cf7e4e01cc49aebe6e0450ecb6052f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:03.308102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-65ec3beb-6d7e-4102-999f-f9d94a187825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29cf7e4e01cc49aebe6e0450ecb6052f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:03.308876 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-65ec3beb-6d7e-4102-999f-f9d94a187825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29cf7e4e01cc49aebe6e0450ecb6052f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:03.309493 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-65ec3beb-6d7e-4102-999f-f9d94a187825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29cf7e4e01cc49aebe6e0450ecb6052f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:03.322519 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1286/2582] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:15:03 2022] DELETE /identity/v3/users/29cf7e4e01cc49aebe6e0450ecb6052f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:15:03.607640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d42301-24a5-4cbc-b11e-08d2f4a1fd1b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:03.609236 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b1d42301-24a5-4cbc-b11e-08d2f4a1fd1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:03.624047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d42301-24a5-4cbc-b11e-08d2f4a1fd1b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:03.630265 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:15:03.687998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df430f4e-e590-4337-a1c6-d29cdac26151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:03.689027 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df430f4e-e590-4337-a1c6-d29cdac26151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:03.689303 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df430f4e-e590-4337-a1c6-d29cdac26151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:03.689570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df430f4e-e590-4337-a1c6-d29cdac26151 admin admin] PATH_INFO: `/v3/projects/b6774f19aa5b4700baf43407b11e99b3` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:03.690870 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df430f4e-e590-4337-a1c6-d29cdac26151 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6774f19aa5b4700baf43407b11e99b3)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:03.692841 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df430f4e-e590-4337-a1c6-d29cdac26151 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:03.746208 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-df430f4e-e590-4337-a1c6-d29cdac26151 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6774f19aa5b4700baf43407b11e99b3', 'request_id': 'req-df430f4e-e590-4337-a1c6-d29cdac26151'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:03.755225 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-df430f4e-e590-4337-a1c6-d29cdac26151 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6774f19aa5b4700baf43407b11e99b3', 'request_id': 'req-df430f4e-e590-4337-a1c6-d29cdac26151'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:03.761872 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-df430f4e-e590-4337-a1c6-d29cdac26151 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6774f19aa5b4700baf43407b11e99b3', 'request_id': 'req-df430f4e-e590-4337-a1c6-d29cdac26151'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:03.774222 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-df430f4e-e590-4337-a1c6-d29cdac26151 admin admin] The token cache is being invalidate because project b6774f19aa5b4700baf43407b11e99b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:15:03.774511 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-df430f4e-e590-4337-a1c6-d29cdac26151 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:03.775176 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-df430f4e-e590-4337-a1c6-d29cdac26151 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:03.776806 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1297/2583] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:15:03 2022] DELETE /identity/v3/projects/b6774f19aa5b4700baf43407b11e99b3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:15:03.783253 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360cbcd-4cb4-49ee-9bda-daebb4308fff None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:03.783538 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360cbcd-4cb4-49ee-9bda-daebb4308fff None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:03.783812 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360cbcd-4cb4-49ee-9bda-daebb4308fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:03.802260 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-5360cbcd-4cb4-49ee-9bda-daebb4308fff None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:15:03.803498 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5360cbcd-4cb4-49ee-9bda-daebb4308fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:03.869019 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1287/2584] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:15:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:15:03.877282 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bed21-ff35-47ce-9f82-fa9d60371ec7 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:03.877600 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bed21-ff35-47ce-9f82-fa9d60371ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:03.877884 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bed21-ff35-47ce-9f82-fa9d60371ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:03.897529 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-434bed21-ff35-47ce-9f82-fa9d60371ec7 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:15:03.898731 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-434bed21-ff35-47ce-9f82-fa9d60371ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:03.913947 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1298/2585] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:15:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:15:03.918405 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360cbcd-4cb4-49ee-9bda-daebb4308fff None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:03.929582 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360cbcd-4cb4-49ee-9bda-daebb4308fff None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:03.934337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce95d20-7b90-433b-9297-97f196297c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:03.935000 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce95d20-7b90-433b-9297-97f196297c24 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:03.935349 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce95d20-7b90-433b-9297-97f196297c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:03.935760 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce95d20-7b90-433b-9297-97f196297c24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:03.936557 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce95d20-7b90-433b-9297-97f196297c24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:15:03.936869 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce95d20-7b90-433b-9297-97f196297c24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:03.938744 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce95d20-7b90-433b-9297-97f196297c24 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:03.950339 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1288/2586] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:15:03.963144 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bed21-ff35-47ce-9f82-fa9d60371ec7 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:03.973608 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bed21-ff35-47ce-9f82-fa9d60371ec7 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:03.978307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95c4f0-7454-4373-bded-5b8b6f2c8c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:03.978955 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95c4f0-7454-4373-bded-5b8b6f2c8c35 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:03.979357 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95c4f0-7454-4373-bded-5b8b6f2c8c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:03.979630 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95c4f0-7454-4373-bded-5b8b6f2c8c35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:03.980341 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95c4f0-7454-4373-bded-5b8b6f2c8c35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:03.982257 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95c4f0-7454-4373-bded-5b8b6f2c8c35 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:04.008881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1299/2587] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:15:03 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:15:04.013914 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce95d20-7b90-433b-9297-97f196297c24 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:04.024271 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce95d20-7b90-433b-9297-97f196297c24 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:04.083081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd1c79-ac30-497b-9542-d0800112079c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:04.083752 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd1c79-ac30-497b-9542-d0800112079c admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:04.084034 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd1c79-ac30-497b-9542-d0800112079c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:04.084310 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd1c79-ac30-497b-9542-d0800112079c admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:04.085061 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd1c79-ac30-497b-9542-d0800112079c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:04.086966 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd1c79-ac30-497b-9542-d0800112079c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:04.107538 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1289/2588] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:15:04 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:15:04.113140 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95c4f0-7454-4373-bded-5b8b6f2c8c35 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:04.123896 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95c4f0-7454-4373-bded-5b8b6f2c8c35 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:04.128949 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7057a8-a0fd-45e5-9fe3-0a5ff5467c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:04.129611 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7057a8-a0fd-45e5-9fe3-0a5ff5467c92 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:04.129898 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7057a8-a0fd-45e5-9fe3-0a5ff5467c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:04.130176 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7057a8-a0fd-45e5-9fe3-0a5ff5467c92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:04.130904 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7057a8-a0fd-45e5-9fe3-0a5ff5467c92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:04.132544 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7057a8-a0fd-45e5-9fe3-0a5ff5467c92 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:04.143941 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1300/2589] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:15:04.147988 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd1c79-ac30-497b-9542-d0800112079c admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:04.158857 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd1c79-ac30-497b-9542-d0800112079c admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:04.169856 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23f1d2-dab2-4862-b5dd-54d6990f943e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:04.170572 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23f1d2-dab2-4862-b5dd-54d6990f943e admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:04.170860 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23f1d2-dab2-4862-b5dd-54d6990f943e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:04.171140 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23f1d2-dab2-4862-b5dd-54d6990f943e admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:04.171879 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23f1d2-dab2-4862-b5dd-54d6990f943e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:04.174139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23f1d2-dab2-4862-b5dd-54d6990f943e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:04.184929 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1290/2590] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:15:04.189515 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7057a8-a0fd-45e5-9fe3-0a5ff5467c92 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:04.199604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7057a8-a0fd-45e5-9fe3-0a5ff5467c92 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:04.205046 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa127cc-06b3-4c2d-a03c-a5f3874931bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:04.205792 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa127cc-06b3-4c2d-a03c-a5f3874931bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:04.206080 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa127cc-06b3-4c2d-a03c-a5f3874931bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:04.206359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa127cc-06b3-4c2d-a03c-a5f3874931bd admin admin] PATH_INFO: `/v3/projects/28915be2484847499aee3443ac4e3a48/users/e8b83017a15845fdb39da2c392b5583a/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:04.226927 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa127cc-06b3-4c2d-a03c-a5f3874931bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=28915be2484847499aee3443ac4e3a48, user_id=e8b83017a15845fdb39da2c392b5583a, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:04.229656 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa127cc-06b3-4c2d-a03c-a5f3874931bd admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:04.243759 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1301/2591] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:15:04 2022] PUT /identity/v3/projects/28915be2484847499aee3443ac4e3a48/users/e8b83017a15845fdb39da2c392b5583a/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:15:04.254115 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f193ab9-0b1a-432e-ad16-f95c15a0729e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:04.254428 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f193ab9-0b1a-432e-ad16-f95c15a0729e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:04.254736 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f193ab9-0b1a-432e-ad16-f95c15a0729e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:04.290329 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-4f193ab9-0b1a-432e-ad16-f95c15a0729e None None] MFA Rules not processed for user `e8b83017a15845fdb39da2c392b5583a`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:15:04.291558 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4f193ab9-0b1a-432e-ad16-f95c15a0729e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:04.296733 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:15:04.360215 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1291/2592] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:15:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:15:04.373056 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa127cc-06b3-4c2d-a03c-a5f3874931bd admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:04.374828 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-5fa127cc-06b3-4c2d-a03c-a5f3874931bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:04.415968 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:15:04.436110 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa127cc-06b3-4c2d-a03c-a5f3874931bd admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:04.440137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea802a9b-17fe-4135-8c5e-04fcd0ed611f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf64f4ec145742d78eee6c4a447515dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:04.440752 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea802a9b-17fe-4135-8c5e-04fcd0ed611f service glance] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:04.441035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea802a9b-17fe-4135-8c5e-04fcd0ed611f service glance] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:04.441305 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea802a9b-17fe-4135-8c5e-04fcd0ed611f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:04.449606 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea802a9b-17fe-4135-8c5e-04fcd0ed611f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:04.452981 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea802a9b-17fe-4135-8c5e-04fcd0ed611f service glance] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:04.462769 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1302/2593] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:15:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:15:14.357322 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=24 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:15:14.458823 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=10 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:15:32.740866 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f193ab9-0b1a-432e-ad16-f95c15a0729e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:32.742438 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4f193ab9-0b1a-432e-ad16-f95c15a0729e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:32.832538 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f193ab9-0b1a-432e-ad16-f95c15a0729e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:32.838271 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf92989-fb2a-4c11-9dcd-775a5920fade service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1004beeeaed4af4a92c89ad31008b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:32.839051 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf92989-fb2a-4c11-9dcd-775a5920fade service placement] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:32.839426 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf92989-fb2a-4c11-9dcd-775a5920fade service placement] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:32.839713 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf92989-fb2a-4c11-9dcd-775a5920fade service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:32.841745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7cf92989-fb2a-4c11-9dcd-775a5920fade service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:32.859293 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf92989-fb2a-4c11-9dcd-775a5920fade service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:32.861836 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf92989-fb2a-4c11-9dcd-775a5920fade service placement] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:32.874848 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1292/2594] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:15:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:15:33.637077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea802a9b-17fe-4135-8c5e-04fcd0ed611f service glance] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:33.718256 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea802a9b-17fe-4135-8c5e-04fcd0ed611f service glance] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:33.724211 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bb85e-aaaf-40b8-8b48-94ab75da967b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:33.725143 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bb85e-aaaf-40b8-8b48-94ab75da967b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:33.725428 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bb85e-aaaf-40b8-8b48-94ab75da967b admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:33.725708 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bb85e-aaaf-40b8-8b48-94ab75da967b admin admin] PATH_INFO: `/v3/users/e8b83017a15845fdb39da2c392b5583a` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:33.726942 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bb85e-aaaf-40b8-8b48-94ab75da967b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8b83017a15845fdb39da2c392b5583a)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:33.728940 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bb85e-aaaf-40b8-8b48-94ab75da967b admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:33.784745 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8c8bb85e-aaaf-40b8-8b48-94ab75da967b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8b83017a15845fdb39da2c392b5583a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:33.791704 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8c8bb85e-aaaf-40b8-8b48-94ab75da967b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8b83017a15845fdb39da2c392b5583a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:33.792384 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8c8bb85e-aaaf-40b8-8b48-94ab75da967b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8b83017a15845fdb39da2c392b5583a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:33.804904 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8c8bb85e-aaaf-40b8-8b48-94ab75da967b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8b83017a15845fdb39da2c392b5583a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:33.813553 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8c8bb85e-aaaf-40b8-8b48-94ab75da967b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8b83017a15845fdb39da2c392b5583a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:33.821635 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1303/2595] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:15:33 2022] DELETE /identity/v3/users/e8b83017a15845fdb39da2c392b5583a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:15:33.826290 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29fe87-567d-4bf9-a1c6-f1fb43cb997d None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:33.826783 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29fe87-567d-4bf9-a1c6-f1fb43cb997d None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:33.826904 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29fe87-567d-4bf9-a1c6-f1fb43cb997d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:33.846176 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-ca29fe87-567d-4bf9-a1c6-f1fb43cb997d None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:15:33.847402 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ca29fe87-567d-4bf9-a1c6-f1fb43cb997d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:33.911468 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1293/2596] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:15:33.921209 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bb85e-aaaf-40b8-8b48-94ab75da967b admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:33.922736 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8c8bb85e-aaaf-40b8-8b48-94ab75da967b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:33.982928 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bb85e-aaaf-40b8-8b48-94ab75da967b admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:33.986888 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440af86-e498-4c19-a62a-b0eb1d9dfb3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:33.987567 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440af86-e498-4c19-a62a-b0eb1d9dfb3e service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:33.987856 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440af86-e498-4c19-a62a-b0eb1d9dfb3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:33.988134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440af86-e498-4c19-a62a-b0eb1d9dfb3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:33.997214 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440af86-e498-4c19-a62a-b0eb1d9dfb3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:33.998663 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440af86-e498-4c19-a62a-b0eb1d9dfb3e service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:34.008883 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1304/2597] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:15:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:15:34.293277 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29fe87-567d-4bf9-a1c6-f1fb43cb997d None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:34.294759 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ca29fe87-567d-4bf9-a1c6-f1fb43cb997d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:34.308306 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29fe87-567d-4bf9-a1c6-f1fb43cb997d None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:34.313102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854ab4a-89a0-4e94-8095-4625b887ec52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:34.314186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854ab4a-89a0-4e94-8095-4625b887ec52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:34.315036 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854ab4a-89a0-4e94-8095-4625b887ec52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:34.315390 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854ab4a-89a0-4e94-8095-4625b887ec52 admin admin] PATH_INFO: `/v3/projects/28915be2484847499aee3443ac4e3a48` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:34.316750 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854ab4a-89a0-4e94-8095-4625b887ec52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28915be2484847499aee3443ac4e3a48)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:34.319048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854ab4a-89a0-4e94-8095-4625b887ec52 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:34.372331 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b854ab4a-89a0-4e94-8095-4625b887ec52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28915be2484847499aee3443ac4e3a48', 'request_id': 'req-b854ab4a-89a0-4e94-8095-4625b887ec52'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:34.379858 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b854ab4a-89a0-4e94-8095-4625b887ec52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28915be2484847499aee3443ac4e3a48', 'request_id': 'req-b854ab4a-89a0-4e94-8095-4625b887ec52'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:34.389050 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b854ab4a-89a0-4e94-8095-4625b887ec52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28915be2484847499aee3443ac4e3a48', 'request_id': 'req-b854ab4a-89a0-4e94-8095-4625b887ec52'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:34.399837 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b854ab4a-89a0-4e94-8095-4625b887ec52 admin admin] The token cache is being invalidate because project 28915be2484847499aee3443ac4e3a48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:15:34.400127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b854ab4a-89a0-4e94-8095-4625b887ec52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:34.400783 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b854ab4a-89a0-4e94-8095-4625b887ec52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:34.402395 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1294/2598] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:15:34 2022] DELETE /identity/v3/projects/28915be2484847499aee3443ac4e3a48 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:15:34.408702 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd68785-fb7b-499e-9f42-6f2520a5a8af None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:34.409003 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd68785-fb7b-499e-9f42-6f2520a5a8af None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:34.409280 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd68785-fb7b-499e-9f42-6f2520a5a8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:34.427211 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-4cd68785-fb7b-499e-9f42-6f2520a5a8af None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:15:34.428480 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-4cd68785-fb7b-499e-9f42-6f2520a5a8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:34.446823 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:15:34.493538 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1305/2599] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:15:34.501318 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344d8d6-2412-41dd-8b7b-d3c181d86718 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:34.501613 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344d8d6-2412-41dd-8b7b-d3c181d86718 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:34.502379 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344d8d6-2412-41dd-8b7b-d3c181d86718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:34.522705 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b344d8d6-2412-41dd-8b7b-d3c181d86718 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:15:34.524055 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b344d8d6-2412-41dd-8b7b-d3c181d86718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:34.532587 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1295/2600] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:15:34.537959 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd68785-fb7b-499e-9f42-6f2520a5a8af None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:34.549278 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd68785-fb7b-499e-9f42-6f2520a5a8af None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:34.557389 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426e3e2-9cd4-439f-bce9-2f066f6d7b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:34.558109 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426e3e2-9cd4-439f-bce9-2f066f6d7b36 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:34.558542 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426e3e2-9cd4-439f-bce9-2f066f6d7b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:34.558727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426e3e2-9cd4-439f-bce9-2f066f6d7b36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:34.559397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426e3e2-9cd4-439f-bce9-2f066f6d7b36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:15:34.559705 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426e3e2-9cd4-439f-bce9-2f066f6d7b36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:34.561464 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426e3e2-9cd4-439f-bce9-2f066f6d7b36 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:34.575070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1306/2601] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:15:34.579596 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344d8d6-2412-41dd-8b7b-d3c181d86718 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:34.594249 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344d8d6-2412-41dd-8b7b-d3c181d86718 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:34.599687 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe861a65-3d57-4d40-bc73-02c78da7bd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:34.600303 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe861a65-3d57-4d40-bc73-02c78da7bd53 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:34.600713 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe861a65-3d57-4d40-bc73-02c78da7bd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:34.600925 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe861a65-3d57-4d40-bc73-02c78da7bd53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:34.601624 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe861a65-3d57-4d40-bc73-02c78da7bd53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:34.603533 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe861a65-3d57-4d40-bc73-02c78da7bd53 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:34.607577 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:15:34.640493 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1296/2602] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:15:34 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:15:34.642975 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426e3e2-9cd4-439f-bce9-2f066f6d7b36 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:34.661239 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426e3e2-9cd4-439f-bce9-2f066f6d7b36 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:34.750081 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54188b6f-c3b7-41cc-a425-a441678573c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:34.750963 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54188b6f-c3b7-41cc-a425-a441678573c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:34.752394 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54188b6f-c3b7-41cc-a425-a441678573c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:34.752929 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54188b6f-c3b7-41cc-a425-a441678573c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:34.754230 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54188b6f-c3b7-41cc-a425-a441678573c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:34.758235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54188b6f-c3b7-41cc-a425-a441678573c2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:34.793280 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1307/2603] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:15:34 2022] POST /identity/v3/users => generated 287 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:15:34.797424 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe861a65-3d57-4d40-bc73-02c78da7bd53 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:34.808502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe861a65-3d57-4d40-bc73-02c78da7bd53 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:34.813626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994329d-a16a-497b-b3bd-e765d2f13ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:34.814498 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994329d-a16a-497b-b3bd-e765d2f13ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:34.814846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994329d-a16a-497b-b3bd-e765d2f13ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:34.815212 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994329d-a16a-497b-b3bd-e765d2f13ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:34.816025 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994329d-a16a-497b-b3bd-e765d2f13ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:34.817956 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994329d-a16a-497b-b3bd-e765d2f13ac7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:34.830603 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1297/2604] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:15:34.834823 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54188b6f-c3b7-41cc-a425-a441678573c2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:34.846480 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54188b6f-c3b7-41cc-a425-a441678573c2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:34.851577 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb8ba4-0e33-4800-a7fc-74b0affe4207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:34.852482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb8ba4-0e33-4800-a7fc-74b0affe4207 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:34.852732 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb8ba4-0e33-4800-a7fc-74b0affe4207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:34.853012 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb8ba4-0e33-4800-a7fc-74b0affe4207 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:34.853756 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb8ba4-0e33-4800-a7fc-74b0affe4207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:34.855376 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb8ba4-0e33-4800-a7fc-74b0affe4207 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:34.869874 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1308/2605] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:15:34.870735 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994329d-a16a-497b-b3bd-e765d2f13ac7 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:34.880969 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994329d-a16a-497b-b3bd-e765d2f13ac7 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:34.885910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f009060-e0a8-47d5-a805-b35b1b28008a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:34.886814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f009060-e0a8-47d5-a805-b35b1b28008a admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:34.887097 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f009060-e0a8-47d5-a805-b35b1b28008a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:34.887374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f009060-e0a8-47d5-a805-b35b1b28008a admin admin] PATH_INFO: `/v3/projects/afc11aad09624b1a9cce76a9501960d2/users/0247c501a7894b279e3ca8f471df6429/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:34.905251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f009060-e0a8-47d5-a805-b35b1b28008a admin admin] RBAC: Authorizing `identity:create_grant(project_id=afc11aad09624b1a9cce76a9501960d2, user_id=0247c501a7894b279e3ca8f471df6429, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:34.907434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f009060-e0a8-47d5-a805-b35b1b28008a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:34.923872 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1298/2606] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:15:34 2022] PUT /identity/v3/projects/afc11aad09624b1a9cce76a9501960d2/users/0247c501a7894b279e3ca8f471df6429/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:15:34.929460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac10a1-71c7-4d30-8282-ff481a4b8f3e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:34.929757 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac10a1-71c7-4d30-8282-ff481a4b8f3e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:34.930039 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac10a1-71c7-4d30-8282-ff481a4b8f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:34.952891 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-b7ac10a1-71c7-4d30-8282-ff481a4b8f3e None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:15:34.954165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-b7ac10a1-71c7-4d30-8282-ff481a4b8f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:35.036058 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1309/2607] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:15:35.045739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f009060-e0a8-47d5-a805-b35b1b28008a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:35.047566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3f009060-e0a8-47d5-a805-b35b1b28008a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:35.115564 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f009060-e0a8-47d5-a805-b35b1b28008a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:35.119256 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf758ed-5ff5-4e29-8da6-69bd22a9f17a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:35.119920 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf758ed-5ff5-4e29-8da6-69bd22a9f17a service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:35.120200 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf758ed-5ff5-4e29-8da6-69bd22a9f17a service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:35.120499 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf758ed-5ff5-4e29-8da6-69bd22a9f17a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:35.130399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf758ed-5ff5-4e29-8da6-69bd22a9f17a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:35.132332 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf758ed-5ff5-4e29-8da6-69bd22a9f17a service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:35.143290 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1299/2608] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:15:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:15:37.833765 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac10a1-71c7-4d30-8282-ff481a4b8f3e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:37.851362 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac10a1-71c7-4d30-8282-ff481a4b8f3e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:37.859681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129e673-fb88-43e8-b123-70502273bb2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:37.860387 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129e673-fb88-43e8-b123-70502273bb2d service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:37.861247 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129e673-fb88-43e8-b123-70502273bb2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:37.861705 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129e673-fb88-43e8-b123-70502273bb2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:37.864254 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f129e673-fb88-43e8-b123-70502273bb2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:37.881641 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f129e673-fb88-43e8-b123-70502273bb2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:37.883098 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f129e673-fb88-43e8-b123-70502273bb2d service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:37.896491 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1310/2609] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:15:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:15:41.185096 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186bccc-2955-4344-b0a6-96c5d65a5c6f None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:41.185791 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186bccc-2955-4344-b0a6-96c5d65a5c6f None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:41.188703 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186bccc-2955-4344-b0a6-96c5d65a5c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:41.230280 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a186bccc-2955-4344-b0a6-96c5d65a5c6f None None] MFA Rules not processed for user `0247c501a7894b279e3ca8f471df6429`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:15:41.231589 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a186bccc-2955-4344-b0a6-96c5d65a5c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:41.326413 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1300/2610] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:15:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:15:41.331217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129e673-fb88-43e8-b123-70502273bb2d service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:41.341935 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129e673-fb88-43e8-b123-70502273bb2d service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:41.354147 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809aca4c-76c9-4d27-b4e3-f7db8685df16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:41.355285 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809aca4c-76c9-4d27-b4e3-f7db8685df16 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:41.355759 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809aca4c-76c9-4d27-b4e3-f7db8685df16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:41.356296 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809aca4c-76c9-4d27-b4e3-f7db8685df16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:41.357810 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809aca4c-76c9-4d27-b4e3-f7db8685df16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:41.362045 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809aca4c-76c9-4d27-b4e3-f7db8685df16 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:41.407099 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:15:41.430050 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1311/2611] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:15:41 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:15:41.435426 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186bccc-2955-4344-b0a6-96c5d65a5c6f None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:41.447559 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186bccc-2955-4344-b0a6-96c5d65a5c6f None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:41.499978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:15:41.523002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a36b8e-ba82-4b8e-853b-e987e4cf6920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:41.523796 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a36b8e-ba82-4b8e-853b-e987e4cf6920 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:41.524592 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a36b8e-ba82-4b8e-853b-e987e4cf6920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:41.524592 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a36b8e-ba82-4b8e-853b-e987e4cf6920 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:41.525243 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a36b8e-ba82-4b8e-853b-e987e4cf6920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:41.528501 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a36b8e-ba82-4b8e-853b-e987e4cf6920 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:41.553922 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1301/2612] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:15:41 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:15:41.556891 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809aca4c-76c9-4d27-b4e3-f7db8685df16 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:41.570998 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809aca4c-76c9-4d27-b4e3-f7db8685df16 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:41.577167 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9579f-1984-4b19-922f-909009b8c47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:41.577471 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9579f-1984-4b19-922f-909009b8c47a admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:41.578213 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9579f-1984-4b19-922f-909009b8c47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:41.578213 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9579f-1984-4b19-922f-909009b8c47a admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:41.578810 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9579f-1984-4b19-922f-909009b8c47a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:41.582079 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9579f-1984-4b19-922f-909009b8c47a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:41.595069 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1312/2613] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:15:41.599377 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a36b8e-ba82-4b8e-853b-e987e4cf6920 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:41.612968 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a36b8e-ba82-4b8e-853b-e987e4cf6920 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:41.618627 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ab9e8-28f9-4672-869c-24d7b437596b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:41.619735 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ab9e8-28f9-4672-869c-24d7b437596b admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:41.620275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ab9e8-28f9-4672-869c-24d7b437596b admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:41.620689 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ab9e8-28f9-4672-869c-24d7b437596b admin admin] PATH_INFO: `/v3/projects/d78cb4d39cf14b66a0d7d043eb8e26b2/users/8ff9389a3aee4188934db3e9f5259dec/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:41.639847 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ab9e8-28f9-4672-869c-24d7b437596b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d78cb4d39cf14b66a0d7d043eb8e26b2, user_id=8ff9389a3aee4188934db3e9f5259dec, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:41.643010 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ab9e8-28f9-4672-869c-24d7b437596b admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:41.661308 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1302/2614] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:15:41 2022] PUT /identity/v3/projects/d78cb4d39cf14b66a0d7d043eb8e26b2/users/8ff9389a3aee4188934db3e9f5259dec/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:15:41.665730 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9579f-1984-4b19-922f-909009b8c47a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:41.678053 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9579f-1984-4b19-922f-909009b8c47a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:41.762691 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28223210-c132-43f3-9dc3-a44ac03c31f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:41.763521 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28223210-c132-43f3-9dc3-a44ac03c31f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:41.763992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28223210-c132-43f3-9dc3-a44ac03c31f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:41.764274 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28223210-c132-43f3-9dc3-a44ac03c31f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:41.765151 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28223210-c132-43f3-9dc3-a44ac03c31f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:41.767020 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28223210-c132-43f3-9dc3-a44ac03c31f9 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:41.780450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1313/2615] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:15:41.783632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ab9e8-28f9-4672-869c-24d7b437596b admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:41.796287 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ab9e8-28f9-4672-869c-24d7b437596b admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:41.802602 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3df53-f3c6-4f51-8d29-62625ca0c804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:41.804068 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3df53-f3c6-4f51-8d29-62625ca0c804 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:41.804805 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3df53-f3c6-4f51-8d29-62625ca0c804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:41.805262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3df53-f3c6-4f51-8d29-62625ca0c804 admin admin] PATH_INFO: `/v3/projects/d78cb4d39cf14b66a0d7d043eb8e26b2/users/8ff9389a3aee4188934db3e9f5259dec/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:41.807601 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3df53-f3c6-4f51-8d29-62625ca0c804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d78cb4d39cf14b66a0d7d043eb8e26b2, user_id=8ff9389a3aee4188934db3e9f5259dec, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:41.810370 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3df53-f3c6-4f51-8d29-62625ca0c804 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:41.826204 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1303/2616] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:15:41 2022] PUT /identity/v3/projects/d78cb4d39cf14b66a0d7d043eb8e26b2/users/8ff9389a3aee4188934db3e9f5259dec/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:15:42.985062 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28223210-c132-43f3-9dc3-a44ac03c31f9 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:42.987559 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-28223210-c132-43f3-9dc3-a44ac03c31f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:43.001237 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28223210-c132-43f3-9dc3-a44ac03c31f9 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:43.081243 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc5c49-3f14-46f0-b3e4-4d52fc20f3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:43.082248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc5c49-3f14-46f0-b3e4-4d52fc20f3a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:43.082694 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc5c49-3f14-46f0-b3e4-4d52fc20f3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:43.083045 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc5c49-3f14-46f0-b3e4-4d52fc20f3a7 admin admin] PATH_INFO: `/v3/users/d20d381f9231454cb27a575538d652ad` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:43.084720 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc5c49-3f14-46f0-b3e4-4d52fc20f3a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d20d381f9231454cb27a575538d652ad)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:43.086599 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc5c49-3f14-46f0-b3e4-4d52fc20f3a7 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:43.157589 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5dcc5c49-3f14-46f0-b3e4-4d52fc20f3a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd20d381f9231454cb27a575538d652ad'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:43.172337 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5dcc5c49-3f14-46f0-b3e4-4d52fc20f3a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd20d381f9231454cb27a575538d652ad'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:43.173443 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5dcc5c49-3f14-46f0-b3e4-4d52fc20f3a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd20d381f9231454cb27a575538d652ad'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:43.189179 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5dcc5c49-3f14-46f0-b3e4-4d52fc20f3a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd20d381f9231454cb27a575538d652ad'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:43.209178 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5dcc5c49-3f14-46f0-b3e4-4d52fc20f3a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd20d381f9231454cb27a575538d652ad'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:43.211127 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:15:43.224996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1314/2617] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:15:42 2022] DELETE /identity/v3/users/d20d381f9231454cb27a575538d652ad => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:15:43.499273 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3df53-f3c6-4f51-8d29-62625ca0c804 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:43.501248 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-20b3df53-f3c6-4f51-8d29-62625ca0c804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:43.524315 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3df53-f3c6-4f51-8d29-62625ca0c804 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:43.605145 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2a1f3-d580-449c-81cf-50e5ddb64a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:43.606048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2a1f3-d580-449c-81cf-50e5ddb64a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:43.607161 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2a1f3-d580-449c-81cf-50e5ddb64a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:43.607161 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2a1f3-d580-449c-81cf-50e5ddb64a57 admin admin] PATH_INFO: `/v3/projects/3c2c716a7fad467f91f34b3ffd9d6a7c` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:43.608047 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2a1f3-d580-449c-81cf-50e5ddb64a57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c2c716a7fad467f91f34b3ffd9d6a7c)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:43.611267 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2a1f3-d580-449c-81cf-50e5ddb64a57 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:43.693228 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a1f2a1f3-d580-449c-81cf-50e5ddb64a57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c2c716a7fad467f91f34b3ffd9d6a7c', 'request_id': 'req-a1f2a1f3-d580-449c-81cf-50e5ddb64a57'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:43.724036 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a1f2a1f3-d580-449c-81cf-50e5ddb64a57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c2c716a7fad467f91f34b3ffd9d6a7c', 'request_id': 'req-a1f2a1f3-d580-449c-81cf-50e5ddb64a57'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:43.746944 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a1f2a1f3-d580-449c-81cf-50e5ddb64a57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c2c716a7fad467f91f34b3ffd9d6a7c', 'request_id': 'req-a1f2a1f3-d580-449c-81cf-50e5ddb64a57'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:43.768269 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a1f2a1f3-d580-449c-81cf-50e5ddb64a57 admin admin] The token cache is being invalidate because project 3c2c716a7fad467f91f34b3ffd9d6a7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:15:43.769106 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a1f2a1f3-d580-449c-81cf-50e5ddb64a57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:43.770110 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a1f2a1f3-d580-449c-81cf-50e5ddb64a57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:15:43.772967 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1304/2618] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:15:43 2022] DELETE /identity/v3/projects/3c2c716a7fad467f91f34b3ffd9d6a7c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:15:43.780883 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99336c-5379-4dbc-8dfb-c9416e659a9d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:43.781314 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99336c-5379-4dbc-8dfb-c9416e659a9d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:43.781622 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99336c-5379-4dbc-8dfb-c9416e659a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:43.802992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-bc99336c-5379-4dbc-8dfb-c9416e659a9d None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:15:43.804377 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-bc99336c-5379-4dbc-8dfb-c9416e659a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:43.904459 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1315/2619] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:15:43.910734 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63955f-9bdb-4a75-92d5-ec173e13c39a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:43.911114 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63955f-9bdb-4a75-92d5-ec173e13c39a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:43.911468 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63955f-9bdb-4a75-92d5-ec173e13c39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:43.932296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-7a63955f-9bdb-4a75-92d5-ec173e13c39a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:15:43.934288 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7a63955f-9bdb-4a75-92d5-ec173e13c39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:43.950012 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1305/2620] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:15:43.951178 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99336c-5379-4dbc-8dfb-c9416e659a9d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:43.964230 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99336c-5379-4dbc-8dfb-c9416e659a9d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:43.970532 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800a566-d01b-4060-9aee-8823daa7aacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:43.971756 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800a566-d01b-4060-9aee-8823daa7aacf admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:43.972178 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800a566-d01b-4060-9aee-8823daa7aacf admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:43.972594 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800a566-d01b-4060-9aee-8823daa7aacf admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:43.973435 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800a566-d01b-4060-9aee-8823daa7aacf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:15:43.973859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800a566-d01b-4060-9aee-8823daa7aacf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:43.975592 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800a566-d01b-4060-9aee-8823daa7aacf admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:43.993204 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1316/2621] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:15:43.994680 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63955f-9bdb-4a75-92d5-ec173e13c39a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:44.006631 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63955f-9bdb-4a75-92d5-ec173e13c39a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:44.013844 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdcd9f-5b9e-4a2a-beba-98d9d3a91ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:44.014623 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdcd9f-5b9e-4a2a-beba-98d9d3a91ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:44.014980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdcd9f-5b9e-4a2a-beba-98d9d3a91ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:44.015605 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdcd9f-5b9e-4a2a-beba-98d9d3a91ad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:44.016105 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffdcd9f-5b9e-4a2a-beba-98d9d3a91ad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:44.019091 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffdcd9f-5b9e-4a2a-beba-98d9d3a91ad6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:44.037305 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:15:44.056090 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1306/2622] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:15:43 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:15:44.062594 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800a566-d01b-4060-9aee-8823daa7aacf admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:44.074612 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800a566-d01b-4060-9aee-8823daa7aacf admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:44.148593 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbcfd7-e439-492e-b08a-bc04fdb008ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:44.149453 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbcfd7-e439-492e-b08a-bc04fdb008ea admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:44.150347 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbcfd7-e439-492e-b08a-bc04fdb008ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:44.150918 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbcfd7-e439-492e-b08a-bc04fdb008ea admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:44.151788 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddbcfd7-e439-492e-b08a-bc04fdb008ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:44.154289 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddbcfd7-e439-492e-b08a-bc04fdb008ea admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:44.188372 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1317/2623] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:15:44 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:15:44.189674 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdcd9f-5b9e-4a2a-beba-98d9d3a91ad6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:44.210003 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdcd9f-5b9e-4a2a-beba-98d9d3a91ad6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:44.218856 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3313af-e2b6-4d4b-b949-3e809abec083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:44.219678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3313af-e2b6-4d4b-b949-3e809abec083 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:44.220438 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3313af-e2b6-4d4b-b949-3e809abec083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:44.221417 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3313af-e2b6-4d4b-b949-3e809abec083 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:44.222416 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3313af-e2b6-4d4b-b949-3e809abec083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:44.224235 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3313af-e2b6-4d4b-b949-3e809abec083 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:44.241140 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1307/2624] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:15:44.243024 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbcfd7-e439-492e-b08a-bc04fdb008ea admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:44.255494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbcfd7-e439-492e-b08a-bc04fdb008ea admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:44.264458 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3621d5c-971e-4a61-8f87-78812ab66f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:44.264458 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3621d5c-971e-4a61-8f87-78812ab66f6c admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:44.264912 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3621d5c-971e-4a61-8f87-78812ab66f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:44.265077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3621d5c-971e-4a61-8f87-78812ab66f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:44.266099 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3621d5c-971e-4a61-8f87-78812ab66f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:44.268150 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3621d5c-971e-4a61-8f87-78812ab66f6c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:44.284858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1318/2625] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:15:44.287492 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3313af-e2b6-4d4b-b949-3e809abec083 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:44.299485 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3313af-e2b6-4d4b-b949-3e809abec083 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:44.330893 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1411d4-c0e2-4901-9e45-8faccfdd48cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:44.332011 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1411d4-c0e2-4901-9e45-8faccfdd48cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:44.332392 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1411d4-c0e2-4901-9e45-8faccfdd48cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:44.332826 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1411d4-c0e2-4901-9e45-8faccfdd48cc admin admin] PATH_INFO: `/v3/projects/51a40e8d389f4ab8a90e76ac437f310b/users/d8c5fdfdd1724740b1e83ca49a54cfe6/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:44.395504 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1411d4-c0e2-4901-9e45-8faccfdd48cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=51a40e8d389f4ab8a90e76ac437f310b, user_id=d8c5fdfdd1724740b1e83ca49a54cfe6, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:44.398400 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1411d4-c0e2-4901-9e45-8faccfdd48cc admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:44.433797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1308/2626] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:15:44 2022] PUT /identity/v3/projects/51a40e8d389f4ab8a90e76ac437f310b/users/d8c5fdfdd1724740b1e83ca49a54cfe6/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:15:44.446821 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e686d5-fb45-4713-8d5c-4c7e09294737 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:44.446821 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e686d5-fb45-4713-8d5c-4c7e09294737 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:44.447058 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e686d5-fb45-4713-8d5c-4c7e09294737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:44.511954 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-29e686d5-fb45-4713-8d5c-4c7e09294737 None None] MFA Rules not processed for user `d8c5fdfdd1724740b1e83ca49a54cfe6`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:15:44.514989 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-29e686d5-fb45-4713-8d5c-4c7e09294737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:44.640992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:15:44.658557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1319/2627] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:15:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:15:44.663119 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1411d4-c0e2-4901-9e45-8faccfdd48cc admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:44.764861 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1411d4-c0e2-4901-9e45-8faccfdd48cc admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:44.771135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b595cc-e71b-4bc7-89ec-5d0081bc4f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:44.771720 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b595cc-e71b-4bc7-89ec-5d0081bc4f00 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:44.772067 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b595cc-e71b-4bc7-89ec-5d0081bc4f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:44.772392 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b595cc-e71b-4bc7-89ec-5d0081bc4f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:44.773264 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b595cc-e71b-4bc7-89ec-5d0081bc4f00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:44.775159 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b595cc-e71b-4bc7-89ec-5d0081bc4f00 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:44.840894 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1309/2628] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:15:44 2022] POST /identity/v3/projects => generated 375 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:15:44.845074 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e686d5-fb45-4713-8d5c-4c7e09294737 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:44.858006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e686d5-fb45-4713-8d5c-4c7e09294737 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:44.998516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6e3e9-eae0-4ba2-b3cf-4dee28257398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:44.999650 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6e3e9-eae0-4ba2-b3cf-4dee28257398 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:45.000820 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6e3e9-eae0-4ba2-b3cf-4dee28257398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:45.001165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6e3e9-eae0-4ba2-b3cf-4dee28257398 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:45.001888 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6e3e9-eae0-4ba2-b3cf-4dee28257398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:45.005444 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6e3e9-eae0-4ba2-b3cf-4dee28257398 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:45.042849 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1320/2629] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:15:44 2022] POST /identity/v3/users => generated 294 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:15:45.049523 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b595cc-e71b-4bc7-89ec-5d0081bc4f00 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:45.071555 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b595cc-e71b-4bc7-89ec-5d0081bc4f00 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:45.102027 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9562b7-c15e-4cd7-b3aa-3752c844cca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:45.103034 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9562b7-c15e-4cd7-b3aa-3752c844cca2 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:45.103497 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9562b7-c15e-4cd7-b3aa-3752c844cca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:45.104226 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9562b7-c15e-4cd7-b3aa-3752c844cca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:45.105151 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9562b7-c15e-4cd7-b3aa-3752c844cca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:45.108131 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9562b7-c15e-4cd7-b3aa-3752c844cca2 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:45.129812 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1310/2630] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:15:45.134250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6e3e9-eae0-4ba2-b3cf-4dee28257398 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:45.153733 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6e3e9-eae0-4ba2-b3cf-4dee28257398 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:45.164677 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21f78a-df5f-41e0-b9cf-9982af904b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:45.165643 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21f78a-df5f-41e0-b9cf-9982af904b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:45.165932 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21f78a-df5f-41e0-b9cf-9982af904b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:45.166211 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21f78a-df5f-41e0-b9cf-9982af904b35 admin admin] PATH_INFO: `/v3/projects/e6866a44d1a44e85a5cba3b741e7d267/users/3e0f73850d2f427ea50ad6c1448888f3/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:45.185221 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21f78a-df5f-41e0-b9cf-9982af904b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6866a44d1a44e85a5cba3b741e7d267, user_id=3e0f73850d2f427ea50ad6c1448888f3, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:45.192467 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21f78a-df5f-41e0-b9cf-9982af904b35 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:45.228528 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1321/2631] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:15:45 2022] PUT /identity/v3/projects/e6866a44d1a44e85a5cba3b741e7d267/users/3e0f73850d2f427ea50ad6c1448888f3/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:15:45.230144 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9562b7-c15e-4cd7-b3aa-3752c844cca2 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:45.244251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9562b7-c15e-4cd7-b3aa-3752c844cca2 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:45.330181 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a7783-5ad8-4bf1-af69-5aba70946a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:45.331034 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a7783-5ad8-4bf1-af69-5aba70946a54 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:45.331323 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a7783-5ad8-4bf1-af69-5aba70946a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:45.331605 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a7783-5ad8-4bf1-af69-5aba70946a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:45.332359 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a7783-5ad8-4bf1-af69-5aba70946a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:45.334348 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a7783-5ad8-4bf1-af69-5aba70946a54 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:45.349213 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1311/2632] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:15:45.353393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21f78a-df5f-41e0-b9cf-9982af904b35 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:45.378145 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21f78a-df5f-41e0-b9cf-9982af904b35 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:45.394646 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9d5b1-c533-45d5-954e-d00c84cb7c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:45.397137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9d5b1-c533-45d5-954e-d00c84cb7c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:45.397359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9d5b1-c533-45d5-954e-d00c84cb7c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:45.397648 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9d5b1-c533-45d5-954e-d00c84cb7c48 admin admin] PATH_INFO: `/v3/projects/e6866a44d1a44e85a5cba3b741e7d267/users/3e0f73850d2f427ea50ad6c1448888f3/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:45.400300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9d5b1-c533-45d5-954e-d00c84cb7c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6866a44d1a44e85a5cba3b741e7d267, user_id=3e0f73850d2f427ea50ad6c1448888f3, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:45.404897 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9d5b1-c533-45d5-954e-d00c84cb7c48 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:45.421068 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1322/2633] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:15:45 2022] PUT /identity/v3/projects/e6866a44d1a44e85a5cba3b741e7d267/users/3e0f73850d2f427ea50ad6c1448888f3/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:15:45.432979 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aedb27-8e1c-4b89-8d3e-e5ea583ddfae None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:45.433816 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aedb27-8e1c-4b89-8d3e-e5ea583ddfae None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:45.434531 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aedb27-8e1c-4b89-8d3e-e5ea583ddfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:45.472428 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-f0aedb27-8e1c-4b89-8d3e-e5ea583ddfae None None] MFA Rules not processed for user `3e0f73850d2f427ea50ad6c1448888f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:15:45.473992 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f0aedb27-8e1c-4b89-8d3e-e5ea583ddfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:45.507015 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:15:45.615203 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1312/2634] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:15:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:15:45.636807 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9d5b1-c533-45d5-954e-d00c84cb7c48 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:45.639833 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a8b9d5b1-c533-45d5-954e-d00c84cb7c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:45.765619 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9d5b1-c533-45d5-954e-d00c84cb7c48 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:45.770480 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1104b-0e36-4c43-94e6-00d44a8c515b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:45.771170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1104b-0e36-4c43-94e6-00d44a8c515b service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:45.771463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1104b-0e36-4c43-94e6-00d44a8c515b service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:45.771746 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1104b-0e36-4c43-94e6-00d44a8c515b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:45.873692 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1104b-0e36-4c43-94e6-00d44a8c515b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:45.875586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1104b-0e36-4c43-94e6-00d44a8c515b service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:45.895554 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:15:45.895868 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1323/2635] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:15:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:15:47.584278 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d5837-0814-4344-9189-3b64f41f0bbc None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:47.585061 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d5837-0814-4344-9189-3b64f41f0bbc None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:47.585955 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d5837-0814-4344-9189-3b64f41f0bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:47.650382 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-2d1d5837-0814-4344-9189-3b64f41f0bbc None None] MFA Rules not processed for user `8ff9389a3aee4188934db3e9f5259dec`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:15:47.650382 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2d1d5837-0814-4344-9189-3b64f41f0bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:47.774321 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1313/2636] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:15:47 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:15:47.792132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1104b-0e36-4c43-94e6-00d44a8c515b service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:47.793803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-87e1104b-0e36-4c43-94e6-00d44a8c515b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:47.881890 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1104b-0e36-4c43-94e6-00d44a8c515b service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:47.887841 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7158fc7-f9a3-40dd-80f1-3df3d8141b91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:47.888525 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7158fc7-f9a3-40dd-80f1-3df3d8141b91 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:47.888811 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7158fc7-f9a3-40dd-80f1-3df3d8141b91 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:47.889087 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7158fc7-f9a3-40dd-80f1-3df3d8141b91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:47.890860 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e7158fc7-f9a3-40dd-80f1-3df3d8141b91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:47.951215 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7158fc7-f9a3-40dd-80f1-3df3d8141b91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:47.952973 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7158fc7-f9a3-40dd-80f1-3df3d8141b91 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:47.963468 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1324/2637] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:15:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:15:48.758273 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d5837-0814-4344-9189-3b64f41f0bbc None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:15:48.769147 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d5837-0814-4344-9189-3b64f41f0bbc None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:15:48.773118 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dfd08-1984-48f4-96e0-858f70c9af82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:15:48.774056 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dfd08-1984-48f4-96e0-858f70c9af82 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:48.774666 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dfd08-1984-48f4-96e0-858f70c9af82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:48.775194 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dfd08-1984-48f4-96e0-858f70c9af82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:48.786903 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622dfd08-1984-48f4-96e0-858f70c9af82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:15:48.788703 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622dfd08-1984-48f4-96e0-858f70c9af82 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:15:48.801195 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1314/2638] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:15:48 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:15:49.036469 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078333c1-b061-4193-a897-83ced754948a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:15:49.037473 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078333c1-b061-4193-a897-83ced754948a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:15:49.037662 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078333c1-b061-4193-a897-83ced754948a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:15:49.059567 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-078333c1-b061-4193-a897-83ced754948a None None] MFA Rules not processed for user `0247c501a7894b279e3ca8f471df6429`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:15:49.061025 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-078333c1-b061-4193-a897-83ced754948a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:15:49.071262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1325/2639] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:15:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:15:58.796546 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=60 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:15:59.051759 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=59 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:01.704112 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dfd08-1984-48f4-96e0-858f70c9af82 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:01.784888 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dfd08-1984-48f4-96e0-858f70c9af82 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:01.792273 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3e063-ab3d-417b-bc1b-bb09ac9adf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:01.793231 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3e063-ab3d-417b-bc1b-bb09ac9adf09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:01.793581 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3e063-ab3d-417b-bc1b-bb09ac9adf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:01.793804 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3e063-ab3d-417b-bc1b-bb09ac9adf09 admin admin] PATH_INFO: `/v3/users/d8c5fdfdd1724740b1e83ca49a54cfe6` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:01.795223 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3e063-ab3d-417b-bc1b-bb09ac9adf09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8c5fdfdd1724740b1e83ca49a54cfe6)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:01.797532 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3e063-ab3d-417b-bc1b-bb09ac9adf09 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:01.852653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-22a3e063-ab3d-417b-bc1b-bb09ac9adf09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8c5fdfdd1724740b1e83ca49a54cfe6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:01.860823 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-22a3e063-ab3d-417b-bc1b-bb09ac9adf09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8c5fdfdd1724740b1e83ca49a54cfe6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:01.874043 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-22a3e063-ab3d-417b-bc1b-bb09ac9adf09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8c5fdfdd1724740b1e83ca49a54cfe6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:01.874822 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-22a3e063-ab3d-417b-bc1b-bb09ac9adf09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8c5fdfdd1724740b1e83ca49a54cfe6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:01.875601 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-22a3e063-ab3d-417b-bc1b-bb09ac9adf09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8c5fdfdd1724740b1e83ca49a54cfe6'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:01.891860 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1315/2640] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:16:01 2022] DELETE /identity/v3/users/d8c5fdfdd1724740b1e83ca49a54cfe6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:01.897240 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1fa31-46f2-4cd5-9fcd-c7752d3c4bf5 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:01.897772 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1fa31-46f2-4cd5-9fcd-c7752d3c4bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:01.897772 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1fa31-46f2-4cd5-9fcd-c7752d3c4bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:01.917245 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-7da1fa31-46f2-4cd5-9fcd-c7752d3c4bf5 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:01.918438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7da1fa31-46f2-4cd5-9fcd-c7752d3c4bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:01.979186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1326/2641] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:01.990495 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3e063-ab3d-417b-bc1b-bb09ac9adf09 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:01.990495 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-22a3e063-ab3d-417b-bc1b-bb09ac9adf09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:02.052818 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3e063-ab3d-417b-bc1b-bb09ac9adf09 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:02.056550 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931cb589-8846-4f51-a5c4-7a2db38dce67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:02.057209 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cb589-8846-4f51-a5c4-7a2db38dce67 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:02.057491 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cb589-8846-4f51-a5c4-7a2db38dce67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:02.057768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cb589-8846-4f51-a5c4-7a2db38dce67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:02.068529 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931cb589-8846-4f51-a5c4-7a2db38dce67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:02.069922 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931cb589-8846-4f51-a5c4-7a2db38dce67 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:02.079529 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1316/2642] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:16:02.380553 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1fa31-46f2-4cd5-9fcd-c7752d3c4bf5 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:02.382428 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7da1fa31-46f2-4cd5-9fcd-c7752d3c4bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:02.400022 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1fa31-46f2-4cd5-9fcd-c7752d3c4bf5 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:02.405444 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e603e5-0d8f-40d0-919b-212b50dd277f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:02.406882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e603e5-0d8f-40d0-919b-212b50dd277f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:02.407284 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e603e5-0d8f-40d0-919b-212b50dd277f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:02.407677 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e603e5-0d8f-40d0-919b-212b50dd277f admin admin] PATH_INFO: `/v3/projects/51a40e8d389f4ab8a90e76ac437f310b` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:02.411675 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e603e5-0d8f-40d0-919b-212b50dd277f admin admin] RBAC: Authorizing `identity:delete_project(project_id=51a40e8d389f4ab8a90e76ac437f310b)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:02.415062 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e603e5-0d8f-40d0-919b-212b50dd277f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:02.464084 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-57e603e5-0d8f-40d0-919b-212b50dd277f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51a40e8d389f4ab8a90e76ac437f310b', 'request_id': 'req-57e603e5-0d8f-40d0-919b-212b50dd277f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:02.472808 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-57e603e5-0d8f-40d0-919b-212b50dd277f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51a40e8d389f4ab8a90e76ac437f310b', 'request_id': 'req-57e603e5-0d8f-40d0-919b-212b50dd277f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:02.479090 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-57e603e5-0d8f-40d0-919b-212b50dd277f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51a40e8d389f4ab8a90e76ac437f310b', 'request_id': 'req-57e603e5-0d8f-40d0-919b-212b50dd277f'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:02.491082 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-57e603e5-0d8f-40d0-919b-212b50dd277f admin admin] The token cache is being invalidate because project 51a40e8d389f4ab8a90e76ac437f310b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:16:02.491379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-57e603e5-0d8f-40d0-919b-212b50dd277f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:02.492070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-57e603e5-0d8f-40d0-919b-212b50dd277f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:02.493658 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1327/2643] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:16:02 2022] DELETE /identity/v3/projects/51a40e8d389f4ab8a90e76ac437f310b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:02.497593 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931cb589-8846-4f51-a5c4-7a2db38dce67 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:02.507583 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931cb589-8846-4f51-a5c4-7a2db38dce67 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:02.527520 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:02.571361 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85e8f0-17be-4d9c-8515-950c7079f940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:02.572534 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85e8f0-17be-4d9c-8515-950c7079f940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:02.572845 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85e8f0-17be-4d9c-8515-950c7079f940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:02.573130 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85e8f0-17be-4d9c-8515-950c7079f940 admin admin] PATH_INFO: `/v3/users/3e0f73850d2f427ea50ad6c1448888f3` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:02.574346 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a85e8f0-17be-4d9c-8515-950c7079f940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e0f73850d2f427ea50ad6c1448888f3)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:02.576653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a85e8f0-17be-4d9c-8515-950c7079f940 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:02.628565 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6a85e8f0-17be-4d9c-8515-950c7079f940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e0f73850d2f427ea50ad6c1448888f3'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:02.636842 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6a85e8f0-17be-4d9c-8515-950c7079f940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e0f73850d2f427ea50ad6c1448888f3'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:02.650219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6a85e8f0-17be-4d9c-8515-950c7079f940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e0f73850d2f427ea50ad6c1448888f3'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:02.650868 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6a85e8f0-17be-4d9c-8515-950c7079f940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e0f73850d2f427ea50ad6c1448888f3'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:02.651462 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6a85e8f0-17be-4d9c-8515-950c7079f940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e0f73850d2f427ea50ad6c1448888f3'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:02.670758 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1317/2644] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:16:02 2022] DELETE /identity/v3/users/3e0f73850d2f427ea50ad6c1448888f3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:02.959695 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e603e5-0d8f-40d0-919b-212b50dd277f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:02.961157 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-57e603e5-0d8f-40d0-919b-212b50dd277f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:02.975127 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e603e5-0d8f-40d0-919b-212b50dd277f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:03.053484 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018c117-bac7-4095-8ebe-e5dc1783a3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:03.054366 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018c117-bac7-4095-8ebe-e5dc1783a3f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:03.054642 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018c117-bac7-4095-8ebe-e5dc1783a3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:03.054917 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018c117-bac7-4095-8ebe-e5dc1783a3f6 admin admin] PATH_INFO: `/v3/projects/e6866a44d1a44e85a5cba3b741e7d267` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:03.056119 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5018c117-bac7-4095-8ebe-e5dc1783a3f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6866a44d1a44e85a5cba3b741e7d267)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:03.058102 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5018c117-bac7-4095-8ebe-e5dc1783a3f6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:03.097897 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:03.124229 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5018c117-bac7-4095-8ebe-e5dc1783a3f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6866a44d1a44e85a5cba3b741e7d267', 'request_id': 'req-5018c117-bac7-4095-8ebe-e5dc1783a3f6'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:03.132826 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5018c117-bac7-4095-8ebe-e5dc1783a3f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6866a44d1a44e85a5cba3b741e7d267', 'request_id': 'req-5018c117-bac7-4095-8ebe-e5dc1783a3f6'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:03.139568 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5018c117-bac7-4095-8ebe-e5dc1783a3f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6866a44d1a44e85a5cba3b741e7d267', 'request_id': 'req-5018c117-bac7-4095-8ebe-e5dc1783a3f6'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:03.152100 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5018c117-bac7-4095-8ebe-e5dc1783a3f6 admin admin] The token cache is being invalidate because project e6866a44d1a44e85a5cba3b741e7d267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:16:03.152397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5018c117-bac7-4095-8ebe-e5dc1783a3f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:03.153088 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-5018c117-bac7-4095-8ebe-e5dc1783a3f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:03.154648 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1328/2645] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:16:02 2022] DELETE /identity/v3/projects/e6866a44d1a44e85a5cba3b741e7d267 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:03.160922 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98318b4c-ad8c-4e7c-9b16-69868beca9b1 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:03.161451 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98318b4c-ad8c-4e7c-9b16-69868beca9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:03.161542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98318b4c-ad8c-4e7c-9b16-69868beca9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:03.180236 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-98318b4c-ad8c-4e7c-9b16-69868beca9b1 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:03.181487 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-98318b4c-ad8c-4e7c-9b16-69868beca9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:03.249712 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1318/2646] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:03.259895 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcbe69-87e6-4e65-9161-e3da5f6c4da3 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:03.260115 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcbe69-87e6-4e65-9161-e3da5f6c4da3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:03.260686 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcbe69-87e6-4e65-9161-e3da5f6c4da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:03.279628 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-2fbcbe69-87e6-4e65-9161-e3da5f6c4da3 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:03.280896 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-2fbcbe69-87e6-4e65-9161-e3da5f6c4da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:03.288913 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1329/2647] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:03.293278 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98318b4c-ad8c-4e7c-9b16-69868beca9b1 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:03.303837 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98318b4c-ad8c-4e7c-9b16-69868beca9b1 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:03.308606 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e805e-ff27-4165-9979-42c04013e374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:03.309271 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e805e-ff27-4165-9979-42c04013e374 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:03.309548 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e805e-ff27-4165-9979-42c04013e374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:03.309820 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e805e-ff27-4165-9979-42c04013e374 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:03.310545 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e805e-ff27-4165-9979-42c04013e374 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:16:03.310847 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e805e-ff27-4165-9979-42c04013e374 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:03.312482 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e805e-ff27-4165-9979-42c04013e374 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:03.325458 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1319/2648] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:16:03.329979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbcbe69-87e6-4e65-9161-e3da5f6c4da3 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:03.340739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbcbe69-87e6-4e65-9161-e3da5f6c4da3 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:03.345614 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561c468-9170-4ce4-a30a-c2e946c67c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:03.346353 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561c468-9170-4ce4-a30a-c2e946c67c80 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:03.346639 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561c468-9170-4ce4-a30a-c2e946c67c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:03.347073 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561c468-9170-4ce4-a30a-c2e946c67c80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:03.347783 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3561c468-9170-4ce4-a30a-c2e946c67c80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:03.349786 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3561c468-9170-4ce4-a30a-c2e946c67c80 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:03.382186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1330/2649] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:16:03 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:16:03.386895 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e805e-ff27-4165-9979-42c04013e374 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:03.397058 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e805e-ff27-4165-9979-42c04013e374 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:03.425856 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:03.459695 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfc2c3-9f70-4099-9bf0-555088372283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:03.460389 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfc2c3-9f70-4099-9bf0-555088372283 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:03.460707 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfc2c3-9f70-4099-9bf0-555088372283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:03.460986 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfc2c3-9f70-4099-9bf0-555088372283 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:03.461687 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dfc2c3-9f70-4099-9bf0-555088372283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:03.463608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dfc2c3-9f70-4099-9bf0-555088372283 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:03.485451 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1320/2650] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:16:03 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:16:03.490499 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561c468-9170-4ce4-a30a-c2e946c67c80 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:03.500996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561c468-9170-4ce4-a30a-c2e946c67c80 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:03.506621 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2374b-9164-43aa-8f0f-c6d4f66319fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:03.507373 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2374b-9164-43aa-8f0f-c6d4f66319fb admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:03.507607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2374b-9164-43aa-8f0f-c6d4f66319fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:03.507887 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2374b-9164-43aa-8f0f-c6d4f66319fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:03.508676 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2374b-9164-43aa-8f0f-c6d4f66319fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:03.510634 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2374b-9164-43aa-8f0f-c6d4f66319fb admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:03.521772 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1331/2651] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:16:03.525834 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfc2c3-9f70-4099-9bf0-555088372283 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:03.536930 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfc2c3-9f70-4099-9bf0-555088372283 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:03.541774 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c7940-b501-4a20-897f-a555ff696c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:03.542420 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c7940-b501-4a20-897f-a555ff696c39 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:03.542702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c7940-b501-4a20-897f-a555ff696c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:03.542973 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c7940-b501-4a20-897f-a555ff696c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:03.543685 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c7940-b501-4a20-897f-a555ff696c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:03.545303 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c7940-b501-4a20-897f-a555ff696c39 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:03.556891 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1321/2652] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:16:03.561189 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2374b-9164-43aa-8f0f-c6d4f66319fb admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:03.573291 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2374b-9164-43aa-8f0f-c6d4f66319fb admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:03.578693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f4033-e1ae-462c-b241-41e1aa3aee8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:03.579591 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f4033-e1ae-462c-b241-41e1aa3aee8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:03.580616 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f4033-e1ae-462c-b241-41e1aa3aee8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:03.580815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f4033-e1ae-462c-b241-41e1aa3aee8f admin admin] PATH_INFO: `/v3/projects/10204ea8c164427d866fbafa1fc1328f/users/8e54d981a5f04888bc4b020d7608ece5/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:03.595928 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f4033-e1ae-462c-b241-41e1aa3aee8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=10204ea8c164427d866fbafa1fc1328f, user_id=8e54d981a5f04888bc4b020d7608ece5, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:03.598625 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f4033-e1ae-462c-b241-41e1aa3aee8f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:03.612978 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1332/2653] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:16:03 2022] PUT /identity/v3/projects/10204ea8c164427d866fbafa1fc1328f/users/8e54d981a5f04888bc4b020d7608ece5/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:03.623337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a58ec3-1976-43b4-a8b3-90fff07bcb86 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:03.623637 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a58ec3-1976-43b4-a8b3-90fff07bcb86 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:03.623920 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a58ec3-1976-43b4-a8b3-90fff07bcb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:03.652173 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-37a58ec3-1976-43b4-a8b3-90fff07bcb86 None None] MFA Rules not processed for user `8e54d981a5f04888bc4b020d7608ece5`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:03.653485 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-37a58ec3-1976-43b4-a8b3-90fff07bcb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:03.724879 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1322/2654] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:03.729431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f4033-e1ae-462c-b241-41e1aa3aee8f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:03.795765 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f4033-e1ae-462c-b241-41e1aa3aee8f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:03.801212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695283a-b5e8-44a3-9c34-6861789722ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:03.801882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695283a-b5e8-44a3-9c34-6861789722ef admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:03.802171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695283a-b5e8-44a3-9c34-6861789722ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:03.802450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695283a-b5e8-44a3-9c34-6861789722ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:03.803155 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695283a-b5e8-44a3-9c34-6861789722ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:03.805121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695283a-b5e8-44a3-9c34-6861789722ef admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:03.836313 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1333/2655] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:16:03 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:16:03.840578 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a58ec3-1976-43b4-a8b3-90fff07bcb86 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:03.851244 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a58ec3-1976-43b4-a8b3-90fff07bcb86 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:03.909711 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a299e37-4344-4527-9c73-8362085c0cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:03.910384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a299e37-4344-4527-9c73-8362085c0cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:03.910669 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a299e37-4344-4527-9c73-8362085c0cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:03.910939 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a299e37-4344-4527-9c73-8362085c0cd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:03.911615 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a299e37-4344-4527-9c73-8362085c0cd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:03.913547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a299e37-4344-4527-9c73-8362085c0cd4 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:03.934934 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1323/2656] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:16:03 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:16:03.939760 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695283a-b5e8-44a3-9c34-6861789722ef admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:03.950099 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695283a-b5e8-44a3-9c34-6861789722ef admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:03.954689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e7837-9a65-4644-a650-2517be8d8121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:03.955440 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e7837-9a65-4644-a650-2517be8d8121 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:03.955723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e7837-9a65-4644-a650-2517be8d8121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:03.955991 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e7837-9a65-4644-a650-2517be8d8121 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:03.956732 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e7837-9a65-4644-a650-2517be8d8121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:03.958329 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e7837-9a65-4644-a650-2517be8d8121 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:03.968862 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1334/2657] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:16:03.973506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a299e37-4344-4527-9c73-8362085c0cd4 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:03.984105 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a299e37-4344-4527-9c73-8362085c0cd4 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:03.989386 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11148a41-3baf-4755-92ac-b2bd41f71540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:03.990047 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11148a41-3baf-4755-92ac-b2bd41f71540 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:03.990329 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11148a41-3baf-4755-92ac-b2bd41f71540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:03.990608 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11148a41-3baf-4755-92ac-b2bd41f71540 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:03.991464 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11148a41-3baf-4755-92ac-b2bd41f71540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:03.992950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11148a41-3baf-4755-92ac-b2bd41f71540 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:04.003546 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1324/2658] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:16:04.007951 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e7837-9a65-4644-a650-2517be8d8121 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:04.018270 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e7837-9a65-4644-a650-2517be8d8121 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:04.030395 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eab80c-8ff5-4e10-b8ab-e7637e1213f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:04.031303 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eab80c-8ff5-4e10-b8ab-e7637e1213f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:04.031589 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eab80c-8ff5-4e10-b8ab-e7637e1213f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:04.031866 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eab80c-8ff5-4e10-b8ab-e7637e1213f4 admin admin] PATH_INFO: `/v3/projects/e680dc24669f4ad7b2626606240ebb39/users/6b22254d007841f28631d29df3f984b0/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:04.049142 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eab80c-8ff5-4e10-b8ab-e7637e1213f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e680dc24669f4ad7b2626606240ebb39, user_id=6b22254d007841f28631d29df3f984b0, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:04.051725 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eab80c-8ff5-4e10-b8ab-e7637e1213f4 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:04.061099 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:04.067820 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1335/2659] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:16:04 2022] PUT /identity/v3/projects/e680dc24669f4ad7b2626606240ebb39/users/6b22254d007841f28631d29df3f984b0/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:04.079734 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d651126-f733-4995-9319-52d1374754d9 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:04.080239 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d651126-f733-4995-9319-52d1374754d9 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:04.080625 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d651126-f733-4995-9319-52d1374754d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:04.107139 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-1d651126-f733-4995-9319-52d1374754d9 None None] MFA Rules not processed for user `6b22254d007841f28631d29df3f984b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:04.108472 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1d651126-f733-4995-9319-52d1374754d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:04.113906 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:04.178631 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1325/2660] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:04.183885 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eab80c-8ff5-4e10-b8ab-e7637e1213f4 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:04.250932 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eab80c-8ff5-4e10-b8ab-e7637e1213f4 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:04.256991 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc0478-7397-4430-948e-7c86377247b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:04.257188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc0478-7397-4430-948e-7c86377247b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:04.257472 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc0478-7397-4430-948e-7c86377247b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:04.257748 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc0478-7397-4430-948e-7c86377247b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:04.258441 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc0478-7397-4430-948e-7c86377247b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:04.260615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc0478-7397-4430-948e-7c86377247b1 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:04.290849 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1336/2661] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:16:04 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:16:04.292053 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d651126-f733-4995-9319-52d1374754d9 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:04.305225 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d651126-f733-4995-9319-52d1374754d9 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:04.350058 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc0478-7397-4430-948e-7c86377247b1 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:04.351844 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-83dc0478-7397-4430-948e-7c86377247b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:04.373396 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f1850-b8a0-4c65-9372-de18d7778deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:04.374085 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f1850-b8a0-4c65-9372-de18d7778deb admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:04.374370 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f1850-b8a0-4c65-9372-de18d7778deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:04.374646 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f1850-b8a0-4c65-9372-de18d7778deb admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:04.375347 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f1850-b8a0-4c65-9372-de18d7778deb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:04.382035 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f1850-b8a0-4c65-9372-de18d7778deb admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:04.409547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1326/2662] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:16:04 2022] POST /identity/v3/users => generated 296 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:16:04.413384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f1850-b8a0-4c65-9372-de18d7778deb admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:04.420270 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc0478-7397-4430-948e-7c86377247b1 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:04.425152 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f1850-b8a0-4c65-9372-de18d7778deb admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:04.425313 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f74206-ff09-451e-8fcf-fbc2bc4d62e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:04.425977 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f74206-ff09-451e-8fcf-fbc2bc4d62e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:04.426325 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f74206-ff09-451e-8fcf-fbc2bc4d62e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:04.426662 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f74206-ff09-451e-8fcf-fbc2bc4d62e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:04.428559 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-32f74206-ff09-451e-8fcf-fbc2bc4d62e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:04.430502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36bcdf-778f-4e7b-8073-8cc9e176b931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:04.431197 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36bcdf-778f-4e7b-8073-8cc9e176b931 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:04.431486 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36bcdf-778f-4e7b-8073-8cc9e176b931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:04.431764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36bcdf-778f-4e7b-8073-8cc9e176b931 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:04.432526 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36bcdf-778f-4e7b-8073-8cc9e176b931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:04.434130 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36bcdf-778f-4e7b-8073-8cc9e176b931 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:04.448951 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f74206-ff09-451e-8fcf-fbc2bc4d62e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:04.448951 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f74206-ff09-451e-8fcf-fbc2bc4d62e4 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:04.449648 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1327/2663] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:16:04.449648 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36bcdf-778f-4e7b-8073-8cc9e176b931 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:04.457744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1337/2664] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:16:04.459386 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36bcdf-778f-4e7b-8073-8cc9e176b931 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:04.464006 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f00ab-bf46-4dcb-94e7-382c08b2bc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:04.464928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f00ab-bf46-4dcb-94e7-382c08b2bc17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:04.465216 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f00ab-bf46-4dcb-94e7-382c08b2bc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:04.465491 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f00ab-bf46-4dcb-94e7-382c08b2bc17 admin admin] PATH_INFO: `/v3/projects/5e5dbfacdcea4603b5248888f09ee6b9/users/54ac05800dfe477797793daac920afdf/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:04.481155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f00ab-bf46-4dcb-94e7-382c08b2bc17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5dbfacdcea4603b5248888f09ee6b9, user_id=54ac05800dfe477797793daac920afdf, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:04.483817 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f00ab-bf46-4dcb-94e7-382c08b2bc17 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:04.500679 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1328/2665] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:16:04 2022] PUT /identity/v3/projects/5e5dbfacdcea4603b5248888f09ee6b9/users/54ac05800dfe477797793daac920afdf/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:16:04.505101 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f74206-ff09-451e-8fcf-fbc2bc4d62e4 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:04.520441 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f74206-ff09-451e-8fcf-fbc2bc4d62e4 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:04.590295 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3692ac-3e02-413e-aeef-3355efec3fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:04.590984 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3692ac-3e02-413e-aeef-3355efec3fbf admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:04.591270 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3692ac-3e02-413e-aeef-3355efec3fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:04.591551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3692ac-3e02-413e-aeef-3355efec3fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:04.592281 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3692ac-3e02-413e-aeef-3355efec3fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:04.594004 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3692ac-3e02-413e-aeef-3355efec3fbf admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:04.608888 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1338/2666] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:16:04.613339 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f00ab-bf46-4dcb-94e7-382c08b2bc17 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:04.623716 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f00ab-bf46-4dcb-94e7-382c08b2bc17 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:04.628743 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d085e-3042-4eca-8359-d3a14580a229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:04.629550 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d085e-3042-4eca-8359-d3a14580a229 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:04.629831 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d085e-3042-4eca-8359-d3a14580a229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:04.630110 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d085e-3042-4eca-8359-d3a14580a229 admin admin] PATH_INFO: `/v3/projects/5e5dbfacdcea4603b5248888f09ee6b9/users/54ac05800dfe477797793daac920afdf/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:04.632202 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d085e-3042-4eca-8359-d3a14580a229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5dbfacdcea4603b5248888f09ee6b9, user_id=54ac05800dfe477797793daac920afdf, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:04.634946 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d085e-3042-4eca-8359-d3a14580a229 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:04.648208 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1329/2667] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:16:04 2022] PUT /identity/v3/projects/5e5dbfacdcea4603b5248888f09ee6b9/users/54ac05800dfe477797793daac920afdf/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:04.659415 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681326e0-c888-453a-b8d6-ad12c918805e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:04.659772 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681326e0-c888-453a-b8d6-ad12c918805e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:04.660059 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681326e0-c888-453a-b8d6-ad12c918805e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:04.692018 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-681326e0-c888-453a-b8d6-ad12c918805e None None] MFA Rules not processed for user `54ac05800dfe477797793daac920afdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:04.693285 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-681326e0-c888-453a-b8d6-ad12c918805e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:04.706670 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:04.771294 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1339/2668] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:04.782643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d085e-3042-4eca-8359-d3a14580a229 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:04.785055 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d95d085e-3042-4eca-8359-d3a14580a229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:04.844412 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:04.851940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d085e-3042-4eca-8359-d3a14580a229 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:04.856197 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881d733-4424-49c9-b636-d95e84c1b11d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:04.856979 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881d733-4424-49c9-b636-d95e84c1b11d service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:04.857268 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881d733-4424-49c9-b636-d95e84c1b11d service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:04.857549 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881d733-4424-49c9-b636-d95e84c1b11d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:04.867356 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881d733-4424-49c9-b636-d95e84c1b11d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:04.868858 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881d733-4424-49c9-b636-d95e84c1b11d service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:04.879668 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1330/2669] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:16:04.927695 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681326e0-c888-453a-b8d6-ad12c918805e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:04.929170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-681326e0-c888-453a-b8d6-ad12c918805e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:04.942463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681326e0-c888-453a-b8d6-ad12c918805e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:04.946195 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8980ca6-0181-4cd0-84ff-c5879404b190 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:04.946850 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8980ca6-0181-4cd0-84ff-c5879404b190 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:04.947139 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8980ca6-0181-4cd0-84ff-c5879404b190 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:04.947419 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8980ca6-0181-4cd0-84ff-c5879404b190 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:05.017885 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8980ca6-0181-4cd0-84ff-c5879404b190 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:05.019512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8980ca6-0181-4cd0-84ff-c5879404b190 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:05.034105 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1340/2670] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:16:07.699001 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881d733-4424-49c9-b636-d95e84c1b11d service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:07.700960 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-1881d733-4424-49c9-b636-d95e84c1b11d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:07.782132 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881d733-4424-49c9-b636-d95e84c1b11d service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:07.787562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638e22d-559f-411d-9fd8-ffa957cc1e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:07.788471 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638e22d-559f-411d-9fd8-ffa957cc1e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:07.788764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638e22d-559f-411d-9fd8-ffa957cc1e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:07.789053 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638e22d-559f-411d-9fd8-ffa957cc1e95 admin admin] PATH_INFO: `/v3/users/5fc2803fed254f3b8a280df51891ec0b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:07.790388 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638e22d-559f-411d-9fd8-ffa957cc1e95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fc2803fed254f3b8a280df51891ec0b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:07.792337 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638e22d-559f-411d-9fd8-ffa957cc1e95 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:07.843607 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3638e22d-559f-411d-9fd8-ffa957cc1e95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fc2803fed254f3b8a280df51891ec0b'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:07.851152 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3638e22d-559f-411d-9fd8-ffa957cc1e95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fc2803fed254f3b8a280df51891ec0b'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:07.863795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3638e22d-559f-411d-9fd8-ffa957cc1e95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fc2803fed254f3b8a280df51891ec0b'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:07.864453 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3638e22d-559f-411d-9fd8-ffa957cc1e95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fc2803fed254f3b8a280df51891ec0b'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:07.865055 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-3638e22d-559f-411d-9fd8-ffa957cc1e95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fc2803fed254f3b8a280df51891ec0b'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:07.877425 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1331/2671] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:16:07 2022] DELETE /identity/v3/users/5fc2803fed254f3b8a280df51891ec0b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:08.066759 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8980ca6-0181-4cd0-84ff-c5879404b190 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:08.067239 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638e22d-559f-411d-9fd8-ffa957cc1e95 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:08.068766 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3638e22d-559f-411d-9fd8-ffa957cc1e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:08.081182 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8980ca6-0181-4cd0-84ff-c5879404b190 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:08.149041 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1fa7e-a251-4729-b24c-c98267e5a9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:08.149291 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638e22d-559f-411d-9fd8-ffa957cc1e95 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:08.150076 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1fa7e-a251-4729-b24c-c98267e5a9fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:08.150357 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1fa7e-a251-4729-b24c-c98267e5a9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:08.150632 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1fa7e-a251-4729-b24c-c98267e5a9fb admin admin] PATH_INFO: `/v3/users/8e54d981a5f04888bc4b020d7608ece5` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:08.151803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1fa7e-a251-4729-b24c-c98267e5a9fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e54d981a5f04888bc4b020d7608ece5)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:08.153944 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1fa7e-a251-4729-b24c-c98267e5a9fb admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:08.154107 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc18227-8870-45fb-b25b-175cfbb1e50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:08.154835 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc18227-8870-45fb-b25b-175cfbb1e50d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:08.155115 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc18227-8870-45fb-b25b-175cfbb1e50d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:08.155390 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc18227-8870-45fb-b25b-175cfbb1e50d admin admin] PATH_INFO: `/v3/projects/a9244f3ef2bf4bc891d0ff3384662e9b` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:08.157375 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc18227-8870-45fb-b25b-175cfbb1e50d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9244f3ef2bf4bc891d0ff3384662e9b)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:08.159500 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc18227-8870-45fb-b25b-175cfbb1e50d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:08.170962 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:08.206954 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2cf1fa7e-a251-4729-b24c-c98267e5a9fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e54d981a5f04888bc4b020d7608ece5'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:08.209516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:08.216436 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2cf1fa7e-a251-4729-b24c-c98267e5a9fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e54d981a5f04888bc4b020d7608ece5'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:08.217058 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2cf1fa7e-a251-4729-b24c-c98267e5a9fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e54d981a5f04888bc4b020d7608ece5'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:08.221202 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6dc18227-8870-45fb-b25b-175cfbb1e50d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9244f3ef2bf4bc891d0ff3384662e9b', 'request_id': 'req-6dc18227-8870-45fb-b25b-175cfbb1e50d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:08.228539 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6dc18227-8870-45fb-b25b-175cfbb1e50d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9244f3ef2bf4bc891d0ff3384662e9b', 'request_id': 'req-6dc18227-8870-45fb-b25b-175cfbb1e50d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:08.232764 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2cf1fa7e-a251-4729-b24c-c98267e5a9fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e54d981a5f04888bc4b020d7608ece5'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:08.237669 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6dc18227-8870-45fb-b25b-175cfbb1e50d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9244f3ef2bf4bc891d0ff3384662e9b', 'request_id': 'req-6dc18227-8870-45fb-b25b-175cfbb1e50d'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:08.241664 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2cf1fa7e-a251-4729-b24c-c98267e5a9fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e54d981a5f04888bc4b020d7608ece5'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:08.247695 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1341/2672] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:16:08 2022] DELETE /identity/v3/users/8e54d981a5f04888bc4b020d7608ece5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:08.250718 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6dc18227-8870-45fb-b25b-175cfbb1e50d admin admin] The token cache is being invalidate because project a9244f3ef2bf4bc891d0ff3384662e9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:16:08.250718 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6dc18227-8870-45fb-b25b-175cfbb1e50d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:08.250718 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-6dc18227-8870-45fb-b25b-175cfbb1e50d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:08.252704 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1332/2673] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:16:08 2022] DELETE /identity/v3/projects/a9244f3ef2bf4bc891d0ff3384662e9b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:08.252955 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7250699-148b-46a1-b89a-f8568c1e3c6d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:08.253252 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7250699-148b-46a1-b89a-f8568c1e3c6d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:08.253583 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7250699-148b-46a1-b89a-f8568c1e3c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:08.257255 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f59c5-401c-4053-8e45-6001c11e4114 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:08.257544 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f59c5-401c-4053-8e45-6001c11e4114 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:08.257851 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f59c5-401c-4053-8e45-6001c11e4114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:08.273158 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c7250699-148b-46a1-b89a-f8568c1e3c6d None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:08.274371 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c7250699-148b-46a1-b89a-f8568c1e3c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:08.276638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8d5f59c5-401c-4053-8e45-6001c11e4114 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:08.277808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8d5f59c5-401c-4053-8e45-6001c11e4114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:08.343319 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1342/2674] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:16:08.346352 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1333/2675] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:16:08.354001 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f59c5-401c-4053-8e45-6001c11e4114 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:08.354261 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde3446-ac97-48f9-8877-6951556329c3 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:08.354554 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde3446-ac97-48f9-8877-6951556329c3 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:08.354834 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde3446-ac97-48f9-8877-6951556329c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:08.355463 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8d5f59c5-401c-4053-8e45-6001c11e4114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:08.373411 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-6cde3446-ac97-48f9-8877-6951556329c3 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:08.374629 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6cde3446-ac97-48f9-8877-6951556329c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:08.382616 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1343/2676] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:08.386929 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde3446-ac97-48f9-8877-6951556329c3 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:08.396630 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde3446-ac97-48f9-8877-6951556329c3 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:08.401185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701e973-6131-45da-a922-f21b53d89afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:08.401833 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701e973-6131-45da-a922-f21b53d89afe admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:08.402114 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701e973-6131-45da-a922-f21b53d89afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:08.402388 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701e973-6131-45da-a922-f21b53d89afe admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:08.403102 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b701e973-6131-45da-a922-f21b53d89afe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:16:08.403455 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b701e973-6131-45da-a922-f21b53d89afe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:08.405068 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b701e973-6131-45da-a922-f21b53d89afe admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:08.417665 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1344/2677] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 22:16:08.420842 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f59c5-401c-4053-8e45-6001c11e4114 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:08.421908 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701e973-6131-45da-a922-f21b53d89afe admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:08.425471 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14e1d9-d9af-4c6d-8d41-ba3a51a11989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:08.426179 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14e1d9-d9af-4c6d-8d41-ba3a51a11989 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:08.426462 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14e1d9-d9af-4c6d-8d41-ba3a51a11989 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:08.426736 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14e1d9-d9af-4c6d-8d41-ba3a51a11989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:08.432482 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701e973-6131-45da-a922-f21b53d89afe admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:08.437313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14e1d9-d9af-4c6d-8d41-ba3a51a11989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:08.438177 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9bc71-0459-4280-adca-7c76f507fb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:08.438751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14e1d9-d9af-4c6d-8d41-ba3a51a11989 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:08.439033 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9bc71-0459-4280-adca-7c76f507fb57 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:08.439949 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9bc71-0459-4280-adca-7c76f507fb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:08.440232 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9bc71-0459-4280-adca-7c76f507fb57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:08.440990 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9bc71-0459-4280-adca-7c76f507fb57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:08.442946 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9bc71-0459-4280-adca-7c76f507fb57 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:08.449196 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1334/2678] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:16:08.473554 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1345/2679] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:16:08 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:16:08.477679 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14e1d9-d9af-4c6d-8d41-ba3a51a11989 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:08.488626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14e1d9-d9af-4c6d-8d41-ba3a51a11989 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:08.542379 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:08.571759 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787766bc-682e-451a-8e1a-05ad2d5b195f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:08.572999 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787766bc-682e-451a-8e1a-05ad2d5b195f admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:08.573286 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787766bc-682e-451a-8e1a-05ad2d5b195f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:08.573565 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787766bc-682e-451a-8e1a-05ad2d5b195f admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:08.574832 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787766bc-682e-451a-8e1a-05ad2d5b195f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:08.577067 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787766bc-682e-451a-8e1a-05ad2d5b195f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:08.606218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1335/2680] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:16:08 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:16:08.607536 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9bc71-0459-4280-adca-7c76f507fb57 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:08.619726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9bc71-0459-4280-adca-7c76f507fb57 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:08.634029 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7f6d0-5c3e-4431-a7b6-083969180798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:08.634724 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7f6d0-5c3e-4431-a7b6-083969180798 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:08.635010 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7f6d0-5c3e-4431-a7b6-083969180798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:08.635548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7f6d0-5c3e-4431-a7b6-083969180798 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:08.636282 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7f6d0-5c3e-4431-a7b6-083969180798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:08.639745 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7f6d0-5c3e-4431-a7b6-083969180798 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:08.655874 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1346/2681] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:16:08.660697 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787766bc-682e-451a-8e1a-05ad2d5b195f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:08.675418 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787766bc-682e-451a-8e1a-05ad2d5b195f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:08.684515 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f266e1a-e850-4238-8075-45a9e4717a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:08.685978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f266e1a-e850-4238-8075-45a9e4717a74 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:08.685978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f266e1a-e850-4238-8075-45a9e4717a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:08.686189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f266e1a-e850-4238-8075-45a9e4717a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:08.687091 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f266e1a-e850-4238-8075-45a9e4717a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:08.689895 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f266e1a-e850-4238-8075-45a9e4717a74 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:08.705261 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1336/2682] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:16:08.710887 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7f6d0-5c3e-4431-a7b6-083969180798 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:08.729472 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7f6d0-5c3e-4431-a7b6-083969180798 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:08.736194 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1b55a-e2ff-413f-b7cd-7db5afcbe010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:08.736963 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1b55a-e2ff-413f-b7cd-7db5afcbe010 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:08.737246 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1b55a-e2ff-413f-b7cd-7db5afcbe010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:08.737566 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1b55a-e2ff-413f-b7cd-7db5afcbe010 admin admin] PATH_INFO: `/v3/projects/dc96270813d7410eac729459ad0231dc/users/bcd00e9825b040eeb391cb2e46c1b6d4/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:08.756055 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1b55a-e2ff-413f-b7cd-7db5afcbe010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc96270813d7410eac729459ad0231dc, user_id=bcd00e9825b040eeb391cb2e46c1b6d4, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:08.759134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1b55a-e2ff-413f-b7cd-7db5afcbe010 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:08.776588 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1347/2683] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:16:08 2022] PUT /identity/v3/projects/dc96270813d7410eac729459ad0231dc/users/bcd00e9825b040eeb391cb2e46c1b6d4/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:08.787501 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bba205-8859-421a-908c-7a8e7688198e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:08.787896 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bba205-8859-421a-908c-7a8e7688198e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:08.788113 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bba205-8859-421a-908c-7a8e7688198e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:08.799501 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1b55a-e2ff-413f-b7cd-7db5afcbe010 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:08.801415 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-dca1b55a-e2ff-413f-b7cd-7db5afcbe010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:08.821200 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-a5bba205-8859-421a-908c-7a8e7688198e None None] MFA Rules not processed for user `bcd00e9825b040eeb391cb2e46c1b6d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:08.822692 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a5bba205-8859-421a-908c-7a8e7688198e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:08.872303 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:08.890931 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1b55a-e2ff-413f-b7cd-7db5afcbe010 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:08.897201 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1337/2684] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:08.897448 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685dee4-7148-47e0-9f70-150f47853468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:08.898324 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685dee4-7148-47e0-9f70-150f47853468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:08.898538 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685dee4-7148-47e0-9f70-150f47853468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:08.898815 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685dee4-7148-47e0-9f70-150f47853468 admin admin] PATH_INFO: `/v3/projects/10204ea8c164427d866fbafa1fc1328f` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:08.900005 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685dee4-7148-47e0-9f70-150f47853468 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10204ea8c164427d866fbafa1fc1328f)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:08.901534 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bba205-8859-421a-908c-7a8e7688198e None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:08.901968 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685dee4-7148-47e0-9f70-150f47853468 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:08.912427 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bba205-8859-421a-908c-7a8e7688198e None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:08.917081 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3bbd9-eb20-40a6-9e8f-0fa94714a403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:08.917735 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3bbd9-eb20-40a6-9e8f-0fa94714a403 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:08.918013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3bbd9-eb20-40a6-9e8f-0fa94714a403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:08.918340 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3bbd9-eb20-40a6-9e8f-0fa94714a403 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:08.919025 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3bbd9-eb20-40a6-9e8f-0fa94714a403 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:08.920959 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3bbd9-eb20-40a6-9e8f-0fa94714a403 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:08.949739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1338/2685] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:16:08 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:16:08.953905 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3bbd9-eb20-40a6-9e8f-0fa94714a403 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:08.955560 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8685dee4-7148-47e0-9f70-150f47853468 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10204ea8c164427d866fbafa1fc1328f', 'request_id': 'req-8685dee4-7148-47e0-9f70-150f47853468'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:08.965749 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8685dee4-7148-47e0-9f70-150f47853468 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10204ea8c164427d866fbafa1fc1328f', 'request_id': 'req-8685dee4-7148-47e0-9f70-150f47853468'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:08.972869 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8685dee4-7148-47e0-9f70-150f47853468 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10204ea8c164427d866fbafa1fc1328f', 'request_id': 'req-8685dee4-7148-47e0-9f70-150f47853468'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:08.989640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8685dee4-7148-47e0-9f70-150f47853468 admin admin] The token cache is being invalidate because project 10204ea8c164427d866fbafa1fc1328f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:16:08.989861 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8685dee4-7148-47e0-9f70-150f47853468 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:08.990522 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8685dee4-7148-47e0-9f70-150f47853468 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:08.992164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1348/2686] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:16:08 2022] DELETE /identity/v3/projects/10204ea8c164427d866fbafa1fc1328f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:16:08.996397 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685dee4-7148-47e0-9f70-150f47853468 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:08.997865 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-8685dee4-7148-47e0-9f70-150f47853468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:09.029589 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3bbd9-eb20-40a6-9e8f-0fa94714a403 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:09.034953 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166963a-f28d-4974-a6da-104a9747de5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:09.035704 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166963a-f28d-4974-a6da-104a9747de5e admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:09.035993 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166963a-f28d-4974-a6da-104a9747de5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:09.036301 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166963a-f28d-4974-a6da-104a9747de5e admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:09.037127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166963a-f28d-4974-a6da-104a9747de5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:09.039199 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166963a-f28d-4974-a6da-104a9747de5e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:09.061426 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1339/2687] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:16:08 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:16:09.065868 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166963a-f28d-4974-a6da-104a9747de5e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:09.067508 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5166963a-f28d-4974-a6da-104a9747de5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:09.067645 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685dee4-7148-47e0-9f70-150f47853468 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:09.072581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001cdac-ef63-4d34-b3b1-a07c924d2ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:09.073492 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001cdac-ef63-4d34-b3b1-a07c924d2ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:09.073779 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001cdac-ef63-4d34-b3b1-a07c924d2ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:09.074063 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001cdac-ef63-4d34-b3b1-a07c924d2ccc admin admin] PATH_INFO: `/v3/users/6b22254d007841f28631d29df3f984b0` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:09.075278 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001cdac-ef63-4d34-b3b1-a07c924d2ccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b22254d007841f28631d29df3f984b0)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:09.077280 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001cdac-ef63-4d34-b3b1-a07c924d2ccc admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:09.079615 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166963a-f28d-4974-a6da-104a9747de5e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:09.085145 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c0831-ec57-4891-803c-4cdedde79dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:09.085814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c0831-ec57-4891-803c-4cdedde79dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:09.086101 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c0831-ec57-4891-803c-4cdedde79dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:09.086379 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c0831-ec57-4891-803c-4cdedde79dd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:09.087114 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c0831-ec57-4891-803c-4cdedde79dd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:09.088786 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c0831-ec57-4891-803c-4cdedde79dd8 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:09.102521 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1340/2688] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:16:09.103546 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c0831-ec57-4891-803c-4cdedde79dd8 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:09.114547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c0831-ec57-4891-803c-4cdedde79dd8 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:09.120691 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae1818-e3d1-431f-9ff9-540e5b490bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:09.121691 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae1818-e3d1-431f-9ff9-540e5b490bd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:09.122083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae1818-e3d1-431f-9ff9-540e5b490bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:09.122436 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae1818-e3d1-431f-9ff9-540e5b490bd1 admin admin] PATH_INFO: `/v3/projects/bfa7f5a8f7f5448baa4ee68e9590d776/users/0d13a5a77a4345cab67dee33ef2c0d2a/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:09.124841 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:09.134113 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2001cdac-ef63-4d34-b3b1-a07c924d2ccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b22254d007841f28631d29df3f984b0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:09.141811 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2001cdac-ef63-4d34-b3b1-a07c924d2ccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b22254d007841f28631d29df3f984b0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:09.142596 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2001cdac-ef63-4d34-b3b1-a07c924d2ccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b22254d007841f28631d29df3f984b0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:09.145083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae1818-e3d1-431f-9ff9-540e5b490bd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfa7f5a8f7f5448baa4ee68e9590d776, user_id=0d13a5a77a4345cab67dee33ef2c0d2a, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:09.147964 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae1818-e3d1-431f-9ff9-540e5b490bd1 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:09.156642 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2001cdac-ef63-4d34-b3b1-a07c924d2ccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b22254d007841f28631d29df3f984b0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:09.162211 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1341/2689] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:16:09 2022] PUT /identity/v3/projects/bfa7f5a8f7f5448baa4ee68e9590d776/users/0d13a5a77a4345cab67dee33ef2c0d2a/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:09.164624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-2001cdac-ef63-4d34-b3b1-a07c924d2ccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b22254d007841f28631d29df3f984b0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:09.166543 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae1818-e3d1-431f-9ff9-540e5b490bd1 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:09.167246 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:09.168602 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9cae1818-e3d1-431f-9ff9-540e5b490bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:09.172103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1349/2690] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:16:08 2022] DELETE /identity/v3/users/6b22254d007841f28631d29df3f984b0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:16:09.239893 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae1818-e3d1-431f-9ff9-540e5b490bd1 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:09.311022 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192780bf-f120-4746-abe5-51515e861a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:09.312206 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192780bf-f120-4746-abe5-51515e861a7c admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:09.312780 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192780bf-f120-4746-abe5-51515e861a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:09.313288 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192780bf-f120-4746-abe5-51515e861a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:09.314768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192780bf-f120-4746-abe5-51515e861a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:09.317964 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192780bf-f120-4746-abe5-51515e861a7c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:09.330799 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1342/2691] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:16:09.336384 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001cdac-ef63-4d34-b3b1-a07c924d2ccc admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:09.361660 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001cdac-ef63-4d34-b3b1-a07c924d2ccc admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:09.371109 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46beeee2-3802-4215-9815-e49905c647a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:09.372050 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46beeee2-3802-4215-9815-e49905c647a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:09.372333 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46beeee2-3802-4215-9815-e49905c647a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:09.372643 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46beeee2-3802-4215-9815-e49905c647a5 admin admin] PATH_INFO: `/v3/projects/bfa7f5a8f7f5448baa4ee68e9590d776/users/0d13a5a77a4345cab67dee33ef2c0d2a/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:09.374727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46beeee2-3802-4215-9815-e49905c647a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfa7f5a8f7f5448baa4ee68e9590d776, user_id=0d13a5a77a4345cab67dee33ef2c0d2a, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:09.377576 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46beeee2-3802-4215-9815-e49905c647a5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:09.388690 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1350/2692] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:16:09 2022] PUT /identity/v3/projects/bfa7f5a8f7f5448baa4ee68e9590d776/users/0d13a5a77a4345cab67dee33ef2c0d2a/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:09.400469 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8339e-b832-4d14-92e3-41923ea80273 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:09.400760 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8339e-b832-4d14-92e3-41923ea80273 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:09.401043 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8339e-b832-4d14-92e3-41923ea80273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:09.430941 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-68e8339e-b832-4d14-92e3-41923ea80273 None None] MFA Rules not processed for user `0d13a5a77a4345cab67dee33ef2c0d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:09.432192 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-68e8339e-b832-4d14-92e3-41923ea80273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:09.493084 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46beeee2-3802-4215-9815-e49905c647a5 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:09.494777 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-46beeee2-3802-4215-9815-e49905c647a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:09.528299 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1343/2693] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:16:09.539733 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8339e-b832-4d14-92e3-41923ea80273 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:09.541128 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-68e8339e-b832-4d14-92e3-41923ea80273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:09.554729 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:09.585165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46beeee2-3802-4215-9815-e49905c647a5 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:09.590147 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13d629-7f4c-43d4-8ad4-ac3b40c179d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:09.591016 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13d629-7f4c-43d4-8ad4-ac3b40c179d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:09.591297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13d629-7f4c-43d4-8ad4-ac3b40c179d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:09.591578 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13d629-7f4c-43d4-8ad4-ac3b40c179d5 admin admin] PATH_INFO: `/v3/projects/e680dc24669f4ad7b2626606240ebb39` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:09.592785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13d629-7f4c-43d4-8ad4-ac3b40c179d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e680dc24669f4ad7b2626606240ebb39)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:09.594695 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13d629-7f4c-43d4-8ad4-ac3b40c179d5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:09.603279 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8339e-b832-4d14-92e3-41923ea80273 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:09.606926 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796856d-0c55-45be-a49e-a3576df92161 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:09.607575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796856d-0c55-45be-a49e-a3576df92161 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:09.607857 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796856d-0c55-45be-a49e-a3576df92161 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:09.608129 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796856d-0c55-45be-a49e-a3576df92161 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:09.618696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796856d-0c55-45be-a49e-a3576df92161 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:09.620182 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796856d-0c55-45be-a49e-a3576df92161 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:09.631475 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1344/2694] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:16:09.649463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3a13d629-7f4c-43d4-8ad4-ac3b40c179d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e680dc24669f4ad7b2626606240ebb39', 'request_id': 'req-3a13d629-7f4c-43d4-8ad4-ac3b40c179d5'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:09.658725 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3a13d629-7f4c-43d4-8ad4-ac3b40c179d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e680dc24669f4ad7b2626606240ebb39', 'request_id': 'req-3a13d629-7f4c-43d4-8ad4-ac3b40c179d5'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:09.669924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3a13d629-7f4c-43d4-8ad4-ac3b40c179d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e680dc24669f4ad7b2626606240ebb39', 'request_id': 'req-3a13d629-7f4c-43d4-8ad4-ac3b40c179d5'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:09.684326 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3a13d629-7f4c-43d4-8ad4-ac3b40c179d5 admin admin] The token cache is being invalidate because project e680dc24669f4ad7b2626606240ebb39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:16:09.684663 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3a13d629-7f4c-43d4-8ad4-ac3b40c179d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:09.685524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3a13d629-7f4c-43d4-8ad4-ac3b40c179d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:09.687165 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1351/2695] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:16:09 2022] DELETE /identity/v3/projects/e680dc24669f4ad7b2626606240ebb39 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:16:09.691891 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796856d-0c55-45be-a49e-a3576df92161 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:09.703361 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796856d-0c55-45be-a49e-a3576df92161 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:09.706545 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13d629-7f4c-43d4-8ad4-ac3b40c179d5 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:09.707949 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3a13d629-7f4c-43d4-8ad4-ac3b40c179d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:09.777088 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a069a-b05a-49aa-8fd2-1c90a65fc529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:09.778126 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a069a-b05a-49aa-8fd2-1c90a65fc529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:09.778478 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a069a-b05a-49aa-8fd2-1c90a65fc529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:09.778833 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a069a-b05a-49aa-8fd2-1c90a65fc529 admin admin] PATH_INFO: `/v3/users/54ac05800dfe477797793daac920afdf` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:09.780160 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a069a-b05a-49aa-8fd2-1c90a65fc529 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54ac05800dfe477797793daac920afdf)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:09.782715 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a069a-b05a-49aa-8fd2-1c90a65fc529 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:09.783570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13d629-7f4c-43d4-8ad4-ac3b40c179d5 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:09.795382 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662bf73-af8c-4cc7-ab84-d3bd822d43ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:09.796449 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662bf73-af8c-4cc7-ab84-d3bd822d43ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:09.796819 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662bf73-af8c-4cc7-ab84-d3bd822d43ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:09.797158 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662bf73-af8c-4cc7-ab84-d3bd822d43ae admin admin] PATH_INFO: `/v3/users/bcd00e9825b040eeb391cb2e46c1b6d4` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:09.799653 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6662bf73-af8c-4cc7-ab84-d3bd822d43ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcd00e9825b040eeb391cb2e46c1b6d4)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:09.801782 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6662bf73-af8c-4cc7-ab84-d3bd822d43ae admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:09.829349 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:09.850742 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2e4a069a-b05a-49aa-8fd2-1c90a65fc529 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54ac05800dfe477797793daac920afdf'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:09.861652 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2e4a069a-b05a-49aa-8fd2-1c90a65fc529 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54ac05800dfe477797793daac920afdf'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:09.865787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6662bf73-af8c-4cc7-ab84-d3bd822d43ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcd00e9825b040eeb391cb2e46c1b6d4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:09.875141 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6662bf73-af8c-4cc7-ab84-d3bd822d43ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcd00e9825b040eeb391cb2e46c1b6d4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:09.876046 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6662bf73-af8c-4cc7-ab84-d3bd822d43ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcd00e9825b040eeb391cb2e46c1b6d4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:09.883786 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2e4a069a-b05a-49aa-8fd2-1c90a65fc529 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54ac05800dfe477797793daac920afdf'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:09.884868 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2e4a069a-b05a-49aa-8fd2-1c90a65fc529 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54ac05800dfe477797793daac920afdf'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:09.886751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-2e4a069a-b05a-49aa-8fd2-1c90a65fc529 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54ac05800dfe477797793daac920afdf'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:09.895276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6662bf73-af8c-4cc7-ab84-d3bd822d43ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcd00e9825b040eeb391cb2e46c1b6d4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:09.906006 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1345/2696] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:16:09 2022] DELETE /identity/v3/users/54ac05800dfe477797793daac920afdf => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:09.906977 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6662bf73-af8c-4cc7-ab84-d3bd822d43ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcd00e9825b040eeb391cb2e46c1b6d4'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:09.924330 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1352/2697] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:16:09 2022] DELETE /identity/v3/users/bcd00e9825b040eeb391cb2e46c1b6d4 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:16:09.931006 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58ce0b-dcfc-4473-8e5e-e163175c01a1 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:09.931434 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58ce0b-dcfc-4473-8e5e-e163175c01a1 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:09.931853 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58ce0b-dcfc-4473-8e5e-e163175c01a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:09.957149 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-5e58ce0b-dcfc-4473-8e5e-e163175c01a1 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:09.958678 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5e58ce0b-dcfc-4473-8e5e-e163175c01a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:09.998854 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:10.039596 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1346/2698] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:10.059805 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662bf73-af8c-4cc7-ab84-d3bd822d43ae admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:10.061396 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6662bf73-af8c-4cc7-ab84-d3bd822d43ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:10.130918 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662bf73-af8c-4cc7-ab84-d3bd822d43ae admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:10.135891 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c058e-89a7-4943-86bd-044ada51946a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:10.137108 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c058e-89a7-4943-86bd-044ada51946a service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:10.137392 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c058e-89a7-4943-86bd-044ada51946a service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:10.137664 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c058e-89a7-4943-86bd-044ada51946a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:10.147780 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c058e-89a7-4943-86bd-044ada51946a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:10.149247 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c058e-89a7-4943-86bd-044ada51946a service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:10.159784 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1353/2699] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:16:10.257636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58ce0b-dcfc-4473-8e5e-e163175c01a1 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:10.259180 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5e58ce0b-dcfc-4473-8e5e-e163175c01a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:10.272090 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58ce0b-dcfc-4473-8e5e-e163175c01a1 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:10.275770 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660cd4e-14c1-4fb0-aaea-ba8ed535fc15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:10.276453 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660cd4e-14c1-4fb0-aaea-ba8ed535fc15 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:10.276745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660cd4e-14c1-4fb0-aaea-ba8ed535fc15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:10.277023 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660cd4e-14c1-4fb0-aaea-ba8ed535fc15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:10.279062 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-7660cd4e-14c1-4fb0-aaea-ba8ed535fc15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:10.297913 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660cd4e-14c1-4fb0-aaea-ba8ed535fc15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:10.300328 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660cd4e-14c1-4fb0-aaea-ba8ed535fc15 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:10.313398 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1347/2700] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:16:10.317801 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c058e-89a7-4943-86bd-044ada51946a service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:10.322552 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-886c058e-89a7-4943-86bd-044ada51946a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:10.352572 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c058e-89a7-4943-86bd-044ada51946a service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:10.358333 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f8864-11fa-4933-ad8b-f9dda538feba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:10.359318 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f8864-11fa-4933-ad8b-f9dda538feba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:10.359809 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f8864-11fa-4933-ad8b-f9dda538feba admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:10.360104 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f8864-11fa-4933-ad8b-f9dda538feba admin admin] PATH_INFO: `/v3/projects/5e5dbfacdcea4603b5248888f09ee6b9` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:10.362577 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f8864-11fa-4933-ad8b-f9dda538feba admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e5dbfacdcea4603b5248888f09ee6b9)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:10.368450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f8864-11fa-4933-ad8b-f9dda538feba admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:10.439644 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-640f8864-11fa-4933-ad8b-f9dda538feba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e5dbfacdcea4603b5248888f09ee6b9', 'request_id': 'req-640f8864-11fa-4933-ad8b-f9dda538feba'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:10.449404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-640f8864-11fa-4933-ad8b-f9dda538feba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e5dbfacdcea4603b5248888f09ee6b9', 'request_id': 'req-640f8864-11fa-4933-ad8b-f9dda538feba'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:10.456174 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-640f8864-11fa-4933-ad8b-f9dda538feba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e5dbfacdcea4603b5248888f09ee6b9', 'request_id': 'req-640f8864-11fa-4933-ad8b-f9dda538feba'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:10.468172 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-640f8864-11fa-4933-ad8b-f9dda538feba admin admin] The token cache is being invalidate because project 5e5dbfacdcea4603b5248888f09ee6b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:16:10.468562 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-640f8864-11fa-4933-ad8b-f9dda538feba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:10.469171 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-640f8864-11fa-4933-ad8b-f9dda538feba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:10.471466 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1354/2701] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:16:10 2022] DELETE /identity/v3/projects/5e5dbfacdcea4603b5248888f09ee6b9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:10.477448 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3890770-ab68-4474-9608-17fc211d206e None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:10.477809 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3890770-ab68-4474-9608-17fc211d206e None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:10.478028 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3890770-ab68-4474-9608-17fc211d206e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:10.503935 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-f3890770-ab68-4474-9608-17fc211d206e None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:10.505204 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f3890770-ab68-4474-9608-17fc211d206e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:10.510668 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f8864-11fa-4933-ad8b-f9dda538feba admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:10.512981 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-640f8864-11fa-4933-ad8b-f9dda538feba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:10.550556 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:10.591570 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1348/2702] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:10.600987 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064841e7-6a85-4f5a-8442-e5f2a5f242b9 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:10.601712 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064841e7-6a85-4f5a-8442-e5f2a5f242b9 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:10.601712 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064841e7-6a85-4f5a-8442-e5f2a5f242b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:10.604678 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f8864-11fa-4933-ad8b-f9dda538feba admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:10.610321 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68d610-c95a-4e59-a0dc-487ebdba265a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:10.611378 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68d610-c95a-4e59-a0dc-487ebdba265a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:10.612038 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68d610-c95a-4e59-a0dc-487ebdba265a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:10.612211 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68d610-c95a-4e59-a0dc-487ebdba265a admin admin] PATH_INFO: `/v3/projects/dc96270813d7410eac729459ad0231dc` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:10.613483 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68d610-c95a-4e59-a0dc-487ebdba265a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc96270813d7410eac729459ad0231dc)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:10.615393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68d610-c95a-4e59-a0dc-487ebdba265a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:10.625487 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-064841e7-6a85-4f5a-8442-e5f2a5f242b9 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:10.626941 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-064841e7-6a85-4f5a-8442-e5f2a5f242b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:10.644104 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1349/2703] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:16:10.645057 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064841e7-6a85-4f5a-8442-e5f2a5f242b9 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:10.656436 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064841e7-6a85-4f5a-8442-e5f2a5f242b9 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:10.683333 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0b68d610-c95a-4e59-a0dc-487ebdba265a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc96270813d7410eac729459ad0231dc', 'request_id': 'req-0b68d610-c95a-4e59-a0dc-487ebdba265a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:10.694470 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0b68d610-c95a-4e59-a0dc-487ebdba265a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc96270813d7410eac729459ad0231dc', 'request_id': 'req-0b68d610-c95a-4e59-a0dc-487ebdba265a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:10.703477 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0b68d610-c95a-4e59-a0dc-487ebdba265a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc96270813d7410eac729459ad0231dc', 'request_id': 'req-0b68d610-c95a-4e59-a0dc-487ebdba265a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:10.719475 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0b68d610-c95a-4e59-a0dc-487ebdba265a admin admin] The token cache is being invalidate because project dc96270813d7410eac729459ad0231dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:16:10.719846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0b68d610-c95a-4e59-a0dc-487ebdba265a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:10.721764 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-0b68d610-c95a-4e59-a0dc-487ebdba265a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:10.723404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1355/2704] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:16:10 2022] DELETE /identity/v3/projects/dc96270813d7410eac729459ad0231dc => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:10.727404 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68d610-c95a-4e59-a0dc-487ebdba265a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:10.728988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0b68d610-c95a-4e59-a0dc-487ebdba265a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:10.730179 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23e0c5-caf7-41a9-9721-f2b228538367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:10.730866 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23e0c5-caf7-41a9-9721-f2b228538367 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:10.731154 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23e0c5-caf7-41a9-9721-f2b228538367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:10.731435 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23e0c5-caf7-41a9-9721-f2b228538367 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:10.732176 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23e0c5-caf7-41a9-9721-f2b228538367 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:16:10.732525 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23e0c5-caf7-41a9-9721-f2b228538367 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:10.734489 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23e0c5-caf7-41a9-9721-f2b228538367 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:10.742488 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68d610-c95a-4e59-a0dc-487ebdba265a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:10.747538 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898705f-ce5c-4227-a5a5-1cd95030f70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:10.748599 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898705f-ce5c-4227-a5a5-1cd95030f70d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:10.748887 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898705f-ce5c-4227-a5a5-1cd95030f70d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:10.749157 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898705f-ce5c-4227-a5a5-1cd95030f70d admin admin] PATH_INFO: `/v3/users/0d13a5a77a4345cab67dee33ef2c0d2a` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:10.755192 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1350/2705] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:16:10.755429 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898705f-ce5c-4227-a5a5-1cd95030f70d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d13a5a77a4345cab67dee33ef2c0d2a)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:10.755429 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898705f-ce5c-4227-a5a5-1cd95030f70d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:10.756342 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23e0c5-caf7-41a9-9721-f2b228538367 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:10.758153 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ff23e0c5-caf7-41a9-9721-f2b228538367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:10.773326 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23e0c5-caf7-41a9-9721-f2b228538367 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:10.778433 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854ee0a-3491-4ebc-abab-5dacb2db9e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:10.779155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854ee0a-3491-4ebc-abab-5dacb2db9e94 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:10.779386 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854ee0a-3491-4ebc-abab-5dacb2db9e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:10.779800 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854ee0a-3491-4ebc-abab-5dacb2db9e94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:10.780533 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854ee0a-3491-4ebc-abab-5dacb2db9e94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:10.782473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854ee0a-3491-4ebc-abab-5dacb2db9e94 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:10.812172 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d898705f-ce5c-4227-a5a5-1cd95030f70d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d13a5a77a4345cab67dee33ef2c0d2a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:10.815744 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1351/2706] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:16:10 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:16:10.819628 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854ee0a-3491-4ebc-abab-5dacb2db9e94 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:10.820826 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d898705f-ce5c-4227-a5a5-1cd95030f70d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d13a5a77a4345cab67dee33ef2c0d2a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:10.821596 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d898705f-ce5c-4227-a5a5-1cd95030f70d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d13a5a77a4345cab67dee33ef2c0d2a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:10.854951 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d898705f-ce5c-4227-a5a5-1cd95030f70d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d13a5a77a4345cab67dee33ef2c0d2a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:10.874057 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:10.877776 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d898705f-ce5c-4227-a5a5-1cd95030f70d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d13a5a77a4345cab67dee33ef2c0d2a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:10.894456 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1356/2707] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:16:10 2022] DELETE /identity/v3/users/0d13a5a77a4345cab67dee33ef2c0d2a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:16:10.914225 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854ee0a-3491-4ebc-abab-5dacb2db9e94 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:10.989929 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592049c-8dc6-4dc6-b2a2-b850315d7e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:10.990627 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592049c-8dc6-4dc6-b2a2-b850315d7e47 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:10.991054 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592049c-8dc6-4dc6-b2a2-b850315d7e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:10.991350 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592049c-8dc6-4dc6-b2a2-b850315d7e47 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:10.992077 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592049c-8dc6-4dc6-b2a2-b850315d7e47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:10.994029 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592049c-8dc6-4dc6-b2a2-b850315d7e47 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:11.024587 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1352/2708] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:16:10 2022] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:16:11.027862 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898705f-ce5c-4227-a5a5-1cd95030f70d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:11.029513 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d898705f-ce5c-4227-a5a5-1cd95030f70d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:11.045069 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898705f-ce5c-4227-a5a5-1cd95030f70d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:11.051242 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015c151-52c1-4a35-b8de-fdadae56024c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:11.052006 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015c151-52c1-4a35-b8de-fdadae56024c admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:11.052481 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015c151-52c1-4a35-b8de-fdadae56024c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:11.052919 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015c151-52c1-4a35-b8de-fdadae56024c admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:11.054707 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015c151-52c1-4a35-b8de-fdadae56024c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:11.056052 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015c151-52c1-4a35-b8de-fdadae56024c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:11.075775 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1357/2709] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:16:11.077487 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592049c-8dc6-4dc6-b2a2-b850315d7e47 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:11.089119 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592049c-8dc6-4dc6-b2a2-b850315d7e47 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:11.096068 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896dbbf-1007-4e53-9417-1280000e9ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:11.096792 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896dbbf-1007-4e53-9417-1280000e9ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:11.097085 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896dbbf-1007-4e53-9417-1280000e9ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:11.097369 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896dbbf-1007-4e53-9417-1280000e9ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:11.098150 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896dbbf-1007-4e53-9417-1280000e9ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:11.099733 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896dbbf-1007-4e53-9417-1280000e9ab0 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:11.112068 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1353/2710] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:16:11.117415 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015c151-52c1-4a35-b8de-fdadae56024c admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:11.129304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015c151-52c1-4a35-b8de-fdadae56024c admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:11.135556 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99afa7e-06ae-4775-8bf4-4f0fe9d3e8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:11.136869 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99afa7e-06ae-4775-8bf4-4f0fe9d3e8b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:11.136869 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99afa7e-06ae-4775-8bf4-4f0fe9d3e8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:11.136869 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99afa7e-06ae-4775-8bf4-4f0fe9d3e8b2 admin admin] PATH_INFO: `/v3/projects/d167a9e8151c43c1a9e74630c2b627fc/users/d06feb3d88cb4461bd1d0a2ddb87fd66/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:11.149763 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:11.154011 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99afa7e-06ae-4775-8bf4-4f0fe9d3e8b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d167a9e8151c43c1a9e74630c2b627fc, user_id=d06feb3d88cb4461bd1d0a2ddb87fd66, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:11.157466 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99afa7e-06ae-4775-8bf4-4f0fe9d3e8b2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:11.186571 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1358/2711] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:16:11 2022] PUT /identity/v3/projects/d167a9e8151c43c1a9e74630c2b627fc/users/d06feb3d88cb4461bd1d0a2ddb87fd66/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:11.200500 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e70f4b-aca6-4c90-841f-334a8afb7850 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:11.200811 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e70f4b-aca6-4c90-841f-334a8afb7850 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:11.201263 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e70f4b-aca6-4c90-841f-334a8afb7850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:11.251710 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-02e70f4b-aca6-4c90-841f-334a8afb7850 None None] MFA Rules not processed for user `d06feb3d88cb4461bd1d0a2ddb87fd66`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:11.252980 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-02e70f4b-aca6-4c90-841f-334a8afb7850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:11.257755 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99afa7e-06ae-4775-8bf4-4f0fe9d3e8b2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:11.259664 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e99afa7e-06ae-4775-8bf4-4f0fe9d3e8b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:11.339858 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99afa7e-06ae-4775-8bf4-4f0fe9d3e8b2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:11.344957 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f19e85-ff2e-4e0b-832b-98e4d5791526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:11.345888 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f19e85-ff2e-4e0b-832b-98e4d5791526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:11.346177 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f19e85-ff2e-4e0b-832b-98e4d5791526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:11.346513 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f19e85-ff2e-4e0b-832b-98e4d5791526 admin admin] PATH_INFO: `/v3/projects/bfa7f5a8f7f5448baa4ee68e9590d776` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:11.347783 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f19e85-ff2e-4e0b-832b-98e4d5791526 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfa7f5a8f7f5448baa4ee68e9590d776)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:11.349849 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f19e85-ff2e-4e0b-832b-98e4d5791526 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:11.371491 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1354/2712] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:11.384560 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e70f4b-aca6-4c90-841f-334a8afb7850 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:11.387235 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-02e70f4b-aca6-4c90-841f-334a8afb7850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:11.410968 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-16f19e85-ff2e-4e0b-832b-98e4d5791526 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfa7f5a8f7f5448baa4ee68e9590d776', 'request_id': 'req-16f19e85-ff2e-4e0b-832b-98e4d5791526'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:11.421921 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-16f19e85-ff2e-4e0b-832b-98e4d5791526 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfa7f5a8f7f5448baa4ee68e9590d776', 'request_id': 'req-16f19e85-ff2e-4e0b-832b-98e4d5791526'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:11.429603 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-16f19e85-ff2e-4e0b-832b-98e4d5791526 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfa7f5a8f7f5448baa4ee68e9590d776', 'request_id': 'req-16f19e85-ff2e-4e0b-832b-98e4d5791526'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:11.445430 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-16f19e85-ff2e-4e0b-832b-98e4d5791526 admin admin] The token cache is being invalidate because project bfa7f5a8f7f5448baa4ee68e9590d776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:16:11.445810 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-16f19e85-ff2e-4e0b-832b-98e4d5791526 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:11.446423 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-16f19e85-ff2e-4e0b-832b-98e4d5791526 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:11.447327 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:11.448214 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1359/2713] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:16:11 2022] DELETE /identity/v3/projects/bfa7f5a8f7f5448baa4ee68e9590d776 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:11.453369 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26c4ab-0a6e-49d6-a256-91016d6b8fb4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:11.453780 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26c4ab-0a6e-49d6-a256-91016d6b8fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:11.454150 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26c4ab-0a6e-49d6-a256-91016d6b8fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:11.463503 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e70f4b-aca6-4c90-841f-334a8afb7850 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:11.475916 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-ff26c4ab-0a6e-49d6-a256-91016d6b8fb4 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:11.477195 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-ff26c4ab-0a6e-49d6-a256-91016d6b8fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:11.524798 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337dbf8-58f2-4f14-97c8-83cabc926b89 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf64f4ec145742d78eee6c4a447515dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:11.525640 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337dbf8-58f2-4f14-97c8-83cabc926b89 service glance] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:11.525825 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337dbf8-58f2-4f14-97c8-83cabc926b89 service glance] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:11.526120 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337dbf8-58f2-4f14-97c8-83cabc926b89 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:11.528048 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b337dbf8-58f2-4f14-97c8-83cabc926b89 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:11.567075 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1360/2714] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:11.574756 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71b34a-148a-410c-9210-1e056f1c5bf1 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:11.575044 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71b34a-148a-410c-9210-1e056f1c5bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:11.575390 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71b34a-148a-410c-9210-1e056f1c5bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:11.597722 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-0e71b34a-148a-410c-9210-1e056f1c5bf1 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:11.598372 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337dbf8-58f2-4f14-97c8-83cabc926b89 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:11.598841 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0e71b34a-148a-410c-9210-1e056f1c5bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:11.599843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337dbf8-58f2-4f14-97c8-83cabc926b89 service glance] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:11.608223 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1361/2715] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:11.611969 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1355/2716] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:16:11.612765 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71b34a-148a-410c-9210-1e056f1c5bf1 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:11.632732 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71b34a-148a-410c-9210-1e056f1c5bf1 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:11.639448 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97ab16-92f2-412c-b6d3-df7f5295fdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:11.640502 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97ab16-92f2-412c-b6d3-df7f5295fdb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:11.640637 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97ab16-92f2-412c-b6d3-df7f5295fdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:11.640894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97ab16-92f2-412c-b6d3-df7f5295fdb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:11.641727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97ab16-92f2-412c-b6d3-df7f5295fdb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:16:11.642074 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97ab16-92f2-412c-b6d3-df7f5295fdb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:11.643849 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97ab16-92f2-412c-b6d3-df7f5295fdb6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:11.656723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:11.665098 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1362/2717] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 22:16:11.672633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337dbf8-58f2-4f14-97c8-83cabc926b89 service glance] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:11.686625 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337dbf8-58f2-4f14-97c8-83cabc926b89 service glance] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:11.697633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ddd3b-c2e6-42b2-8bad-0134e73c8329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:11.698318 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ddd3b-c2e6-42b2-8bad-0134e73c8329 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:11.698605 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ddd3b-c2e6-42b2-8bad-0134e73c8329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:11.698857 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ddd3b-c2e6-42b2-8bad-0134e73c8329 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:11.699574 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ddd3b-c2e6-42b2-8bad-0134e73c8329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:11.701670 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ddd3b-c2e6-42b2-8bad-0134e73c8329 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:11.739916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1356/2718] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:16:11 2022] POST /identity/v3/projects => generated 389 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:16:11.741057 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97ab16-92f2-412c-b6d3-df7f5295fdb6 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:11.758194 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97ab16-92f2-412c-b6d3-df7f5295fdb6 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:11.822190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e5ea3-4bd6-4377-9f63-1043fb2065dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:11.822871 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e5ea3-4bd6-4377-9f63-1043fb2065dd admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:11.823156 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e5ea3-4bd6-4377-9f63-1043fb2065dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:11.823434 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e5ea3-4bd6-4377-9f63-1043fb2065dd admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:11.824158 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e5ea3-4bd6-4377-9f63-1043fb2065dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:11.826472 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e5ea3-4bd6-4377-9f63-1043fb2065dd admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:11.852542 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1363/2719] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:16:11 2022] POST /identity/v3/users => generated 295 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:16:11.853637 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ddd3b-c2e6-42b2-8bad-0134e73c8329 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:11.864359 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ddd3b-c2e6-42b2-8bad-0134e73c8329 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:11.869160 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667bdcc-5883-4ce7-a69d-ca2e7c3e0f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:11.869834 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667bdcc-5883-4ce7-a69d-ca2e7c3e0f9e admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:11.870118 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667bdcc-5883-4ce7-a69d-ca2e7c3e0f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:11.870404 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667bdcc-5883-4ce7-a69d-ca2e7c3e0f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:11.871136 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667bdcc-5883-4ce7-a69d-ca2e7c3e0f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:11.872775 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667bdcc-5883-4ce7-a69d-ca2e7c3e0f9e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:11.885673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1357/2720] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:16:11.889572 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e5ea3-4bd6-4377-9f63-1043fb2065dd admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:11.905578 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e5ea3-4bd6-4377-9f63-1043fb2065dd admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:11.907063 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f5704-6e33-4d52-9050-0f95174165bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:11.907994 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f5704-6e33-4d52-9050-0f95174165bd admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:11.908354 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f5704-6e33-4d52-9050-0f95174165bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:11.908803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f5704-6e33-4d52-9050-0f95174165bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:11.909653 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f5704-6e33-4d52-9050-0f95174165bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:11.911383 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f5704-6e33-4d52-9050-0f95174165bd admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:11.933957 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1364/2721] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:16:11.938304 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667bdcc-5883-4ce7-a69d-ca2e7c3e0f9e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:11.952238 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667bdcc-5883-4ce7-a69d-ca2e7c3e0f9e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:11.959572 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b2a43-8fe4-4cba-8662-ab8911113930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:11.960635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b2a43-8fe4-4cba-8662-ab8911113930 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:11.961200 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b2a43-8fe4-4cba-8662-ab8911113930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:11.961501 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b2a43-8fe4-4cba-8662-ab8911113930 admin admin] PATH_INFO: `/v3/projects/951fcaa9ae6c4685872ccf0518fadaad/users/294390e60aac475a82a9f487ddc35ece/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:11.984226 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b2a43-8fe4-4cba-8662-ab8911113930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=951fcaa9ae6c4685872ccf0518fadaad, user_id=294390e60aac475a82a9f487ddc35ece, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:11.987611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b2a43-8fe4-4cba-8662-ab8911113930 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:12.011068 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1358/2722] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:16:11 2022] PUT /identity/v3/projects/951fcaa9ae6c4685872ccf0518fadaad/users/294390e60aac475a82a9f487ddc35ece/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:12.022954 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03adc8-f705-4ef2-a79e-7adddc3e258d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:12.023968 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03adc8-f705-4ef2-a79e-7adddc3e258d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:12.026348 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03adc8-f705-4ef2-a79e-7adddc3e258d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:12.068988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-9e03adc8-f705-4ef2-a79e-7adddc3e258d None None] MFA Rules not processed for user `294390e60aac475a82a9f487ddc35ece`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:12.070741 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9e03adc8-f705-4ef2-a79e-7adddc3e258d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:12.165758 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1365/2723] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:12.170444 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b2a43-8fe4-4cba-8662-ab8911113930 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:12.246137 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:12.258533 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b2a43-8fe4-4cba-8662-ab8911113930 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:12.264233 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704bcd6-e08e-48d7-9c2a-b50569872280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:12.265279 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704bcd6-e08e-48d7-9c2a-b50569872280 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:12.265569 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704bcd6-e08e-48d7-9c2a-b50569872280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:12.265846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704bcd6-e08e-48d7-9c2a-b50569872280 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:12.266784 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704bcd6-e08e-48d7-9c2a-b50569872280 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:12.270489 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704bcd6-e08e-48d7-9c2a-b50569872280 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:12.300477 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1359/2724] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:16:12 2022] POST /identity/v3/projects => generated 387 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:16:12.303924 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03adc8-f705-4ef2-a79e-7adddc3e258d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:12.316250 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03adc8-f705-4ef2-a79e-7adddc3e258d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:12.405312 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38527332-18b5-4ca4-bc4a-0734103e9ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:12.406132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38527332-18b5-4ca4-bc4a-0734103e9ec4 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:12.406382 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38527332-18b5-4ca4-bc4a-0734103e9ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:12.406698 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38527332-18b5-4ca4-bc4a-0734103e9ec4 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:12.407427 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38527332-18b5-4ca4-bc4a-0734103e9ec4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:12.409929 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38527332-18b5-4ca4-bc4a-0734103e9ec4 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:12.428917 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:12.444493 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1366/2725] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:16:12 2022] POST /identity/v3/users => generated 300 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:16:12.449593 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704bcd6-e08e-48d7-9c2a-b50569872280 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:12.461386 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704bcd6-e08e-48d7-9c2a-b50569872280 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:12.467472 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62ce1e-2ea3-454f-82af-e7d5a7a51d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:12.468251 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62ce1e-2ea3-454f-82af-e7d5a7a51d8a admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:12.468594 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62ce1e-2ea3-454f-82af-e7d5a7a51d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:12.468976 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62ce1e-2ea3-454f-82af-e7d5a7a51d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:12.470382 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62ce1e-2ea3-454f-82af-e7d5a7a51d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:12.472238 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62ce1e-2ea3-454f-82af-e7d5a7a51d8a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:12.486500 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1360/2726] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:16:12.490749 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38527332-18b5-4ca4-bc4a-0734103e9ec4 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:12.502555 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38527332-18b5-4ca4-bc4a-0734103e9ec4 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:12.507596 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e191d09-128f-43d2-b38e-1a2ca1db5fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:12.508547 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e191d09-128f-43d2-b38e-1a2ca1db5fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:12.508832 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e191d09-128f-43d2-b38e-1a2ca1db5fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:12.509126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e191d09-128f-43d2-b38e-1a2ca1db5fc5 admin admin] PATH_INFO: `/v3/projects/5fab669f82a94dc4b7644ec669c6738e/users/742b466eee794d4fba4a0bcc9884c7a8/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:12.533873 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e191d09-128f-43d2-b38e-1a2ca1db5fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fab669f82a94dc4b7644ec669c6738e, user_id=742b466eee794d4fba4a0bcc9884c7a8, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:12.536676 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e191d09-128f-43d2-b38e-1a2ca1db5fc5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:12.551202 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1367/2727] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:16:12 2022] PUT /identity/v3/projects/5fab669f82a94dc4b7644ec669c6738e/users/742b466eee794d4fba4a0bcc9884c7a8/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:12.555806 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62ce1e-2ea3-454f-82af-e7d5a7a51d8a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:12.572189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62ce1e-2ea3-454f-82af-e7d5a7a51d8a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:12.692880 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf4870-ecf9-44c5-9349-23eed2036b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:12.693925 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf4870-ecf9-44c5-9349-23eed2036b4f admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:12.694214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf4870-ecf9-44c5-9349-23eed2036b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:12.694493 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf4870-ecf9-44c5-9349-23eed2036b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:12.695239 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf4870-ecf9-44c5-9349-23eed2036b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:12.696900 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf4870-ecf9-44c5-9349-23eed2036b4f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:12.708653 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1361/2728] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:16:12.712612 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e191d09-128f-43d2-b38e-1a2ca1db5fc5 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:12.726002 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e191d09-128f-43d2-b38e-1a2ca1db5fc5 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:12.734513 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b33693-a015-4d9b-aa97-d7c0c2ef3401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:12.749213 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b33693-a015-4d9b-aa97-d7c0c2ef3401 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:12.749582 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b33693-a015-4d9b-aa97-d7c0c2ef3401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:12.749937 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b33693-a015-4d9b-aa97-d7c0c2ef3401 admin admin] PATH_INFO: `/v3/projects/5fab669f82a94dc4b7644ec669c6738e/users/742b466eee794d4fba4a0bcc9884c7a8/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:12.752848 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b33693-a015-4d9b-aa97-d7c0c2ef3401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fab669f82a94dc4b7644ec669c6738e, user_id=742b466eee794d4fba4a0bcc9884c7a8, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:12.755640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b33693-a015-4d9b-aa97-d7c0c2ef3401 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:12.768137 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1368/2729] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:16:12 2022] PUT /identity/v3/projects/5fab669f82a94dc4b7644ec669c6738e/users/742b466eee794d4fba4a0bcc9884c7a8/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:12.780170 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d9c80-c755-4c21-9a26-1f67ddc09aa3 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:12.780508 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d9c80-c755-4c21-9a26-1f67ddc09aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:12.780922 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d9c80-c755-4c21-9a26-1f67ddc09aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:12.841267 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6f8d9c80-c755-4c21-9a26-1f67ddc09aa3 None None] MFA Rules not processed for user `742b466eee794d4fba4a0bcc9884c7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:12.842595 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6f8d9c80-c755-4c21-9a26-1f67ddc09aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:12.957546 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1362/2730] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:12.968362 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b33693-a015-4d9b-aa97-d7c0c2ef3401 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:12.970841 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a8b33693-a015-4d9b-aa97-d7c0c2ef3401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:13.043122 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b33693-a015-4d9b-aa97-d7c0c2ef3401 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:13.052080 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd558e-3cf8-49a4-abc1-926a3e5f5540 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:13.053150 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd558e-3cf8-49a4-abc1-926a3e5f5540 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:13.053594 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd558e-3cf8-49a4-abc1-926a3e5f5540 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:13.054055 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd558e-3cf8-49a4-abc1-926a3e5f5540 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:13.069479 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd558e-3cf8-49a4-abc1-926a3e5f5540 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:13.071009 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd558e-3cf8-49a4-abc1-926a3e5f5540 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:13.081942 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1369/2731] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:16:13.274216 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d9c80-c755-4c21-9a26-1f67ddc09aa3 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:13.354461 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:13.373296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d9c80-c755-4c21-9a26-1f67ddc09aa3 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:13.378835 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913a2e2-44e3-4d2f-97ac-94c7d21d17a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:13.380022 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913a2e2-44e3-4d2f-97ac-94c7d21d17a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:13.380303 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913a2e2-44e3-4d2f-97ac-94c7d21d17a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:13.380611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913a2e2-44e3-4d2f-97ac-94c7d21d17a7 admin admin] PATH_INFO: `/v3/users/294390e60aac475a82a9f487ddc35ece` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:13.381859 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913a2e2-44e3-4d2f-97ac-94c7d21d17a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=294390e60aac475a82a9f487ddc35ece)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:13.383793 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913a2e2-44e3-4d2f-97ac-94c7d21d17a7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:13.439621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8913a2e2-44e3-4d2f-97ac-94c7d21d17a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '294390e60aac475a82a9f487ddc35ece'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:13.447900 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8913a2e2-44e3-4d2f-97ac-94c7d21d17a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '294390e60aac475a82a9f487ddc35ece'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:13.461692 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8913a2e2-44e3-4d2f-97ac-94c7d21d17a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '294390e60aac475a82a9f487ddc35ece'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:13.462430 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8913a2e2-44e3-4d2f-97ac-94c7d21d17a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '294390e60aac475a82a9f487ddc35ece'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:13.463027 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-8913a2e2-44e3-4d2f-97ac-94c7d21d17a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '294390e60aac475a82a9f487ddc35ece'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:13.477127 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1363/2732] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:16:13 2022] DELETE /identity/v3/users/294390e60aac475a82a9f487ddc35ece => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:13.481591 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69153a38-3d31-47c1-a0c1-7a26fb586e0e None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:13.482068 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69153a38-3d31-47c1-a0c1-7a26fb586e0e None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:13.482188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69153a38-3d31-47c1-a0c1-7a26fb586e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:13.501059 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-69153a38-3d31-47c1-a0c1-7a26fb586e0e None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:13.502919 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-69153a38-3d31-47c1-a0c1-7a26fb586e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:13.573366 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1370/2733] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:13.584006 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913a2e2-44e3-4d2f-97ac-94c7d21d17a7 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:13.585591 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8913a2e2-44e3-4d2f-97ac-94c7d21d17a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:13.672181 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913a2e2-44e3-4d2f-97ac-94c7d21d17a7 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:13.679768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff8d51-1b2d-4c91-b906-8d80460052c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:13.681039 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff8d51-1b2d-4c91-b906-8d80460052c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:13.681524 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff8d51-1b2d-4c91-b906-8d80460052c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:13.681993 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff8d51-1b2d-4c91-b906-8d80460052c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:13.695489 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff8d51-1b2d-4c91-b906-8d80460052c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:13.697191 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff8d51-1b2d-4c91-b906-8d80460052c2 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:13.709207 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1364/2734] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:16:14.582299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69153a38-3d31-47c1-a0c1-7a26fb586e0e None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:14.583528 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-69153a38-3d31-47c1-a0c1-7a26fb586e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:14.602721 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69153a38-3d31-47c1-a0c1-7a26fb586e0e None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:14.607523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adec2e-023e-45ee-a440-e09c64a91e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:14.608848 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adec2e-023e-45ee-a440-e09c64a91e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:14.608970 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adec2e-023e-45ee-a440-e09c64a91e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:14.609233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adec2e-023e-45ee-a440-e09c64a91e02 admin admin] PATH_INFO: `/v3/projects/951fcaa9ae6c4685872ccf0518fadaad` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:14.611435 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82adec2e-023e-45ee-a440-e09c64a91e02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=951fcaa9ae6c4685872ccf0518fadaad)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:14.614136 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82adec2e-023e-45ee-a440-e09c64a91e02 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:14.699330 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-82adec2e-023e-45ee-a440-e09c64a91e02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '951fcaa9ae6c4685872ccf0518fadaad', 'request_id': 'req-82adec2e-023e-45ee-a440-e09c64a91e02'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:14.708796 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-82adec2e-023e-45ee-a440-e09c64a91e02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '951fcaa9ae6c4685872ccf0518fadaad', 'request_id': 'req-82adec2e-023e-45ee-a440-e09c64a91e02'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:14.711097 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:14.716042 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-82adec2e-023e-45ee-a440-e09c64a91e02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '951fcaa9ae6c4685872ccf0518fadaad', 'request_id': 'req-82adec2e-023e-45ee-a440-e09c64a91e02'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:14.741478 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-82adec2e-023e-45ee-a440-e09c64a91e02 admin admin] The token cache is being invalidate because project 951fcaa9ae6c4685872ccf0518fadaad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:16:14.741478 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-82adec2e-023e-45ee-a440-e09c64a91e02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:14.742130 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-82adec2e-023e-45ee-a440-e09c64a91e02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:14.744122 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1371/2735] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:16:14 2022] DELETE /identity/v3/projects/951fcaa9ae6c4685872ccf0518fadaad => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:14.748135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff8d51-1b2d-4c91-b906-8d80460052c2 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:14.761092 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff8d51-1b2d-4c91-b906-8d80460052c2 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:14.826542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20365ab5-3e03-4e69-8b9c-a2ef9b8dd8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:14.827755 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20365ab5-3e03-4e69-8b9c-a2ef9b8dd8bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:14.827755 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20365ab5-3e03-4e69-8b9c-a2ef9b8dd8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:14.828130 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20365ab5-3e03-4e69-8b9c-a2ef9b8dd8bc admin admin] PATH_INFO: `/v3/users/742b466eee794d4fba4a0bcc9884c7a8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:14.829872 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20365ab5-3e03-4e69-8b9c-a2ef9b8dd8bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=742b466eee794d4fba4a0bcc9884c7a8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:14.833109 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20365ab5-3e03-4e69-8b9c-a2ef9b8dd8bc admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:14.849857 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:14.892514 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-20365ab5-3e03-4e69-8b9c-a2ef9b8dd8bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '742b466eee794d4fba4a0bcc9884c7a8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:14.908301 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-20365ab5-3e03-4e69-8b9c-a2ef9b8dd8bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '742b466eee794d4fba4a0bcc9884c7a8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:14.921327 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-20365ab5-3e03-4e69-8b9c-a2ef9b8dd8bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '742b466eee794d4fba4a0bcc9884c7a8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:14.921565 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-20365ab5-3e03-4e69-8b9c-a2ef9b8dd8bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '742b466eee794d4fba4a0bcc9884c7a8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:14.922073 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-20365ab5-3e03-4e69-8b9c-a2ef9b8dd8bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '742b466eee794d4fba4a0bcc9884c7a8'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:14.935918 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1365/2736] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:16:14 2022] DELETE /identity/v3/users/742b466eee794d4fba4a0bcc9884c7a8 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:15.222254 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adec2e-023e-45ee-a440-e09c64a91e02 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:15.223766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-82adec2e-023e-45ee-a440-e09c64a91e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:15.238525 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adec2e-023e-45ee-a440-e09c64a91e02 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:15.306751 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcafb2-876f-4542-be3b-c6b6c7cfd82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:15.307536 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcafb2-876f-4542-be3b-c6b6c7cfd82e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:15.307823 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcafb2-876f-4542-be3b-c6b6c7cfd82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:15.308098 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcafb2-876f-4542-be3b-c6b6c7cfd82e admin admin] PATH_INFO: `/v3/projects/5fab669f82a94dc4b7644ec669c6738e` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:15.309325 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcafb2-876f-4542-be3b-c6b6c7cfd82e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fab669f82a94dc4b7644ec669c6738e)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:15.311245 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcafb2-876f-4542-be3b-c6b6c7cfd82e admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:15.368865 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e7dcafb2-876f-4542-be3b-c6b6c7cfd82e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fab669f82a94dc4b7644ec669c6738e', 'request_id': 'req-e7dcafb2-876f-4542-be3b-c6b6c7cfd82e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:15.374183 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e7dcafb2-876f-4542-be3b-c6b6c7cfd82e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fab669f82a94dc4b7644ec669c6738e', 'request_id': 'req-e7dcafb2-876f-4542-be3b-c6b6c7cfd82e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:15.380521 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e7dcafb2-876f-4542-be3b-c6b6c7cfd82e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fab669f82a94dc4b7644ec669c6738e', 'request_id': 'req-e7dcafb2-876f-4542-be3b-c6b6c7cfd82e'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:15.405995 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e7dcafb2-876f-4542-be3b-c6b6c7cfd82e admin admin] The token cache is being invalidate because project 5fab669f82a94dc4b7644ec669c6738e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:16:15.406280 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e7dcafb2-876f-4542-be3b-c6b6c7cfd82e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:15.406944 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-e7dcafb2-876f-4542-be3b-c6b6c7cfd82e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:15.409481 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1372/2737] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:16:15 2022] DELETE /identity/v3/projects/5fab669f82a94dc4b7644ec669c6738e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:16:15.414675 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513d80a-9db3-4a9b-9c71-6fdacb854dd5 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:15.414975 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513d80a-9db3-4a9b-9c71-6fdacb854dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:15.415255 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513d80a-9db3-4a9b-9c71-6fdacb854dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:15.434134 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-2513d80a-9db3-4a9b-9c71-6fdacb854dd5 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:15.435306 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2513d80a-9db3-4a9b-9c71-6fdacb854dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:15.500745 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1366/2738] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:15.509174 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1199a87-d0aa-418e-a1cd-083f86bf22ea None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:15.509578 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1199a87-d0aa-418e-a1cd-083f86bf22ea None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:15.509755 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1199a87-d0aa-418e-a1cd-083f86bf22ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:15.529066 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-f1199a87-d0aa-418e-a1cd-083f86bf22ea None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:15.530268 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f1199a87-d0aa-418e-a1cd-083f86bf22ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:15.538196 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1373/2739] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:15.542437 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513d80a-9db3-4a9b-9c71-6fdacb854dd5 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:15.552758 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513d80a-9db3-4a9b-9c71-6fdacb854dd5 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:15.557565 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217905e-31ff-42bc-b990-c2525f53f587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:15.558166 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217905e-31ff-42bc-b990-c2525f53f587 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:15.558448 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217905e-31ff-42bc-b990-c2525f53f587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:15.558724 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217905e-31ff-42bc-b990-c2525f53f587 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:15.559455 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217905e-31ff-42bc-b990-c2525f53f587 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:16:15.559764 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217905e-31ff-42bc-b990-c2525f53f587 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:15.561417 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217905e-31ff-42bc-b990-c2525f53f587 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:15.574396 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1367/2740] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:16:15.578762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1199a87-d0aa-418e-a1cd-083f86bf22ea None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:15.590392 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1199a87-d0aa-418e-a1cd-083f86bf22ea None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:15.596226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9c9c0-adb1-4f47-a1c0-cc85f1a2aee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:15.597209 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9c9c0-adb1-4f47-a1c0-cc85f1a2aee5 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:15.597538 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9c9c0-adb1-4f47-a1c0-cc85f1a2aee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:15.597809 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9c9c0-adb1-4f47-a1c0-cc85f1a2aee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:15.598549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9c9c0-adb1-4f47-a1c0-cc85f1a2aee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:15.600579 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9c9c0-adb1-4f47-a1c0-cc85f1a2aee5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:15.627418 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1374/2741] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:16:15 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:16:15.631672 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217905e-31ff-42bc-b990-c2525f53f587 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:15.642609 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217905e-31ff-42bc-b990-c2525f53f587 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:15.705202 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab942d6-39de-49a6-84a0-c03f90a40a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:15.706004 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab942d6-39de-49a6-84a0-c03f90a40a51 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:15.706288 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab942d6-39de-49a6-84a0-c03f90a40a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:15.706561 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab942d6-39de-49a6-84a0-c03f90a40a51 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:15.707276 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab942d6-39de-49a6-84a0-c03f90a40a51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:15.709291 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab942d6-39de-49a6-84a0-c03f90a40a51 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:15.735037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1368/2742] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:16:15 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:16:15.739091 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9c9c0-adb1-4f47-a1c0-cc85f1a2aee5 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:15.753489 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9c9c0-adb1-4f47-a1c0-cc85f1a2aee5 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:15.759695 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586bd33-8c22-4f4f-ba5b-3d4f02d94ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:15.760736 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586bd33-8c22-4f4f-ba5b-3d4f02d94ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:15.761130 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586bd33-8c22-4f4f-ba5b-3d4f02d94ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:15.761130 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586bd33-8c22-4f4f-ba5b-3d4f02d94ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:15.761931 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586bd33-8c22-4f4f-ba5b-3d4f02d94ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:15.763607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586bd33-8c22-4f4f-ba5b-3d4f02d94ff8 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:15.776525 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1375/2743] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:16:15.780459 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab942d6-39de-49a6-84a0-c03f90a40a51 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:15.790837 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab942d6-39de-49a6-84a0-c03f90a40a51 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:15.795669 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46961a-c9db-40cf-bc41-e0023f2d45af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:15.796351 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46961a-c9db-40cf-bc41-e0023f2d45af admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:15.796686 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46961a-c9db-40cf-bc41-e0023f2d45af admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:15.796966 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46961a-c9db-40cf-bc41-e0023f2d45af admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:15.797710 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46961a-c9db-40cf-bc41-e0023f2d45af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:15.800391 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46961a-c9db-40cf-bc41-e0023f2d45af admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:15.802800 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:15.815262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1369/2744] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:16:15.818728 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586bd33-8c22-4f4f-ba5b-3d4f02d94ff8 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:15.829292 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586bd33-8c22-4f4f-ba5b-3d4f02d94ff8 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:15.834461 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa852e-a713-49fb-ac80-14332095e47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:15.835498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa852e-a713-49fb-ac80-14332095e47f admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:15.835632 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa852e-a713-49fb-ac80-14332095e47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:15.835880 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa852e-a713-49fb-ac80-14332095e47f admin admin] PATH_INFO: `/v3/projects/99204eb0fae04724a167957f87168977/users/3db61e00dc494c53b6a0ff1459396eeb/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:15.851675 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa852e-a713-49fb-ac80-14332095e47f admin admin] RBAC: Authorizing `identity:create_grant(project_id=99204eb0fae04724a167957f87168977, user_id=3db61e00dc494c53b6a0ff1459396eeb, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:15.854357 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa852e-a713-49fb-ac80-14332095e47f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:15.875552 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1376/2745] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:16:15 2022] PUT /identity/v3/projects/99204eb0fae04724a167957f87168977/users/3db61e00dc494c53b6a0ff1459396eeb/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:16:15.887688 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce884d-6903-440d-bec9-c0785bc9bfad None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:15.887978 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce884d-6903-440d-bec9-c0785bc9bfad None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:15.888260 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce884d-6903-440d-bec9-c0785bc9bfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:15.917293 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b0ce884d-6903-440d-bec9-c0785bc9bfad None None] MFA Rules not processed for user `3db61e00dc494c53b6a0ff1459396eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:15.918738 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b0ce884d-6903-440d-bec9-c0785bc9bfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:15.994607 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1370/2746] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:16.005901 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa852e-a713-49fb-ac80-14332095e47f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:16.007690 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e4aa852e-a713-49fb-ac80-14332095e47f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:16.023855 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:16.069562 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa852e-a713-49fb-ac80-14332095e47f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:16.073573 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ce902-7873-4e87-9962-5fdee35f87da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:16.074245 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ce902-7873-4e87-9962-5fdee35f87da service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:16.074533 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ce902-7873-4e87-9962-5fdee35f87da service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:16.074812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ce902-7873-4e87-9962-5fdee35f87da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:16.084702 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ce902-7873-4e87-9962-5fdee35f87da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:16.086161 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ce902-7873-4e87-9962-5fdee35f87da service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:16.096987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1377/2747] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:16:21.581133 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce884d-6903-440d-bec9-c0785bc9bfad None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:21.651178 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce884d-6903-440d-bec9-c0785bc9bfad None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:21.655753 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb77efa-31f3-42e3-ad54-3fcfd284a594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:21.656677 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb77efa-31f3-42e3-ad54-3fcfd284a594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:21.656959 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb77efa-31f3-42e3-ad54-3fcfd284a594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:21.657358 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb77efa-31f3-42e3-ad54-3fcfd284a594 admin admin] PATH_INFO: `/v3/users/3db61e00dc494c53b6a0ff1459396eeb` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:21.658836 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb77efa-31f3-42e3-ad54-3fcfd284a594 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3db61e00dc494c53b6a0ff1459396eeb)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:21.660838 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb77efa-31f3-42e3-ad54-3fcfd284a594 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:21.726547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-edb77efa-31f3-42e3-ad54-3fcfd284a594 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3db61e00dc494c53b6a0ff1459396eeb'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:21.739638 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-edb77efa-31f3-42e3-ad54-3fcfd284a594 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3db61e00dc494c53b6a0ff1459396eeb'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:21.758079 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-edb77efa-31f3-42e3-ad54-3fcfd284a594 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3db61e00dc494c53b6a0ff1459396eeb'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:21.758865 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-edb77efa-31f3-42e3-ad54-3fcfd284a594 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3db61e00dc494c53b6a0ff1459396eeb'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:21.759496 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-edb77efa-31f3-42e3-ad54-3fcfd284a594 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3db61e00dc494c53b6a0ff1459396eeb'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:21.776079 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1371/2748] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:16:21 2022] DELETE /identity/v3/users/3db61e00dc494c53b6a0ff1459396eeb => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:21.777840 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb099a-73c0-4b04-bca9-4c21e089cbe5 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:21.778355 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb099a-73c0-4b04-bca9-4c21e089cbe5 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:21.778455 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb099a-73c0-4b04-bca9-4c21e089cbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:21.797150 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-30eb099a-73c0-4b04-bca9-4c21e089cbe5 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:21.799083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-30eb099a-73c0-4b04-bca9-4c21e089cbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:21.864172 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1378/2749] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:21.874313 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb77efa-31f3-42e3-ad54-3fcfd284a594 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:21.876059 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-edb77efa-31f3-42e3-ad54-3fcfd284a594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:21.888599 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:21.947000 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb77efa-31f3-42e3-ad54-3fcfd284a594 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:21.952135 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bace18-b248-4d2f-ab23-7a02e5c869cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:21.952874 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bace18-b248-4d2f-ab23-7a02e5c869cb service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:21.953161 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bace18-b248-4d2f-ab23-7a02e5c869cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:21.953439 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bace18-b248-4d2f-ab23-7a02e5c869cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:21.964933 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bace18-b248-4d2f-ab23-7a02e5c869cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:21.966885 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bace18-b248-4d2f-ab23-7a02e5c869cb service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:21.977955 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1372/2750] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:16:22.256734 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb099a-73c0-4b04-bca9-4c21e089cbe5 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:22.258387 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-30eb099a-73c0-4b04-bca9-4c21e089cbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:22.271677 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb099a-73c0-4b04-bca9-4c21e089cbe5 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:22.276766 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57c3f1-dbeb-420f-b9e1-cac199b84755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:22.277839 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57c3f1-dbeb-420f-b9e1-cac199b84755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:22.278134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57c3f1-dbeb-420f-b9e1-cac199b84755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:22.278414 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57c3f1-dbeb-420f-b9e1-cac199b84755 admin admin] PATH_INFO: `/v3/projects/99204eb0fae04724a167957f87168977` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:22.279711 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57c3f1-dbeb-420f-b9e1-cac199b84755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99204eb0fae04724a167957f87168977)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:22.281684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57c3f1-dbeb-420f-b9e1-cac199b84755 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:22.346619 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8c57c3f1-dbeb-420f-b9e1-cac199b84755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99204eb0fae04724a167957f87168977', 'request_id': 'req-8c57c3f1-dbeb-420f-b9e1-cac199b84755'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:22.355429 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8c57c3f1-dbeb-420f-b9e1-cac199b84755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99204eb0fae04724a167957f87168977', 'request_id': 'req-8c57c3f1-dbeb-420f-b9e1-cac199b84755'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:22.363728 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8c57c3f1-dbeb-420f-b9e1-cac199b84755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99204eb0fae04724a167957f87168977', 'request_id': 'req-8c57c3f1-dbeb-420f-b9e1-cac199b84755'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:22.378668 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8c57c3f1-dbeb-420f-b9e1-cac199b84755 admin admin] The token cache is being invalidate because project 99204eb0fae04724a167957f87168977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:16:22.379128 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8c57c3f1-dbeb-420f-b9e1-cac199b84755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:22.379873 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-8c57c3f1-dbeb-420f-b9e1-cac199b84755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:22.381865 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1379/2751] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:16:22 2022] DELETE /identity/v3/projects/99204eb0fae04724a167957f87168977 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:22.386718 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b031a9-c91c-4dba-ae3d-26b480f46595 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:22.387121 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b031a9-c91c-4dba-ae3d-26b480f46595 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:22.387469 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b031a9-c91c-4dba-ae3d-26b480f46595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:22.406402 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-15b031a9-c91c-4dba-ae3d-26b480f46595 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:22.408506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-15b031a9-c91c-4dba-ae3d-26b480f46595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:22.484508 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1373/2752] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:16:22.493191 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9032ea-2b63-4876-a2ef-bcd27f00e52a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:22.493513 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9032ea-2b63-4876-a2ef-bcd27f00e52a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:22.493800 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9032ea-2b63-4876-a2ef-bcd27f00e52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:22.512957 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-dd9032ea-2b63-4876-a2ef-bcd27f00e52a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:22.514176 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-dd9032ea-2b63-4876-a2ef-bcd27f00e52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:22.530758 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1380/2753] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:22.535879 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b031a9-c91c-4dba-ae3d-26b480f46595 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:22.545770 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b031a9-c91c-4dba-ae3d-26b480f46595 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:22.551108 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3bda8-14f6-4468-806e-8f9556134916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:22.551763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3bda8-14f6-4468-806e-8f9556134916 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:22.552049 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3bda8-14f6-4468-806e-8f9556134916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:22.552326 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3bda8-14f6-4468-806e-8f9556134916 admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:22.553090 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3bda8-14f6-4468-806e-8f9556134916 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:16:22.553393 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3bda8-14f6-4468-806e-8f9556134916 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:22.554987 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3bda8-14f6-4468-806e-8f9556134916 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:22.566759 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1374/2754] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:16:22.571420 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9032ea-2b63-4876-a2ef-bcd27f00e52a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:22.582127 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9032ea-2b63-4876-a2ef-bcd27f00e52a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:22.587520 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb3fa7-03e3-4195-a575-b6b8439a533d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:22.588337 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb3fa7-03e3-4195-a575-b6b8439a533d admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:22.588640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb3fa7-03e3-4195-a575-b6b8439a533d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:22.588927 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb3fa7-03e3-4195-a575-b6b8439a533d admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:22.589652 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb3fa7-03e3-4195-a575-b6b8439a533d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:22.591591 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb3fa7-03e3-4195-a575-b6b8439a533d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:22.630648 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1381/2755] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:16:22 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:16:22.635721 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3bda8-14f6-4468-806e-8f9556134916 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:22.647311 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3bda8-14f6-4468-806e-8f9556134916 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:22.715062 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2fd6a-4f2a-4193-8f80-e436bc68e425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:22.715742 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2fd6a-4f2a-4193-8f80-e436bc68e425 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:22.716026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2fd6a-4f2a-4193-8f80-e436bc68e425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:22.716302 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2fd6a-4f2a-4193-8f80-e436bc68e425 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:22.717060 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2fd6a-4f2a-4193-8f80-e436bc68e425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:22.719008 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2fd6a-4f2a-4193-8f80-e436bc68e425 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:22.741484 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1375/2756] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:16:22 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:16:22.745729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb3fa7-03e3-4195-a575-b6b8439a533d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:22.756730 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb3fa7-03e3-4195-a575-b6b8439a533d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:22.762859 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93c9f8-b02c-47cd-b62d-f8b466815085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:22.763536 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93c9f8-b02c-47cd-b62d-f8b466815085 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:22.763829 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93c9f8-b02c-47cd-b62d-f8b466815085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:22.764109 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93c9f8-b02c-47cd-b62d-f8b466815085 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:22.764973 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93c9f8-b02c-47cd-b62d-f8b466815085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:22.766988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93c9f8-b02c-47cd-b62d-f8b466815085 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:22.773040 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:22.779969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1382/2757] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:16:22.787463 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2fd6a-4f2a-4193-8f80-e436bc68e425 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:22.797296 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2fd6a-4f2a-4193-8f80-e436bc68e425 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:22.804710 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705420c-dac2-4ccc-a939-aa259b5c4b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:22.805480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705420c-dac2-4ccc-a939-aa259b5c4b49 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:22.805736 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705420c-dac2-4ccc-a939-aa259b5c4b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:22.805932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705420c-dac2-4ccc-a939-aa259b5c4b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:22.806768 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705420c-dac2-4ccc-a939-aa259b5c4b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:22.808295 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705420c-dac2-4ccc-a939-aa259b5c4b49 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:22.823131 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1376/2758] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:16:22.825172 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93c9f8-b02c-47cd-b62d-f8b466815085 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:22.837440 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93c9f8-b02c-47cd-b62d-f8b466815085 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:22.842433 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db90eb-a347-4b99-9825-a490e950c400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:22.843347 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db90eb-a347-4b99-9825-a490e950c400 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:22.843630 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db90eb-a347-4b99-9825-a490e950c400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:22.843907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db90eb-a347-4b99-9825-a490e950c400 admin admin] PATH_INFO: `/v3/projects/b6d68d4f0e7d41d587098e165073eb5e/users/5d874b7f1cf94236bcaeed677289e9dc/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:22.861641 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db90eb-a347-4b99-9825-a490e950c400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d68d4f0e7d41d587098e165073eb5e, user_id=5d874b7f1cf94236bcaeed677289e9dc, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:22.864964 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db90eb-a347-4b99-9825-a490e950c400 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:22.880184 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1383/2759] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:16:22 2022] PUT /identity/v3/projects/b6d68d4f0e7d41d587098e165073eb5e/users/5d874b7f1cf94236bcaeed677289e9dc/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:16:22.891317 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c218f26-0978-4a4f-87cf-aecbcc83e7e5 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:22.892341 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c218f26-0978-4a4f-87cf-aecbcc83e7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:22.892662 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c218f26-0978-4a4f-87cf-aecbcc83e7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:22.923449 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-6c218f26-0978-4a4f-87cf-aecbcc83e7e5 None None] MFA Rules not processed for user `5d874b7f1cf94236bcaeed677289e9dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:22.924557 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-6c218f26-0978-4a4f-87cf-aecbcc83e7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:22.929458 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:23.004130 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1377/2760] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:23.012370 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db90eb-a347-4b99-9825-a490e950c400 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:23.074534 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db90eb-a347-4b99-9825-a490e950c400 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:23.079809 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe348352-7d0b-487c-808f-0cff14a89152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:23.080494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe348352-7d0b-487c-808f-0cff14a89152 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:23.080779 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe348352-7d0b-487c-808f-0cff14a89152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:23.081060 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe348352-7d0b-487c-808f-0cff14a89152 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:23.081729 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe348352-7d0b-487c-808f-0cff14a89152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:23.083624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe348352-7d0b-487c-808f-0cff14a89152 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:23.109460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1384/2761] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:16:23 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:16:23.113614 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c218f26-0978-4a4f-87cf-aecbcc83e7e5 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:23.126589 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c218f26-0978-4a4f-87cf-aecbcc83e7e5 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:23.185544 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c15c3f-dca8-4dc0-83a1-89b5e85ee76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:23.186225 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c15c3f-dca8-4dc0-83a1-89b5e85ee76a admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:23.186512 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c15c3f-dca8-4dc0-83a1-89b5e85ee76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:23.186790 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c15c3f-dca8-4dc0-83a1-89b5e85ee76a admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:23.187489 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c15c3f-dca8-4dc0-83a1-89b5e85ee76a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:23.189935 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c15c3f-dca8-4dc0-83a1-89b5e85ee76a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:23.211383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1378/2762] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:16:23 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:16:23.215246 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe348352-7d0b-487c-808f-0cff14a89152 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:23.230524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe348352-7d0b-487c-808f-0cff14a89152 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:23.235407 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efc3ca-7dcd-404f-b32b-0c072e63b9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:23.236076 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efc3ca-7dcd-404f-b32b-0c072e63b9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:23.236360 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efc3ca-7dcd-404f-b32b-0c072e63b9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:23.236684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efc3ca-7dcd-404f-b32b-0c072e63b9e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:23.237438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13efc3ca-7dcd-404f-b32b-0c072e63b9e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:23.239057 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13efc3ca-7dcd-404f-b32b-0c072e63b9e2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:23.249675 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1385/2763] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:16:23.255783 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c15c3f-dca8-4dc0-83a1-89b5e85ee76a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:23.266565 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c15c3f-dca8-4dc0-83a1-89b5e85ee76a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:23.272239 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6a84d-cbb6-4083-a41f-8ec6905e1566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:23.273176 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6a84d-cbb6-4083-a41f-8ec6905e1566 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:23.273466 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6a84d-cbb6-4083-a41f-8ec6905e1566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:23.273741 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6a84d-cbb6-4083-a41f-8ec6905e1566 admin admin] PATH_INFO: `/v3/projects/3cd73b71ce334ae885b7e2934767c0f6/users/ff1ad76e6a224551b60300afb138a9be/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:23.289250 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6a84d-cbb6-4083-a41f-8ec6905e1566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cd73b71ce334ae885b7e2934767c0f6, user_id=ff1ad76e6a224551b60300afb138a9be, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:23.291887 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6a84d-cbb6-4083-a41f-8ec6905e1566 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:23.307172 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1379/2764] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:16:23 2022] PUT /identity/v3/projects/3cd73b71ce334ae885b7e2934767c0f6/users/ff1ad76e6a224551b60300afb138a9be/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:23.311073 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efc3ca-7dcd-404f-b32b-0c072e63b9e2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:23.322706 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efc3ca-7dcd-404f-b32b-0c072e63b9e2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:23.397472 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b3956-ef7d-460b-84f3-caec90d7f281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:23.398217 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b3956-ef7d-460b-84f3-caec90d7f281 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:23.398425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b3956-ef7d-460b-84f3-caec90d7f281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:23.398704 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b3956-ef7d-460b-84f3-caec90d7f281 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:23.399432 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b3956-ef7d-460b-84f3-caec90d7f281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:23.401182 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b3956-ef7d-460b-84f3-caec90d7f281 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:23.420684 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1386/2765] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:16:23.425999 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6a84d-cbb6-4083-a41f-8ec6905e1566 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:23.436468 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6a84d-cbb6-4083-a41f-8ec6905e1566 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:23.441799 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b68463-d222-4c9f-afb8-427d65f8e207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:23.442685 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b68463-d222-4c9f-afb8-427d65f8e207 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:23.442969 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b68463-d222-4c9f-afb8-427d65f8e207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:23.443247 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b68463-d222-4c9f-afb8-427d65f8e207 admin admin] PATH_INFO: `/v3/projects/3cd73b71ce334ae885b7e2934767c0f6/users/ff1ad76e6a224551b60300afb138a9be/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:23.445244 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b68463-d222-4c9f-afb8-427d65f8e207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cd73b71ce334ae885b7e2934767c0f6, user_id=ff1ad76e6a224551b60300afb138a9be, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:23.447868 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b68463-d222-4c9f-afb8-427d65f8e207 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:23.458282 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1380/2766] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:16:23 2022] PUT /identity/v3/projects/3cd73b71ce334ae885b7e2934767c0f6/users/ff1ad76e6a224551b60300afb138a9be/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:23.470694 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d0b93-e6ae-42bd-b2f6-0f9ea42ef00f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:23.471168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d0b93-e6ae-42bd-b2f6-0f9ea42ef00f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:23.471317 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d0b93-e6ae-42bd-b2f6-0f9ea42ef00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:23.498481 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a55d0b93-e6ae-42bd-b2f6-0f9ea42ef00f None None] MFA Rules not processed for user `ff1ad76e6a224551b60300afb138a9be`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:23.499688 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a55d0b93-e6ae-42bd-b2f6-0f9ea42ef00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:23.542367 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:23.580807 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1387/2767] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:23.591516 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b68463-d222-4c9f-afb8-427d65f8e207 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:23.593286 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-00b68463-d222-4c9f-afb8-427d65f8e207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:23.652690 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b68463-d222-4c9f-afb8-427d65f8e207 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:23.656287 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c34ca-343d-43c9-8e20-33bd85091943 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:23.656966 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c34ca-343d-43c9-8e20-33bd85091943 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:23.657384 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c34ca-343d-43c9-8e20-33bd85091943 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:23.657505 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c34ca-343d-43c9-8e20-33bd85091943 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:23.667187 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:23.723162 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c34ca-343d-43c9-8e20-33bd85091943 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:23.724670 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c34ca-343d-43c9-8e20-33bd85091943 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:23.735795 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1381/2768] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:16:24.377145 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d0b93-e6ae-42bd-b2f6-0f9ea42ef00f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:24.378559 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a55d0b93-e6ae-42bd-b2f6-0f9ea42ef00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:24.436877 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d0b93-e6ae-42bd-b2f6-0f9ea42ef00f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:24.441180 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e4c66-821e-4055-a721-a85b8d010c43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:24.441829 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e4c66-821e-4055-a721-a85b8d010c43 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:24.442107 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e4c66-821e-4055-a721-a85b8d010c43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:24.442376 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e4c66-821e-4055-a721-a85b8d010c43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:24.444130 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d56e4c66-821e-4055-a721-a85b8d010c43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:24.508764 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e4c66-821e-4055-a721-a85b8d010c43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:24.510415 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e4c66-821e-4055-a721-a85b8d010c43 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:24.521900 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1388/2769] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:24 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:16:26.303329 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c34ca-343d-43c9-8e20-33bd85091943 service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:26.395185 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c34ca-343d-43c9-8e20-33bd85091943 service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:26.400606 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67905b1e-183b-4196-a2ae-5552f2996a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:26.401140 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67905b1e-183b-4196-a2ae-5552f2996a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:26.401489 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67905b1e-183b-4196-a2ae-5552f2996a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:26.401855 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67905b1e-183b-4196-a2ae-5552f2996a1d admin admin] PATH_INFO: `/v3/users/5d874b7f1cf94236bcaeed677289e9dc` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:26.403162 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67905b1e-183b-4196-a2ae-5552f2996a1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d874b7f1cf94236bcaeed677289e9dc)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:26.405975 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67905b1e-183b-4196-a2ae-5552f2996a1d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:26.474968 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-67905b1e-183b-4196-a2ae-5552f2996a1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d874b7f1cf94236bcaeed677289e9dc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:26.485674 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-67905b1e-183b-4196-a2ae-5552f2996a1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d874b7f1cf94236bcaeed677289e9dc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:26.502620 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-67905b1e-183b-4196-a2ae-5552f2996a1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d874b7f1cf94236bcaeed677289e9dc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:26.503609 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-67905b1e-183b-4196-a2ae-5552f2996a1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d874b7f1cf94236bcaeed677289e9dc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:26.504204 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-67905b1e-183b-4196-a2ae-5552f2996a1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d874b7f1cf94236bcaeed677289e9dc'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:26.528777 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1382/2770] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:16:26 2022] DELETE /identity/v3/users/5d874b7f1cf94236bcaeed677289e9dc => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:26.533857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1f79a-8192-4325-802a-2f59d4a05a69 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:26.534348 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1f79a-8192-4325-802a-2f59d4a05a69 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:26.534657 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1f79a-8192-4325-802a-2f59d4a05a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:26.554066 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-36e1f79a-8192-4325-802a-2f59d4a05a69 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:26.555518 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-36e1f79a-8192-4325-802a-2f59d4a05a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:26.639882 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1389/2771] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:26.651193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67905b1e-183b-4196-a2ae-5552f2996a1d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:26.652825 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-67905b1e-183b-4196-a2ae-5552f2996a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:26.709977 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:26.745872 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67905b1e-183b-4196-a2ae-5552f2996a1d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:26.750189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e6ca9-cd66-4639-98bb-459b192248f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:26.751850 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e6ca9-cd66-4639-98bb-459b192248f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:26.752305 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e6ca9-cd66-4639-98bb-459b192248f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:26.752705 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e6ca9-cd66-4639-98bb-459b192248f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:26.764811 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e6ca9-cd66-4639-98bb-459b192248f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:26.765818 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e6ca9-cd66-4639-98bb-459b192248f2 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:26.777850 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1383/2772] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:16:27.096230 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1f79a-8192-4325-802a-2f59d4a05a69 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:27.097939 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-36e1f79a-8192-4325-802a-2f59d4a05a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:27.120888 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1f79a-8192-4325-802a-2f59d4a05a69 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:27.128219 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e8ca2-e579-4e37-9881-b76683c75212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:27.129052 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e8ca2-e579-4e37-9881-b76683c75212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:27.129341 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e8ca2-e579-4e37-9881-b76683c75212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:27.129687 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e8ca2-e579-4e37-9881-b76683c75212 admin admin] PATH_INFO: `/v3/projects/b6d68d4f0e7d41d587098e165073eb5e` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:27.130838 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e8ca2-e579-4e37-9881-b76683c75212 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6d68d4f0e7d41d587098e165073eb5e)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:27.132823 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e8ca2-e579-4e37-9881-b76683c75212 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:27.151816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=100 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:27.189691 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d05e8ca2-e579-4e37-9881-b76683c75212 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6d68d4f0e7d41d587098e165073eb5e', 'request_id': 'req-d05e8ca2-e579-4e37-9881-b76683c75212'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:27.199524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d05e8ca2-e579-4e37-9881-b76683c75212 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6d68d4f0e7d41d587098e165073eb5e', 'request_id': 'req-d05e8ca2-e579-4e37-9881-b76683c75212'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:27.206134 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d05e8ca2-e579-4e37-9881-b76683c75212 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6d68d4f0e7d41d587098e165073eb5e', 'request_id': 'req-d05e8ca2-e579-4e37-9881-b76683c75212'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:27.218103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d05e8ca2-e579-4e37-9881-b76683c75212 admin admin] The token cache is being invalidate because project b6d68d4f0e7d41d587098e165073eb5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:16:27.218329 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d05e8ca2-e579-4e37-9881-b76683c75212 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:27.219069 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-d05e8ca2-e579-4e37-9881-b76683c75212 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:27.220756 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1390/2773] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:16:27 2022] DELETE /identity/v3/projects/b6d68d4f0e7d41d587098e165073eb5e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:27.224715 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e6ca9-cd66-4639-98bb-459b192248f2 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:27.234778 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e6ca9-cd66-4639-98bb-459b192248f2 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:27.299284 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964ef7e-a73b-4548-8fc8-ddc1b99cccbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:27.300170 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964ef7e-a73b-4548-8fc8-ddc1b99cccbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:27.300516 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964ef7e-a73b-4548-8fc8-ddc1b99cccbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:27.300788 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964ef7e-a73b-4548-8fc8-ddc1b99cccbf admin admin] PATH_INFO: `/v3/users/ff1ad76e6a224551b60300afb138a9be` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:27.301987 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964ef7e-a73b-4548-8fc8-ddc1b99cccbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff1ad76e6a224551b60300afb138a9be)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:27.303907 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964ef7e-a73b-4548-8fc8-ddc1b99cccbf admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:27.357739 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4964ef7e-a73b-4548-8fc8-ddc1b99cccbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff1ad76e6a224551b60300afb138a9be'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:27.372692 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4964ef7e-a73b-4548-8fc8-ddc1b99cccbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff1ad76e6a224551b60300afb138a9be'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:27.388785 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4964ef7e-a73b-4548-8fc8-ddc1b99cccbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff1ad76e6a224551b60300afb138a9be'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:27.389409 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4964ef7e-a73b-4548-8fc8-ddc1b99cccbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff1ad76e6a224551b60300afb138a9be'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:27.390013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-4964ef7e-a73b-4548-8fc8-ddc1b99cccbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff1ad76e6a224551b60300afb138a9be'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:27.402527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1384/2774] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:16:27 2022] DELETE /identity/v3/users/ff1ad76e6a224551b60300afb138a9be => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:27.694706 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e8ca2-e579-4e37-9881-b76683c75212 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:27.696921 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d05e8ca2-e579-4e37-9881-b76683c75212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:27.720421 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e8ca2-e579-4e37-9881-b76683c75212 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:27.781460 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d05fc5-d5b7-4f16-925b-b429d3f0cc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:27.782876 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d05fc5-d5b7-4f16-925b-b429d3f0cc51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:27.783220 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d05fc5-d5b7-4f16-925b-b429d3f0cc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:27.783553 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d05fc5-d5b7-4f16-925b-b429d3f0cc51 admin admin] PATH_INFO: `/v3/projects/3cd73b71ce334ae885b7e2934767c0f6` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:27.784975 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d05fc5-d5b7-4f16-925b-b429d3f0cc51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cd73b71ce334ae885b7e2934767c0f6)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:27.786956 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d05fc5-d5b7-4f16-925b-b429d3f0cc51 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:27.835557 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-87d05fc5-d5b7-4f16-925b-b429d3f0cc51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cd73b71ce334ae885b7e2934767c0f6', 'request_id': 'req-87d05fc5-d5b7-4f16-925b-b429d3f0cc51'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:27.844046 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-87d05fc5-d5b7-4f16-925b-b429d3f0cc51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cd73b71ce334ae885b7e2934767c0f6', 'request_id': 'req-87d05fc5-d5b7-4f16-925b-b429d3f0cc51'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:27.851439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-87d05fc5-d5b7-4f16-925b-b429d3f0cc51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cd73b71ce334ae885b7e2934767c0f6', 'request_id': 'req-87d05fc5-d5b7-4f16-925b-b429d3f0cc51'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:27.862648 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-87d05fc5-d5b7-4f16-925b-b429d3f0cc51 admin admin] The token cache is being invalidate because project 3cd73b71ce334ae885b7e2934767c0f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:16:27.862941 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-87d05fc5-d5b7-4f16-925b-b429d3f0cc51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:27.863654 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-87d05fc5-d5b7-4f16-925b-b429d3f0cc51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:27.865371 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1391/2775] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:16:27 2022] DELETE /identity/v3/projects/3cd73b71ce334ae885b7e2934767c0f6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:27.870184 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825a969-f201-4339-8cac-74cd12509bf7 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:27.870506 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825a969-f201-4339-8cac-74cd12509bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:27.870784 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825a969-f201-4339-8cac-74cd12509bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:27.888849 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-f825a969-f201-4339-8cac-74cd12509bf7 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:27.889935 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-f825a969-f201-4339-8cac-74cd12509bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:27.940360 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:27.955721 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1385/2776] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:27.963510 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e6e81-9eeb-4ca4-af89-1224380b203d None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:27.963803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e6e81-9eeb-4ca4-af89-1224380b203d None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:27.964084 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e6e81-9eeb-4ca4-af89-1224380b203d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:27.982921 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-c77e6e81-9eeb-4ca4-af89-1224380b203d None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:27.984123 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c77e6e81-9eeb-4ca4-af89-1224380b203d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:27.991968 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1392/2777] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:28.003780 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825a969-f201-4339-8cac-74cd12509bf7 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:28.013846 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825a969-f201-4339-8cac-74cd12509bf7 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:28.019396 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698003f5-6b94-43a9-9afc-c82fc6cdf1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:28.020042 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698003f5-6b94-43a9-9afc-c82fc6cdf1bb admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:28.020321 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698003f5-6b94-43a9-9afc-c82fc6cdf1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:28.020623 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698003f5-6b94-43a9-9afc-c82fc6cdf1bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:28.021415 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698003f5-6b94-43a9-9afc-c82fc6cdf1bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:16:28.021720 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698003f5-6b94-43a9-9afc-c82fc6cdf1bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:28.023305 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698003f5-6b94-43a9-9afc-c82fc6cdf1bb admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:28.039298 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1386/2778] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:16:28.040287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e6e81-9eeb-4ca4-af89-1224380b203d None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:28.050641 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e6e81-9eeb-4ca4-af89-1224380b203d None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:28.055591 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77e00c-fb26-47d8-8edc-ebdf656e3ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:28.056262 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77e00c-fb26-47d8-8edc-ebdf656e3ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:28.056578 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77e00c-fb26-47d8-8edc-ebdf656e3ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:28.056854 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77e00c-fb26-47d8-8edc-ebdf656e3ff2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:28.057554 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db77e00c-fb26-47d8-8edc-ebdf656e3ff2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:28.059450 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db77e00c-fb26-47d8-8edc-ebdf656e3ff2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:28.087201 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1393/2779] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:16:28 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:16:28.091263 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698003f5-6b94-43a9-9afc-c82fc6cdf1bb admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:28.111922 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698003f5-6b94-43a9-9afc-c82fc6cdf1bb admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:28.172227 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a6e4c-4f04-4746-95f5-ada67bb0b80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:28.173793 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a6e4c-4f04-4746-95f5-ada67bb0b80a admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:28.174145 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a6e4c-4f04-4746-95f5-ada67bb0b80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:28.174426 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a6e4c-4f04-4746-95f5-ada67bb0b80a admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:28.175125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a6e4c-4f04-4746-95f5-ada67bb0b80a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:28.177083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a6e4c-4f04-4746-95f5-ada67bb0b80a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:28.196972 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1387/2780] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:16:28 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:16:28.201429 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77e00c-fb26-47d8-8edc-ebdf656e3ff2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:28.213708 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77e00c-fb26-47d8-8edc-ebdf656e3ff2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:28.218457 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a786a-6792-48be-9d94-b7d509647adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:28.219131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a786a-6792-48be-9d94-b7d509647adf admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:28.219451 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a786a-6792-48be-9d94-b7d509647adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:28.219832 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a786a-6792-48be-9d94-b7d509647adf admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:28.220936 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a786a-6792-48be-9d94-b7d509647adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:28.222552 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a786a-6792-48be-9d94-b7d509647adf admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:28.224184 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:28.236038 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1394/2781] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:16:28.238674 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a6e4c-4f04-4746-95f5-ada67bb0b80a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:28.249332 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a6e4c-4f04-4746-95f5-ada67bb0b80a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:28.263744 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82505b25-9500-4317-9c38-6911bd63aa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:28.264467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82505b25-9500-4317-9c38-6911bd63aa3c admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:28.264757 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82505b25-9500-4317-9c38-6911bd63aa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:28.265037 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82505b25-9500-4317-9c38-6911bd63aa3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:28.265781 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82505b25-9500-4317-9c38-6911bd63aa3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:28.268002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82505b25-9500-4317-9c38-6911bd63aa3c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:28.278540 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1388/2782] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:16:28.282861 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a786a-6792-48be-9d94-b7d509647adf admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:28.293577 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a786a-6792-48be-9d94-b7d509647adf admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:28.298607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bee718-216e-4cfe-a059-e72c96d5542d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:28.299497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bee718-216e-4cfe-a059-e72c96d5542d admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:28.299782 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bee718-216e-4cfe-a059-e72c96d5542d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:28.300063 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bee718-216e-4cfe-a059-e72c96d5542d admin admin] PATH_INFO: `/v3/projects/7ddf3e695b1b4fba85b223e7709b474f/users/348dca5d1fbe41838a49850ee64f6652/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:28.320969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bee718-216e-4cfe-a059-e72c96d5542d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ddf3e695b1b4fba85b223e7709b474f, user_id=348dca5d1fbe41838a49850ee64f6652, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:28.323654 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bee718-216e-4cfe-a059-e72c96d5542d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:28.338425 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1395/2783] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:16:28 2022] PUT /identity/v3/projects/7ddf3e695b1b4fba85b223e7709b474f/users/348dca5d1fbe41838a49850ee64f6652/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:28.357151 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac08e2c-198d-4512-b4a1-7d6b0ae9a905 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:28.357824 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac08e2c-198d-4512-b4a1-7d6b0ae9a905 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:28.357824 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac08e2c-198d-4512-b4a1-7d6b0ae9a905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:28.392856 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8ac08e2c-198d-4512-b4a1-7d6b0ae9a905 None None] MFA Rules not processed for user `348dca5d1fbe41838a49850ee64f6652`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:28.394214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8ac08e2c-198d-4512-b4a1-7d6b0ae9a905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:28.462045 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1389/2784] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:28.473319 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bee718-216e-4cfe-a059-e72c96d5542d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:28.475050 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-14bee718-216e-4cfe-a059-e72c96d5542d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:28.534823 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bee718-216e-4cfe-a059-e72c96d5542d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:28.538503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8813b9c-e3bf-4dbd-b60b-bb2c305e652d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:28.539156 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8813b9c-e3bf-4dbd-b60b-bb2c305e652d service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:28.539442 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8813b9c-e3bf-4dbd-b60b-bb2c305e652d service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:28.539720 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8813b9c-e3bf-4dbd-b60b-bb2c305e652d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:28.548564 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8813b9c-e3bf-4dbd-b60b-bb2c305e652d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:28.549948 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8813b9c-e3bf-4dbd-b60b-bb2c305e652d service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:28.558877 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1396/2785] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:16:31.598259 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac08e2c-198d-4512-b4a1-7d6b0ae9a905 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:31.599761 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8ac08e2c-198d-4512-b4a1-7d6b0ae9a905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:31.620726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8813b9c-e3bf-4dbd-b60b-bb2c305e652d service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:31.660082 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:31.679512 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac08e2c-198d-4512-b4a1-7d6b0ae9a905 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:31.684490 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df1605-c449-46fd-a82b-d3b361333f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:31.685378 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df1605-c449-46fd-a82b-d3b361333f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:31.685663 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df1605-c449-46fd-a82b-d3b361333f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:31.685943 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df1605-c449-46fd-a82b-d3b361333f0c admin admin] PATH_INFO: `/v3/users/d06feb3d88cb4461bd1d0a2ddb87fd66` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:31.687163 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df1605-c449-46fd-a82b-d3b361333f0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d06feb3d88cb4461bd1d0a2ddb87fd66)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:31.690431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8813b9c-e3bf-4dbd-b60b-bb2c305e652d service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:31.690662 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df1605-c449-46fd-a82b-d3b361333f0c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:31.695579 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93c0dc-82cc-47bb-bb24-efb71a264796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:31.696655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93c0dc-82cc-47bb-bb24-efb71a264796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:31.696938 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93c0dc-82cc-47bb-bb24-efb71a264796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:31.697213 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93c0dc-82cc-47bb-bb24-efb71a264796 admin admin] PATH_INFO: `/v3/users/348dca5d1fbe41838a49850ee64f6652` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:31.698537 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93c0dc-82cc-47bb-bb24-efb71a264796 admin admin] RBAC: Authorizing `identity:delete_user(user_id=348dca5d1fbe41838a49850ee64f6652)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:31.700576 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93c0dc-82cc-47bb-bb24-efb71a264796 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:31.744780 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-59df1605-c449-46fd-a82b-d3b361333f0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd06feb3d88cb4461bd1d0a2ddb87fd66'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:31.753279 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ac93c0dc-82cc-47bb-bb24-efb71a264796 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '348dca5d1fbe41838a49850ee64f6652'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:31.755487 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-59df1605-c449-46fd-a82b-d3b361333f0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd06feb3d88cb4461bd1d0a2ddb87fd66'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:31.761308 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ac93c0dc-82cc-47bb-bb24-efb71a264796 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '348dca5d1fbe41838a49850ee64f6652'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:31.762004 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ac93c0dc-82cc-47bb-bb24-efb71a264796 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '348dca5d1fbe41838a49850ee64f6652'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:31.770053 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-59df1605-c449-46fd-a82b-d3b361333f0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd06feb3d88cb4461bd1d0a2ddb87fd66'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:31.770904 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-59df1605-c449-46fd-a82b-d3b361333f0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd06feb3d88cb4461bd1d0a2ddb87fd66'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:31.772432 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-59df1605-c449-46fd-a82b-d3b361333f0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd06feb3d88cb4461bd1d0a2ddb87fd66'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:31.775930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ac93c0dc-82cc-47bb-bb24-efb71a264796 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '348dca5d1fbe41838a49850ee64f6652'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:31.778531 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:31.785910 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ac93c0dc-82cc-47bb-bb24-efb71a264796 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '348dca5d1fbe41838a49850ee64f6652'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:31.788293 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1390/2786] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:16:31 2022] DELETE /identity/v3/users/d06feb3d88cb4461bd1d0a2ddb87fd66 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:31.792934 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb3396-5399-4f87-b344-703fc292725a None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:31.793284 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb3396-5399-4f87-b344-703fc292725a None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:31.793494 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb3396-5399-4f87-b344-703fc292725a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:31.802409 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1397/2787] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:16:31 2022] DELETE /identity/v3/users/348dca5d1fbe41838a49850ee64f6652 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:31.807091 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71016ed6-cd83-45f8-ac4c-b9b1cbcb5f42 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:31.807377 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71016ed6-cd83-45f8-ac4c-b9b1cbcb5f42 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:31.807650 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71016ed6-cd83-45f8-ac4c-b9b1cbcb5f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:31.820204 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-9bcb3396-5399-4f87-b344-703fc292725a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:31.821447 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9bcb3396-5399-4f87-b344-703fc292725a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:31.824781 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-71016ed6-cd83-45f8-ac4c-b9b1cbcb5f42 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:31.826008 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-71016ed6-cd83-45f8-ac4c-b9b1cbcb5f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:31.887265 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1391/2788] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:31.891593 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1398/2789] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:31.901380 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb3396-5399-4f87-b344-703fc292725a None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:31.902953 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9bcb3396-5399-4f87-b344-703fc292725a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:31.905139 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71016ed6-cd83-45f8-ac4c-b9b1cbcb5f42 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:31.906833 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-71016ed6-cd83-45f8-ac4c-b9b1cbcb5f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:31.966300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71016ed6-cd83-45f8-ac4c-b9b1cbcb5f42 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:31.969961 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a215ff-dfc5-4d9e-91e0-5c6903a9173b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:31.971268 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a215ff-dfc5-4d9e-91e0-5c6903a9173b service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:31.971608 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a215ff-dfc5-4d9e-91e0-5c6903a9173b service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:31.971889 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a215ff-dfc5-4d9e-91e0-5c6903a9173b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:31.972183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb3396-5399-4f87-b344-703fc292725a None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:31.976021 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1baac00-fc3d-4088-982f-99854ca285f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:31.976704 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1baac00-fc3d-4088-982f-99854ca285f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:31.976998 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1baac00-fc3d-4088-982f-99854ca285f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:31.977358 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1baac00-fc3d-4088-982f-99854ca285f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:31.981291 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a215ff-dfc5-4d9e-91e0-5c6903a9173b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:31.982747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a215ff-dfc5-4d9e-91e0-5c6903a9173b service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:31.987792 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1baac00-fc3d-4088-982f-99854ca285f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:31.989260 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1baac00-fc3d-4088-982f-99854ca285f9 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:31.993736 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1399/2790] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:16:31.999557 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1392/2791] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:16:32.365841 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a215ff-dfc5-4d9e-91e0-5c6903a9173b service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:32.367528 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-71a215ff-dfc5-4d9e-91e0-5c6903a9173b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:32.374110 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1baac00-fc3d-4088-982f-99854ca285f9 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:32.376066 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c1baac00-fc3d-4088-982f-99854ca285f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:32.390406 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a215ff-dfc5-4d9e-91e0-5c6903a9173b service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:32.391567 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1baac00-fc3d-4088-982f-99854ca285f9 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:32.397733 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46ca4f-3776-4831-97a6-9277be0a5cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:32.398972 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46ca4f-3776-4831-97a6-9277be0a5cdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:32.399287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46ca4f-3776-4831-97a6-9277be0a5cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:32.399540 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46ca4f-3776-4831-97a6-9277be0a5cdd admin admin] PATH_INFO: `/v3/projects/7ddf3e695b1b4fba85b223e7709b474f` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:32.399672 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f414ba-2d42-4aed-a756-a37ea985937f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:32.400824 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f414ba-2d42-4aed-a756-a37ea985937f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:32.400948 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46ca4f-3776-4831-97a6-9277be0a5cdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ddf3e695b1b4fba85b223e7709b474f)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:32.401214 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f414ba-2d42-4aed-a756-a37ea985937f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:32.401556 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f414ba-2d42-4aed-a756-a37ea985937f admin admin] PATH_INFO: `/v3/projects/d167a9e8151c43c1a9e74630c2b627fc` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:32.403160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46ca4f-3776-4831-97a6-9277be0a5cdd admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:32.403444 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f414ba-2d42-4aed-a756-a37ea985937f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d167a9e8151c43c1a9e74630c2b627fc)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:32.405665 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f414ba-2d42-4aed-a756-a37ea985937f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:32.414882 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:32.461654 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ea46ca4f-3776-4831-97a6-9277be0a5cdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ddf3e695b1b4fba85b223e7709b474f', 'request_id': 'req-ea46ca4f-3776-4831-97a6-9277be0a5cdd'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:32.469503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ea46ca4f-3776-4831-97a6-9277be0a5cdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ddf3e695b1b4fba85b223e7709b474f', 'request_id': 'req-ea46ca4f-3776-4831-97a6-9277be0a5cdd'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:32.470956 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-71f414ba-2d42-4aed-a756-a37ea985937f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd167a9e8151c43c1a9e74630c2b627fc', 'request_id': 'req-71f414ba-2d42-4aed-a756-a37ea985937f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:32.477484 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ea46ca4f-3776-4831-97a6-9277be0a5cdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ddf3e695b1b4fba85b223e7709b474f', 'request_id': 'req-ea46ca4f-3776-4831-97a6-9277be0a5cdd'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:32.477715 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-71f414ba-2d42-4aed-a756-a37ea985937f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd167a9e8151c43c1a9e74630c2b627fc', 'request_id': 'req-71f414ba-2d42-4aed-a756-a37ea985937f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:32.487578 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-71f414ba-2d42-4aed-a756-a37ea985937f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd167a9e8151c43c1a9e74630c2b627fc', 'request_id': 'req-71f414ba-2d42-4aed-a756-a37ea985937f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:32.491042 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ea46ca4f-3776-4831-97a6-9277be0a5cdd admin admin] The token cache is being invalidate because project 7ddf3e695b1b4fba85b223e7709b474f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80209) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:16:32.491331 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ea46ca4f-3776-4831-97a6-9277be0a5cdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:32.492159 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-ea46ca4f-3776-4831-97a6-9277be0a5cdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:32.493864 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1400/2792] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:16:32 2022] DELETE /identity/v3/projects/7ddf3e695b1b4fba85b223e7709b474f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:32.498640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32299fc-dfad-4065-944a-82829dec3110 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:32.498936 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32299fc-dfad-4065-944a-82829dec3110 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:32.499220 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32299fc-dfad-4065-944a-82829dec3110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:32.502293 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-71f414ba-2d42-4aed-a756-a37ea985937f admin admin] The token cache is being invalidate because project d167a9e8151c43c1a9e74630c2b627fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:16:32.502589 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-71f414ba-2d42-4aed-a756-a37ea985937f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:32.503238 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-71f414ba-2d42-4aed-a756-a37ea985937f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:32.505878 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1393/2793] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:16:32 2022] DELETE /identity/v3/projects/d167a9e8151c43c1a9e74630c2b627fc => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:32.510039 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3e9f1-4171-4735-8d84-b723705aa4ae None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:32.510902 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3e9f1-4171-4735-8d84-b723705aa4ae None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:32.511291 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3e9f1-4171-4735-8d84-b723705aa4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:32.519236 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-a32299fc-dfad-4065-944a-82829dec3110 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:32.520494 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a32299fc-dfad-4065-944a-82829dec3110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:32.531673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-fdb3e9f1-4171-4735-8d84-b723705aa4ae None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:32.533528 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-fdb3e9f1-4171-4735-8d84-b723705aa4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:32.536190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:32.601320 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1401/2794] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:32.601581 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1394/2795] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:16:32.605422 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe588d61-b1eb-4667-aa7d-106a35519d34 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:32.605548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07a3ff-edd3-43b8-a785-1a108c6e831a None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:32.605712 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07a3ff-edd3-43b8-a785-1a108c6e831a None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:32.605830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe588d61-b1eb-4667-aa7d-106a35519d34 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:32.605992 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe588d61-b1eb-4667-aa7d-106a35519d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:32.606106 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07a3ff-edd3-43b8-a785-1a108c6e831a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:32.624330 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-bb07a3ff-edd3-43b8-a785-1a108c6e831a None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:32.624970 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-fe588d61-b1eb-4667-aa7d-106a35519d34 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:32.625572 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-bb07a3ff-edd3-43b8-a785-1a108c6e831a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:32.625717 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-fe588d61-b1eb-4667-aa7d-106a35519d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:32.633996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1402/2796] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:16:32.634301 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1395/2797] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:16:32.638449 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07a3ff-edd3-43b8-a785-1a108c6e831a None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:32.640567 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe588d61-b1eb-4667-aa7d-106a35519d34 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:32.648492 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07a3ff-edd3-43b8-a785-1a108c6e831a None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:32.650913 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe588d61-b1eb-4667-aa7d-106a35519d34 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:32.653156 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15035f7-9f1d-4919-9eca-c1c7a57d3fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:32.653786 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15035f7-9f1d-4919-9eca-c1c7a57d3fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:32.654071 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15035f7-9f1d-4919-9eca-c1c7a57d3fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:32.654341 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15035f7-9f1d-4919-9eca-c1c7a57d3fa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:32.655058 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15035f7-9f1d-4919-9eca-c1c7a57d3fa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:16:32.655361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15035f7-9f1d-4919-9eca-c1c7a57d3fa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:32.655784 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b779a-3c1d-4a86-9e94-cddec9dddf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:32.656566 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b779a-3c1d-4a86-9e94-cddec9dddf3a admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:32.656856 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b779a-3c1d-4a86-9e94-cddec9dddf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:32.656988 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15035f7-9f1d-4919-9eca-c1c7a57d3fa6 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:32.657133 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b779a-3c1d-4a86-9e94-cddec9dddf3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:32.658453 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b779a-3c1d-4a86-9e94-cddec9dddf3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80210) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:16:32.658763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b779a-3c1d-4a86-9e94-cddec9dddf3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:32.660375 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b779a-3c1d-4a86-9e94-cddec9dddf3a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:32.669725 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1403/2798] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:16:32.673354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1396/2799] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 22:16:32.674574 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15035f7-9f1d-4919-9eca-c1c7a57d3fa6 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:32.677461 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b779a-3c1d-4a86-9e94-cddec9dddf3a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:32.686102 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15035f7-9f1d-4919-9eca-c1c7a57d3fa6 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:32.692716 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c08f6a-cfd8-4c33-a96a-a8cad9feb801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:32.693393 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c08f6a-cfd8-4c33-a96a-a8cad9feb801 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:32.693816 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c08f6a-cfd8-4c33-a96a-a8cad9feb801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:32.694103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c08f6a-cfd8-4c33-a96a-a8cad9feb801 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:32.694572 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b779a-3c1d-4a86-9e94-cddec9dddf3a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:32.694799 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c08f6a-cfd8-4c33-a96a-a8cad9feb801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:32.696744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c08f6a-cfd8-4c33-a96a-a8cad9feb801 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:32.699945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41496778-6788-4c38-9d0d-b83951c570d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:32.700643 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41496778-6788-4c38-9d0d-b83951c570d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:32.700934 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41496778-6788-4c38-9d0d-b83951c570d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:32.701219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41496778-6788-4c38-9d0d-b83951c570d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:32.701916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41496778-6788-4c38-9d0d-b83951c570d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:32.703822 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41496778-6788-4c38-9d0d-b83951c570d8 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:32.725904 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1404/2800] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:16:32 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:16:32.729951 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c08f6a-cfd8-4c33-a96a-a8cad9feb801 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:32.734928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1397/2801] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:16:32 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:16:32.740657 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41496778-6788-4c38-9d0d-b83951c570d8 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:32.797728 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c08f6a-cfd8-4c33-a96a-a8cad9feb801 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:32.803145 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:32.816181 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41496778-6788-4c38-9d0d-b83951c570d8 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:32.821657 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807f92a-57d7-4ae9-85a2-45f6f30f5cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:32.822323 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807f92a-57d7-4ae9-85a2-45f6f30f5cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:32.822606 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807f92a-57d7-4ae9-85a2-45f6f30f5cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:32.822891 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807f92a-57d7-4ae9-85a2-45f6f30f5cb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:32.823585 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807f92a-57d7-4ae9-85a2-45f6f30f5cb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:32.825563 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807f92a-57d7-4ae9-85a2-45f6f30f5cb8 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:32.847742 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1398/2802] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:16:32 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:16:32.851853 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807f92a-57d7-4ae9-85a2-45f6f30f5cb8 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:32.862409 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807f92a-57d7-4ae9-85a2-45f6f30f5cb8 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:32.865283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689bc2f-201f-4775-9048-94cbe6df9690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:32.865969 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689bc2f-201f-4775-9048-94cbe6df9690 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:32.866256 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689bc2f-201f-4775-9048-94cbe6df9690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:32.866566 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689bc2f-201f-4775-9048-94cbe6df9690 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:32.867258 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689bc2f-201f-4775-9048-94cbe6df9690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:32.867374 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecac962-6a12-49a9-89bf-be259812b3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:32.868007 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecac962-6a12-49a9-89bf-be259812b3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:32.868298 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecac962-6a12-49a9-89bf-be259812b3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:32.868606 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecac962-6a12-49a9-89bf-be259812b3a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:32.869296 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689bc2f-201f-4775-9048-94cbe6df9690 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:32.869406 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecac962-6a12-49a9-89bf-be259812b3a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:32.870892 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecac962-6a12-49a9-89bf-be259812b3a2 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:32.881923 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1399/2803] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:16:32.886383 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecac962-6a12-49a9-89bf-be259812b3a2 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:32.895359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1405/2804] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:16:32 2022] POST /identity/v3/users => generated 296 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:16:32.896768 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689bc2f-201f-4775-9048-94cbe6df9690 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:32.897585 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecac962-6a12-49a9-89bf-be259812b3a2 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:32.902403 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07014a9f-229d-42eb-b136-e64e952214fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:32.903112 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07014a9f-229d-42eb-b136-e64e952214fb admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:32.903398 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07014a9f-229d-42eb-b136-e64e952214fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:32.903705 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07014a9f-229d-42eb-b136-e64e952214fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:32.904461 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07014a9f-229d-42eb-b136-e64e952214fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:32.906125 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07014a9f-229d-42eb-b136-e64e952214fb admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:32.909047 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689bc2f-201f-4775-9048-94cbe6df9690 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:32.913930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5276feb-b7d7-4d5c-ab0b-436b9651c66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:32.914676 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5276feb-b7d7-4d5c-ab0b-436b9651c66c admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:32.915029 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5276feb-b7d7-4d5c-ab0b-436b9651c66c admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:32.915382 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5276feb-b7d7-4d5c-ab0b-436b9651c66c admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:32.916190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5276feb-b7d7-4d5c-ab0b-436b9651c66c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:32.917551 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1400/2805] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:16:32.918077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5276feb-b7d7-4d5c-ab0b-436b9651c66c admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:32.921636 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07014a9f-229d-42eb-b136-e64e952214fb admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:32.931660 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1406/2806] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:16:32.931832 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07014a9f-229d-42eb-b136-e64e952214fb admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:32.932655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5276feb-b7d7-4d5c-ab0b-436b9651c66c admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:32.936619 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77adf96-607c-400e-b5c2-cef64b22ba75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:32.937577 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77adf96-607c-400e-b5c2-cef64b22ba75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:32.937853 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77adf96-607c-400e-b5c2-cef64b22ba75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:32.938123 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77adf96-607c-400e-b5c2-cef64b22ba75 admin admin] PATH_INFO: `/v3/projects/7362fe7859b441899a374cfb736bba98/users/fb5fac7cfb46498cb89b137610b46ba6/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:32.939640 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:32.944007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5276feb-b7d7-4d5c-ab0b-436b9651c66c admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:32.950488 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88972c-2780-4046-a62c-ba96b550f099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:32.951462 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88972c-2780-4046-a62c-ba96b550f099 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:32.951754 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88972c-2780-4046-a62c-ba96b550f099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:32.952037 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88972c-2780-4046-a62c-ba96b550f099 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:32.952821 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88972c-2780-4046-a62c-ba96b550f099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:32.955078 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88972c-2780-4046-a62c-ba96b550f099 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:32.956309 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77adf96-607c-400e-b5c2-cef64b22ba75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7362fe7859b441899a374cfb736bba98, user_id=fb5fac7cfb46498cb89b137610b46ba6, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:32.958969 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77adf96-607c-400e-b5c2-cef64b22ba75 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:32.967748 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1407/2807] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:16:32.972129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88972c-2780-4046-a62c-ba96b550f099 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:32.975575 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1401/2808] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:16:32 2022] PUT /identity/v3/projects/7362fe7859b441899a374cfb736bba98/users/fb5fac7cfb46498cb89b137610b46ba6/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:32.984149 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88972c-2780-4046-a62c-ba96b550f099 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:32.985560 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c248e5e-0e96-4675-8e67-625ccd594251 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:32.986056 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c248e5e-0e96-4675-8e67-625ccd594251 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:32.986473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c248e5e-0e96-4675-8e67-625ccd594251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:33.015548 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-8c248e5e-0e96-4675-8e67-625ccd594251 None None] MFA Rules not processed for user `fb5fac7cfb46498cb89b137610b46ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:33.016951 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-8c248e5e-0e96-4675-8e67-625ccd594251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:33.045635 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0cfee-9667-4af6-9d21-d4c056aab9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:33.046529 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0cfee-9667-4af6-9d21-d4c056aab9ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:33.046831 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0cfee-9667-4af6-9d21-d4c056aab9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:33.047097 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0cfee-9667-4af6-9d21-d4c056aab9ba admin admin] PATH_INFO: `/v3/projects/efbd99d443a24062aaa6d209cb051735/users/f1c925933eb94ec0a7f83768961913c0/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:33.065571 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0cfee-9667-4af6-9d21-d4c056aab9ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=efbd99d443a24062aaa6d209cb051735, user_id=f1c925933eb94ec0a7f83768961913c0, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:33.068215 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0cfee-9667-4af6-9d21-d4c056aab9ba admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:33.081647 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1408/2809] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:16:32 2022] PUT /identity/v3/projects/efbd99d443a24062aaa6d209cb051735/users/f1c925933eb94ec0a7f83768961913c0/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:16:33.085262 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1402/2810] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:16:33.089607 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0cfee-9667-4af6-9d21-d4c056aab9ba admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:33.091783 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810dc9c-fe16-415d-a29b-a9ea43a3b5e8 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:33.092077 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810dc9c-fe16-415d-a29b-a9ea43a3b5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:33.092361 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810dc9c-fe16-415d-a29b-a9ea43a3b5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:33.123504 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-3810dc9c-fe16-415d-a29b-a9ea43a3b5e8 None None] MFA Rules not processed for user `f1c925933eb94ec0a7f83768961913c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:33.124830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3810dc9c-fe16-415d-a29b-a9ea43a3b5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:33.166364 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0cfee-9667-4af6-9d21-d4c056aab9ba admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:33.171549 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083df1f1-eb36-47d2-810e-7fb403e72aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:33.172284 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083df1f1-eb36-47d2-810e-7fb403e72aea admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:33.172608 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083df1f1-eb36-47d2-810e-7fb403e72aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:33.172888 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083df1f1-eb36-47d2-810e-7fb403e72aea admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:33.174315 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083df1f1-eb36-47d2-810e-7fb403e72aea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:33.176441 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083df1f1-eb36-47d2-810e-7fb403e72aea admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:33.195654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1403/2811] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:16:33.206944 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810dc9c-fe16-415d-a29b-a9ea43a3b5e8 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:33.207540 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1409/2812] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:16:33 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:16:33.208659 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-3810dc9c-fe16-415d-a29b-a9ea43a3b5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:33.211730 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083df1f1-eb36-47d2-810e-7fb403e72aea admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:33.228358 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:33.272176 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810dc9c-fe16-415d-a29b-a9ea43a3b5e8 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:33.288424 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083df1f1-eb36-47d2-810e-7fb403e72aea admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:33.293210 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e884c-83a6-417c-bb94-956bffa1b123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:33.293909 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e884c-83a6-417c-bb94-956bffa1b123 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:33.294190 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e884c-83a6-417c-bb94-956bffa1b123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:33.294463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e884c-83a6-417c-bb94-956bffa1b123 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:33.295168 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e884c-83a6-417c-bb94-956bffa1b123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:33.297102 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e884c-83a6-417c-bb94-956bffa1b123 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:33.305319 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:33.329634 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1410/2813] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:16:33 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:16:33.329930 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be23a9f-2d8b-4b46-ad27-fc11ad6b50c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:33.329930 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be23a9f-2d8b-4b46-ad27-fc11ad6b50c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:33.329930 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be23a9f-2d8b-4b46-ad27-fc11ad6b50c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:33.329930 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be23a9f-2d8b-4b46-ad27-fc11ad6b50c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:33.330433 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e884c-83a6-417c-bb94-956bffa1b123 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:33.344710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e884c-83a6-417c-bb94-956bffa1b123 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:33.349561 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2432f-b707-4ee6-9956-f22dddafa485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:33.350228 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2432f-b707-4ee6-9956-f22dddafa485 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:33.350514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2432f-b707-4ee6-9956-f22dddafa485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:33.350790 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2432f-b707-4ee6-9956-f22dddafa485 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:33.351602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2432f-b707-4ee6-9956-f22dddafa485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:33.353280 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2432f-b707-4ee6-9956-f22dddafa485 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:33.373655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1411/2814] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:16:33.378375 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2432f-b707-4ee6-9956-f22dddafa485 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:33.388576 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2432f-b707-4ee6-9956-f22dddafa485 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:33.393463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e6873-8eb7-4a1c-acab-a964cd1c6f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:33.394512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e6873-8eb7-4a1c-acab-a964cd1c6f64 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:33.394512 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e6873-8eb7-4a1c-acab-a964cd1c6f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:33.394673 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e6873-8eb7-4a1c-acab-a964cd1c6f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:33.395365 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e6873-8eb7-4a1c-acab-a964cd1c6f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:33.397360 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e6873-8eb7-4a1c-acab-a964cd1c6f64 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:33.398736 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be23a9f-2d8b-4b46-ad27-fc11ad6b50c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:33.400188 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be23a9f-2d8b-4b46-ad27-fc11ad6b50c0 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:33.409581 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1412/2815] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:16:33.410705 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1404/2816] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:16:33.413876 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e6873-8eb7-4a1c-acab-a964cd1c6f64 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:33.425452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e6873-8eb7-4a1c-acab-a964cd1c6f64 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:33.431150 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36800f-db9e-4e06-908e-215edbe89159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:33.432111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36800f-db9e-4e06-908e-215edbe89159 admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:33.432498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36800f-db9e-4e06-908e-215edbe89159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:33.432844 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36800f-db9e-4e06-908e-215edbe89159 admin admin] PATH_INFO: `/v3/projects/6e9c3975ec9b47768970b615a779d611/users/b81b946a4bc9442cb5de8e776084505a/roles/4749055b54a542b29f57155df3756136` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:33.447840 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36800f-db9e-4e06-908e-215edbe89159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9c3975ec9b47768970b615a779d611, user_id=b81b946a4bc9442cb5de8e776084505a, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:33.450784 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36800f-db9e-4e06-908e-215edbe89159 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:33.464343 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1413/2817] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:16:33 2022] PUT /identity/v3/projects/6e9c3975ec9b47768970b615a779d611/users/b81b946a4bc9442cb5de8e776084505a/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:16:33.480067 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf1c3b-eb22-4ac2-add1-4606fc6ba851 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:33.480361 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf1c3b-eb22-4ac2-add1-4606fc6ba851 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:33.480673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf1c3b-eb22-4ac2-add1-4606fc6ba851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:33.508531 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-94bf1c3b-eb22-4ac2-add1-4606fc6ba851 None None] MFA Rules not processed for user `b81b946a4bc9442cb5de8e776084505a`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:33.509920 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-94bf1c3b-eb22-4ac2-add1-4606fc6ba851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:33.592348 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1405/2818] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:33.599019 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36800f-db9e-4e06-908e-215edbe89159 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:33.671341 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36800f-db9e-4e06-908e-215edbe89159 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:33.682590 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792c857-91fa-4dfe-bd64-9fe4d10fe308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:33.683852 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792c857-91fa-4dfe-bd64-9fe4d10fe308 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:33.684674 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792c857-91fa-4dfe-bd64-9fe4d10fe308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:33.685046 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792c857-91fa-4dfe-bd64-9fe4d10fe308 admin admin] PATH_INFO: `/v3/projects` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:33.685996 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792c857-91fa-4dfe-bd64-9fe4d10fe308 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:33.688739 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792c857-91fa-4dfe-bd64-9fe4d10fe308 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:33.730070 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1414/2819] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:16:33 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:16:33.734155 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf1c3b-eb22-4ac2-add1-4606fc6ba851 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:33.748623 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf1c3b-eb22-4ac2-add1-4606fc6ba851 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:33.762587 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=100 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:33.813002 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa98b62-47db-4f82-8ec5-bc4e5db212fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:33.813672 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa98b62-47db-4f82-8ec5-bc4e5db212fc admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:33.814507 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa98b62-47db-4f82-8ec5-bc4e5db212fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:33.814995 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa98b62-47db-4f82-8ec5-bc4e5db212fc admin admin] PATH_INFO: `/v3/users` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:33.816263 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa98b62-47db-4f82-8ec5-bc4e5db212fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:33.818545 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa98b62-47db-4f82-8ec5-bc4e5db212fc admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:33.849304 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1406/2820] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:16:33 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:16:33.853356 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792c857-91fa-4dfe-bd64-9fe4d10fe308 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:33.864665 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792c857-91fa-4dfe-bd64-9fe4d10fe308 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:33.869539 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433875f-ae15-46ea-8924-69666459483d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:33.870277 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433875f-ae15-46ea-8924-69666459483d admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:33.870727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433875f-ae15-46ea-8924-69666459483d admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:33.870926 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433875f-ae15-46ea-8924-69666459483d admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:33.871569 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433875f-ae15-46ea-8924-69666459483d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:33.873212 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433875f-ae15-46ea-8924-69666459483d admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:33.885558 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1415/2821] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:16:33.891083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa98b62-47db-4f82-8ec5-bc4e5db212fc admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:33.901634 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa98b62-47db-4f82-8ec5-bc4e5db212fc admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:33.906753 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4e6c9-7c82-412b-85be-2c1a06636a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:33.907699 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4e6c9-7c82-412b-85be-2c1a06636a3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:33.908210 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4e6c9-7c82-412b-85be-2c1a06636a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:33.908695 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4e6c9-7c82-412b-85be-2c1a06636a3e admin admin] PATH_INFO: `/v3/projects/54516c78ad1b45e28a2784d428678e87/users/986141320a6a41afba66f872d3bc5a00/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:33.923817 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4e6c9-7c82-412b-85be-2c1a06636a3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=54516c78ad1b45e28a2784d428678e87, user_id=986141320a6a41afba66f872d3bc5a00, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:33.926782 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4e6c9-7c82-412b-85be-2c1a06636a3e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:33.948488 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1407/2822] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:16:33 2022] PUT /identity/v3/projects/54516c78ad1b45e28a2784d428678e87/users/986141320a6a41afba66f872d3bc5a00/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:16:33.952392 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433875f-ae15-46ea-8924-69666459483d admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:33.962644 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433875f-ae15-46ea-8924-69666459483d admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:34.022523 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c581be-3c7f-4e9d-a51c-b33ae211d666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:34.023207 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c581be-3c7f-4e9d-a51c-b33ae211d666 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:34.023498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c581be-3c7f-4e9d-a51c-b33ae211d666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:34.023808 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c581be-3c7f-4e9d-a51c-b33ae211d666 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:34.024573 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c581be-3c7f-4e9d-a51c-b33ae211d666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:34.026188 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c581be-3c7f-4e9d-a51c-b33ae211d666 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:34.037103 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1416/2823] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:16:34.041275 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4e6c9-7c82-412b-85be-2c1a06636a3e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:34.052232 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4e6c9-7c82-412b-85be-2c1a06636a3e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:34.057050 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e228ae-8e10-4673-b0b3-70f6b57dc41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:34.057928 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e228ae-8e10-4673-b0b3-70f6b57dc41d admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:34.058207 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e228ae-8e10-4673-b0b3-70f6b57dc41d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:34.058481 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e228ae-8e10-4673-b0b3-70f6b57dc41d admin admin] PATH_INFO: `/v3/projects/54516c78ad1b45e28a2784d428678e87/users/986141320a6a41afba66f872d3bc5a00/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:34.060432 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e228ae-8e10-4673-b0b3-70f6b57dc41d admin admin] RBAC: Authorizing `identity:create_grant(project_id=54516c78ad1b45e28a2784d428678e87, user_id=986141320a6a41afba66f872d3bc5a00, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:34.063070 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e228ae-8e10-4673-b0b3-70f6b57dc41d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:34.073309 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1408/2824] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:16:34 2022] PUT /identity/v3/projects/54516c78ad1b45e28a2784d428678e87/users/986141320a6a41afba66f872d3bc5a00/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:34.084665 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53aa22-1b2a-46c3-9715-480441cd270c None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:34.084959 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53aa22-1b2a-46c3-9715-480441cd270c None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:34.085267 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53aa22-1b2a-46c3-9715-480441cd270c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:34.113431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-3f53aa22-1b2a-46c3-9715-480441cd270c None None] MFA Rules not processed for user `986141320a6a41afba66f872d3bc5a00`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:34.114647 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-3f53aa22-1b2a-46c3-9715-480441cd270c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:34.118674 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:34.187907 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1417/2825] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:34.200780 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e228ae-8e10-4673-b0b3-70f6b57dc41d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:34.266287 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e228ae-8e10-4673-b0b3-70f6b57dc41d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:34.271003 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67ef73-a66f-46e3-8975-bf7cdb9ebd5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:34.271705 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67ef73-a66f-46e3-8975-bf7cdb9ebd5c service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:34.272218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67ef73-a66f-46e3-8975-bf7cdb9ebd5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:34.272595 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67ef73-a66f-46e3-8975-bf7cdb9ebd5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:34.336600 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67ef73-a66f-46e3-8975-bf7cdb9ebd5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:34.338059 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67ef73-a66f-46e3-8975-bf7cdb9ebd5c service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:34.350272 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1409/2826] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:16:35.856129 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53aa22-1b2a-46c3-9715-480441cd270c None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:35.866669 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53aa22-1b2a-46c3-9715-480441cd270c None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:35.870299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb34f5e-a5b6-42e9-b79a-ae8635a67827 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:35.870956 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb34f5e-a5b6-42e9-b79a-ae8635a67827 service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:35.871240 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb34f5e-a5b6-42e9-b79a-ae8635a67827 service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:35.871517 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb34f5e-a5b6-42e9-b79a-ae8635a67827 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:35.931667 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb34f5e-a5b6-42e9-b79a-ae8635a67827 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:35.933166 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb34f5e-a5b6-42e9-b79a-ae8635a67827 service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:35.942704 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1418/2827] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:16:36.523635 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67ef73-a66f-46e3-8975-bf7cdb9ebd5c service cinder] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:36.532197 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67ef73-a66f-46e3-8975-bf7cdb9ebd5c service cinder] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:36.536196 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd839ba-b7b3-4360-b6ca-4ebbccb71828 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:36.536924 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd839ba-b7b3-4360-b6ca-4ebbccb71828 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:36.537195 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd839ba-b7b3-4360-b6ca-4ebbccb71828 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:36.537475 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd839ba-b7b3-4360-b6ca-4ebbccb71828 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:36.548354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd839ba-b7b3-4360-b6ca-4ebbccb71828 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:36.549828 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd839ba-b7b3-4360-b6ca-4ebbccb71828 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:36.559375 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1410/2828] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:36 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:16:40.469634 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb34f5e-a5b6-42e9-b79a-ae8635a67827 service cinder] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:40.533784 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb34f5e-a5b6-42e9-b79a-ae8635a67827 service cinder] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:40.538556 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c61a93-a8b9-4768-bb35-a2acc5185048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:40.539441 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c61a93-a8b9-4768-bb35-a2acc5185048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:40.539720 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c61a93-a8b9-4768-bb35-a2acc5185048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:40.539995 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c61a93-a8b9-4768-bb35-a2acc5185048 admin admin] PATH_INFO: `/v3/users/fb5fac7cfb46498cb89b137610b46ba6` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:40.541225 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c61a93-a8b9-4768-bb35-a2acc5185048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb5fac7cfb46498cb89b137610b46ba6)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:40.543164 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c61a93-a8b9-4768-bb35-a2acc5185048 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:40.587514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:40.593415 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-65c61a93-a8b9-4768-bb35-a2acc5185048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb5fac7cfb46498cb89b137610b46ba6'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:40.600660 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-65c61a93-a8b9-4768-bb35-a2acc5185048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb5fac7cfb46498cb89b137610b46ba6'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:40.601336 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-65c61a93-a8b9-4768-bb35-a2acc5185048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb5fac7cfb46498cb89b137610b46ba6'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:40.614874 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-65c61a93-a8b9-4768-bb35-a2acc5185048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb5fac7cfb46498cb89b137610b46ba6'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:40.623121 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-65c61a93-a8b9-4768-bb35-a2acc5185048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb5fac7cfb46498cb89b137610b46ba6'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:40.630172 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1419/2829] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:16:40 2022] DELETE /identity/v3/users/fb5fac7cfb46498cb89b137610b46ba6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:40.634916 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27055251-b3c7-43b8-9e7d-be4683f842e4 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:40.635715 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27055251-b3c7-43b8-9e7d-be4683f842e4 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:40.635830 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27055251-b3c7-43b8-9e7d-be4683f842e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:40.652923 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-27055251-b3c7-43b8-9e7d-be4683f842e4 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:40.654179 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-27055251-b3c7-43b8-9e7d-be4683f842e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:40.658204 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:40.735158 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1411/2830] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:16:40.745880 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c61a93-a8b9-4768-bb35-a2acc5185048 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:40.747299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-65c61a93-a8b9-4768-bb35-a2acc5185048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:40.816690 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c61a93-a8b9-4768-bb35-a2acc5185048 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:40.820821 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59e603-4961-4b24-a79a-ab23c3e64c4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:40.821500 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59e603-4961-4b24-a79a-ab23c3e64c4b service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:40.821796 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59e603-4961-4b24-a79a-ab23c3e64c4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:40.822072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59e603-4961-4b24-a79a-ab23c3e64c4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:40.832917 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59e603-4961-4b24-a79a-ab23c3e64c4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:40.834612 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59e603-4961-4b24-a79a-ab23c3e64c4b service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:40.844358 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1420/2831] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:16:41.136891 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27055251-b3c7-43b8-9e7d-be4683f842e4 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:41.138462 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-27055251-b3c7-43b8-9e7d-be4683f842e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:41.150948 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27055251-b3c7-43b8-9e7d-be4683f842e4 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:41.155730 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a568df-08dc-4bd8-b6e5-ce5990c152ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:41.156626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a568df-08dc-4bd8-b6e5-ce5990c152ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:41.156910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a568df-08dc-4bd8-b6e5-ce5990c152ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:41.157187 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a568df-08dc-4bd8-b6e5-ce5990c152ce admin admin] PATH_INFO: `/v3/projects/7362fe7859b441899a374cfb736bba98` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:41.159118 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a568df-08dc-4bd8-b6e5-ce5990c152ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=7362fe7859b441899a374cfb736bba98)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:41.161083 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a568df-08dc-4bd8-b6e5-ce5990c152ce admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:41.212183 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-05a568df-08dc-4bd8-b6e5-ce5990c152ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7362fe7859b441899a374cfb736bba98', 'request_id': 'req-05a568df-08dc-4bd8-b6e5-ce5990c152ce'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:41.218348 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-05a568df-08dc-4bd8-b6e5-ce5990c152ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7362fe7859b441899a374cfb736bba98', 'request_id': 'req-05a568df-08dc-4bd8-b6e5-ce5990c152ce'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:41.227604 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-05a568df-08dc-4bd8-b6e5-ce5990c152ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7362fe7859b441899a374cfb736bba98', 'request_id': 'req-05a568df-08dc-4bd8-b6e5-ce5990c152ce'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:41.240111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-05a568df-08dc-4bd8-b6e5-ce5990c152ce admin admin] The token cache is being invalidate because project 7362fe7859b441899a374cfb736bba98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:16:41.240423 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-05a568df-08dc-4bd8-b6e5-ce5990c152ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:41.241145 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-05a568df-08dc-4bd8-b6e5-ce5990c152ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:41.242751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1412/2832] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:16:41 2022] DELETE /identity/v3/projects/7362fe7859b441899a374cfb736bba98 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:41.246843 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59e603-4961-4b24-a79a-ab23c3e64c4b service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:41.257331 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59e603-4961-4b24-a79a-ab23c3e64c4b service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:41.319800 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e57e93-43c3-46ec-89ca-3d3b8709d44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:41.320593 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e57e93-43c3-46ec-89ca-3d3b8709d44a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:41.320874 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e57e93-43c3-46ec-89ca-3d3b8709d44a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:41.321147 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e57e93-43c3-46ec-89ca-3d3b8709d44a admin admin] PATH_INFO: `/v3/users/b81b946a4bc9442cb5de8e776084505a` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:41.322351 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e57e93-43c3-46ec-89ca-3d3b8709d44a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b81b946a4bc9442cb5de8e776084505a)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:41.324252 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e57e93-43c3-46ec-89ca-3d3b8709d44a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:41.399433 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-70e57e93-43c3-46ec-89ca-3d3b8709d44a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b81b946a4bc9442cb5de8e776084505a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:41.407055 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-70e57e93-43c3-46ec-89ca-3d3b8709d44a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b81b946a4bc9442cb5de8e776084505a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:41.408335 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-70e57e93-43c3-46ec-89ca-3d3b8709d44a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b81b946a4bc9442cb5de8e776084505a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:41.413679 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:41.421808 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-70e57e93-43c3-46ec-89ca-3d3b8709d44a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b81b946a4bc9442cb5de8e776084505a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:41.429695 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-70e57e93-43c3-46ec-89ca-3d3b8709d44a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b81b946a4bc9442cb5de8e776084505a'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:41.436200 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1421/2833] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:16:41 2022] DELETE /identity/v3/users/b81b946a4bc9442cb5de8e776084505a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:41.720365 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a568df-08dc-4bd8-b6e5-ce5990c152ce admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:41.722306 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-05a568df-08dc-4bd8-b6e5-ce5990c152ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:41.738178 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a568df-08dc-4bd8-b6e5-ce5990c152ce admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:41.806175 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eacb16-3ebc-439e-ae43-fa1f8e17c5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:41.807075 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eacb16-3ebc-439e-ae43-fa1f8e17c5ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:41.807252 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eacb16-3ebc-439e-ae43-fa1f8e17c5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:41.807528 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eacb16-3ebc-439e-ae43-fa1f8e17c5ae admin admin] PATH_INFO: `/v3/projects/6e9c3975ec9b47768970b615a779d611` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:41.808943 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eacb16-3ebc-439e-ae43-fa1f8e17c5ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9c3975ec9b47768970b615a779d611)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:41.810985 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eacb16-3ebc-439e-ae43-fa1f8e17c5ae admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:41.853874 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:41.864865 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d9eacb16-3ebc-439e-ae43-fa1f8e17c5ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9c3975ec9b47768970b615a779d611', 'request_id': 'req-d9eacb16-3ebc-439e-ae43-fa1f8e17c5ae'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:41.873299 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d9eacb16-3ebc-439e-ae43-fa1f8e17c5ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9c3975ec9b47768970b615a779d611', 'request_id': 'req-d9eacb16-3ebc-439e-ae43-fa1f8e17c5ae'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:41.882273 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d9eacb16-3ebc-439e-ae43-fa1f8e17c5ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9c3975ec9b47768970b615a779d611', 'request_id': 'req-d9eacb16-3ebc-439e-ae43-fa1f8e17c5ae'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:41.893654 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d9eacb16-3ebc-439e-ae43-fa1f8e17c5ae admin admin] The token cache is being invalidate because project 6e9c3975ec9b47768970b615a779d611 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:16:41.893931 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d9eacb16-3ebc-439e-ae43-fa1f8e17c5ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:41.894560 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-d9eacb16-3ebc-439e-ae43-fa1f8e17c5ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:41.896210 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1413/2834] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:16:41 2022] DELETE /identity/v3/projects/6e9c3975ec9b47768970b615a779d611 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:16:41.900061 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e57e93-43c3-46ec-89ca-3d3b8709d44a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:41.901495 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-70e57e93-43c3-46ec-89ca-3d3b8709d44a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:41.915510 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e57e93-43c3-46ec-89ca-3d3b8709d44a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:41.984689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15514158-0f47-4049-8c11-d162898ff4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:41.985692 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15514158-0f47-4049-8c11-d162898ff4cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:41.986095 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15514158-0f47-4049-8c11-d162898ff4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:41.986440 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15514158-0f47-4049-8c11-d162898ff4cf admin admin] PATH_INFO: `/v3/users/986141320a6a41afba66f872d3bc5a00` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:41.987648 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15514158-0f47-4049-8c11-d162898ff4cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=986141320a6a41afba66f872d3bc5a00)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:41.989606 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15514158-0f47-4049-8c11-d162898ff4cf admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:42.040780 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-15514158-0f47-4049-8c11-d162898ff4cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '986141320a6a41afba66f872d3bc5a00'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:42.047680 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-15514158-0f47-4049-8c11-d162898ff4cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '986141320a6a41afba66f872d3bc5a00'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:42.049744 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-15514158-0f47-4049-8c11-d162898ff4cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '986141320a6a41afba66f872d3bc5a00'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:42.061795 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-15514158-0f47-4049-8c11-d162898ff4cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '986141320a6a41afba66f872d3bc5a00'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:42.071054 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-15514158-0f47-4049-8c11-d162898ff4cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '986141320a6a41afba66f872d3bc5a00'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:42.077761 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1422/2835] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:16:41 2022] DELETE /identity/v3/users/986141320a6a41afba66f872d3bc5a00 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:42.353241 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eacb16-3ebc-439e-ae43-fa1f8e17c5ae admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:42.354848 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-d9eacb16-3ebc-439e-ae43-fa1f8e17c5ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:42.373452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eacb16-3ebc-439e-ae43-fa1f8e17c5ae admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:42.438692 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c359f2-1469-414c-96e2-5c13ed6598db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:42.439861 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c359f2-1469-414c-96e2-5c13ed6598db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:42.440254 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c359f2-1469-414c-96e2-5c13ed6598db admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:42.440482 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c359f2-1469-414c-96e2-5c13ed6598db admin admin] PATH_INFO: `/v3/projects/54516c78ad1b45e28a2784d428678e87` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:42.441771 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c359f2-1469-414c-96e2-5c13ed6598db admin admin] RBAC: Authorizing `identity:delete_project(project_id=54516c78ad1b45e28a2784d428678e87)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:42.443696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c359f2-1469-414c-96e2-5c13ed6598db admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:42.496193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-72c359f2-1469-414c-96e2-5c13ed6598db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54516c78ad1b45e28a2784d428678e87', 'request_id': 'req-72c359f2-1469-414c-96e2-5c13ed6598db'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:42.502927 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-72c359f2-1469-414c-96e2-5c13ed6598db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54516c78ad1b45e28a2784d428678e87', 'request_id': 'req-72c359f2-1469-414c-96e2-5c13ed6598db'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:42.511418 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-72c359f2-1469-414c-96e2-5c13ed6598db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54516c78ad1b45e28a2784d428678e87', 'request_id': 'req-72c359f2-1469-414c-96e2-5c13ed6598db'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:42.523429 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-72c359f2-1469-414c-96e2-5c13ed6598db admin admin] The token cache is being invalidate because project 54516c78ad1b45e28a2784d428678e87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:16:42.523720 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-72c359f2-1469-414c-96e2-5c13ed6598db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:42.524368 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-72c359f2-1469-414c-96e2-5c13ed6598db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:42.525929 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1414/2836] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:16:42 2022] DELETE /identity/v3/projects/54516c78ad1b45e28a2784d428678e87 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:42.530708 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7bd56-5e30-4063-9b9d-96519421a612 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:42.531073 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7bd56-5e30-4063-9b9d-96519421a612 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:42.531362 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7bd56-5e30-4063-9b9d-96519421a612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:42.551929 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-9ef7bd56-5e30-4063-9b9d-96519421a612 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:42.553235 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-9ef7bd56-5e30-4063-9b9d-96519421a612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:42.608659 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:42.619740 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1423/2837] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:42.634788 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe46bb-780c-4074-9815-f12b71f70637 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:42.635284 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe46bb-780c-4074-9815-f12b71f70637 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:42.635553 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe46bb-780c-4074-9815-f12b71f70637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:42.656507 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-5efe46bb-780c-4074-9815-f12b71f70637 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:42.658218 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-5efe46bb-780c-4074-9815-f12b71f70637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:42.666530 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1415/2838] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:42.671597 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7bd56-5e30-4063-9b9d-96519421a612 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:42.682290 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7bd56-5e30-4063-9b9d-96519421a612 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:42.687362 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc8a4a-8424-4018-840e-a2c125cc18c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:42.688032 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc8a4a-8424-4018-840e-a2c125cc18c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:42.688329 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc8a4a-8424-4018-840e-a2c125cc18c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:42.688686 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc8a4a-8424-4018-840e-a2c125cc18c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:42.689525 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc8a4a-8424-4018-840e-a2c125cc18c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:16:42.689846 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc8a4a-8424-4018-840e-a2c125cc18c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:42.691465 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc8a4a-8424-4018-840e-a2c125cc18c4 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:42.705067 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1424/2839] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:16:42.709602 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe46bb-780c-4074-9815-f12b71f70637 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:42.719701 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe46bb-780c-4074-9815-f12b71f70637 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:42.724983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a5044-ceff-4ca9-807c-0ab062d4a50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:42.725841 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a5044-ceff-4ca9-807c-0ab062d4a50c admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:42.726188 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a5044-ceff-4ca9-807c-0ab062d4a50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:42.726488 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a5044-ceff-4ca9-807c-0ab062d4a50c admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:42.727169 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a5044-ceff-4ca9-807c-0ab062d4a50c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:42.729106 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a5044-ceff-4ca9-807c-0ab062d4a50c admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:42.758331 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1416/2840] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:16:42 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:16:42.762726 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc8a4a-8424-4018-840e-a2c125cc18c4 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:42.773429 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc8a4a-8424-4018-840e-a2c125cc18c4 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:42.834050 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bba5f5-3f3a-43b1-a68b-19670f2ac498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:42.834727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bba5f5-3f3a-43b1-a68b-19670f2ac498 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:42.835007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bba5f5-3f3a-43b1-a68b-19670f2ac498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:42.835276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bba5f5-3f3a-43b1-a68b-19670f2ac498 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:42.835959 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bba5f5-3f3a-43b1-a68b-19670f2ac498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:42.837895 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bba5f5-3f3a-43b1-a68b-19670f2ac498 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:42.860287 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1425/2841] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:16:42 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:16:42.863559 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a5044-ceff-4ca9-807c-0ab062d4a50c admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:42.874169 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a5044-ceff-4ca9-807c-0ab062d4a50c admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:42.879023 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195666e9-24e7-4d2e-9779-eb14668bbd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:42.879691 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195666e9-24e7-4d2e-9779-eb14668bbd8e admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:42.879977 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195666e9-24e7-4d2e-9779-eb14668bbd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:42.880284 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195666e9-24e7-4d2e-9779-eb14668bbd8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:42.881057 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195666e9-24e7-4d2e-9779-eb14668bbd8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:42.882662 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195666e9-24e7-4d2e-9779-eb14668bbd8e admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:42.894215 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1417/2842] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:16:42.898650 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bba5f5-3f3a-43b1-a68b-19670f2ac498 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:42.911632 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bba5f5-3f3a-43b1-a68b-19670f2ac498 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:42.916632 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b489e7-f960-42f7-adee-8f72d6d34d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:42.917307 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b489e7-f960-42f7-adee-8f72d6d34d89 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:42.917596 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b489e7-f960-42f7-adee-8f72d6d34d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:42.917876 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b489e7-f960-42f7-adee-8f72d6d34d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:42.918718 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b489e7-f960-42f7-adee-8f72d6d34d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:42.920327 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b489e7-f960-42f7-adee-8f72d6d34d89 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:42.930784 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1426/2843] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 22:16:42.934972 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195666e9-24e7-4d2e-9779-eb14668bbd8e admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:42.945601 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195666e9-24e7-4d2e-9779-eb14668bbd8e admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:42.950164 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89863d73-5309-45bb-8d10-f8ae63b4265d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:42.951043 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89863d73-5309-45bb-8d10-f8ae63b4265d admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:42.951320 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89863d73-5309-45bb-8d10-f8ae63b4265d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:42.951592 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89863d73-5309-45bb-8d10-f8ae63b4265d admin admin] PATH_INFO: `/v3/projects/7aa92b411345490eb693aecfd5c166ee/users/690c315bf19b4b07beb2d1e7ca610f41/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:42.964616 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:42.969763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89863d73-5309-45bb-8d10-f8ae63b4265d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aa92b411345490eb693aecfd5c166ee, user_id=690c315bf19b4b07beb2d1e7ca610f41, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:42.974009 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89863d73-5309-45bb-8d10-f8ae63b4265d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:42.987242 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1418/2844] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:16:42 2022] PUT /identity/v3/projects/7aa92b411345490eb693aecfd5c166ee/users/690c315bf19b4b07beb2d1e7ca610f41/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:42.992548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62219738-c964-4f6f-b6f6-e5d20636e27f None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:42.992841 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62219738-c964-4f6f-b6f6-e5d20636e27f None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:42.993122 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62219738-c964-4f6f-b6f6-e5d20636e27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:43.011828 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-62219738-c964-4f6f-b6f6-e5d20636e27f None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:43.013111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-62219738-c964-4f6f-b6f6-e5d20636e27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:43.080180 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1427/2845] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:43.089920 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89863d73-5309-45bb-8d10-f8ae63b4265d admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:43.091754 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-89863d73-5309-45bb-8d10-f8ae63b4265d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:43.151925 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89863d73-5309-45bb-8d10-f8ae63b4265d admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:43.155479 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf216518-6c17-4c18-a813-2ae9e952d97c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:43.156126 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf216518-6c17-4c18-a813-2ae9e952d97c service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:43.156430 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf216518-6c17-4c18-a813-2ae9e952d97c service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:43.156723 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf216518-6c17-4c18-a813-2ae9e952d97c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:43.166955 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf216518-6c17-4c18-a813-2ae9e952d97c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:43.168550 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf216518-6c17-4c18-a813-2ae9e952d97c service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:43.179085 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1419/2846] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:16:43.552000 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62219738-c964-4f6f-b6f6-e5d20636e27f None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:43.553903 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-62219738-c964-4f6f-b6f6-e5d20636e27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:43.567187 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62219738-c964-4f6f-b6f6-e5d20636e27f None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:43.574474 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbb884-4bd6-43e3-b781-36e8dfb856bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:43.575935 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbb884-4bd6-43e3-b781-36e8dfb856bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:43.576295 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbb884-4bd6-43e3-b781-36e8dfb856bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:43.576691 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbb884-4bd6-43e3-b781-36e8dfb856bd admin admin] PATH_INFO: `/v3/users/f1c925933eb94ec0a7f83768961913c0` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:43.578069 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbb884-4bd6-43e3-b781-36e8dfb856bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1c925933eb94ec0a7f83768961913c0)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:43.590300 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbb884-4bd6-43e3-b781-36e8dfb856bd admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:43.652840 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a9cbb884-4bd6-43e3-b781-36e8dfb856bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1c925933eb94ec0a7f83768961913c0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:43.660497 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a9cbb884-4bd6-43e3-b781-36e8dfb856bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1c925933eb94ec0a7f83768961913c0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:43.661313 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a9cbb884-4bd6-43e3-b781-36e8dfb856bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1c925933eb94ec0a7f83768961913c0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:43.666543 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:43.698463 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a9cbb884-4bd6-43e3-b781-36e8dfb856bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1c925933eb94ec0a7f83768961913c0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:43.707007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-a9cbb884-4bd6-43e3-b781-36e8dfb856bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1c925933eb94ec0a7f83768961913c0'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:43.713505 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1428/2847] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:16:43 2022] DELETE /identity/v3/users/f1c925933eb94ec0a7f83768961913c0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:43.718222 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f49fc-b27b-44cc-a87d-9317f9f96f12 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:43.718514 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f49fc-b27b-44cc-a87d-9317f9f96f12 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:43.718788 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f49fc-b27b-44cc-a87d-9317f9f96f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:43.738498 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-2f9f49fc-b27b-44cc-a87d-9317f9f96f12 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:43.739844 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2f9f49fc-b27b-44cc-a87d-9317f9f96f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:43.805166 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1420/2848] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:43.816272 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbb884-4bd6-43e3-b781-36e8dfb856bd admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:43.817765 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-a9cbb884-4bd6-43e3-b781-36e8dfb856bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:43.897323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbb884-4bd6-43e3-b781-36e8dfb856bd admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:43.901690 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871a12b-ed73-4a5c-b06b-baaf33a08030 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:43.902011 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871a12b-ed73-4a5c-b06b-baaf33a08030 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:43.902263 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871a12b-ed73-4a5c-b06b-baaf33a08030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:43.903974 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c29fa-f0e8-4e57-8533-70a6b95a12c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:43.904785 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c29fa-f0e8-4e57-8533-70a6b95a12c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:43.905077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c29fa-f0e8-4e57-8533-70a6b95a12c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:43.905369 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c29fa-f0e8-4e57-8533-70a6b95a12c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:43.917056 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c29fa-f0e8-4e57-8533-70a6b95a12c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:43.919029 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c29fa-f0e8-4e57-8533-70a6b95a12c9 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:43.930126 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1429/2849] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:16:43.938282 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-9871a12b-ed73-4a5c-b06b-baaf33a08030 None None] MFA Rules not processed for user `690c315bf19b4b07beb2d1e7ca610f41`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:43.939912 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9871a12b-ed73-4a5c-b06b-baaf33a08030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:44.028892 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1421/2850] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:16:44.041930 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c29fa-f0e8-4e57-8533-70a6b95a12c9 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:44.044385 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f79c29fa-f0e8-4e57-8533-70a6b95a12c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:44.125372 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c29fa-f0e8-4e57-8533-70a6b95a12c9 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:44.130062 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106cca9-3f64-4549-9043-3657f357688c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:44.130737 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106cca9-3f64-4549-9043-3657f357688c service cinder] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:44.131029 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106cca9-3f64-4549-9043-3657f357688c service cinder] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:44.131367 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106cca9-3f64-4549-9043-3657f357688c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:44.143064 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106cca9-3f64-4549-9043-3657f357688c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:44.144940 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106cca9-3f64-4549-9043-3657f357688c service cinder] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:44.155441 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1430/2851] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:16:44.246885 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871a12b-ed73-4a5c-b06b-baaf33a08030 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:44.249305 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9871a12b-ed73-4a5c-b06b-baaf33a08030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:44.265877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871a12b-ed73-4a5c-b06b-baaf33a08030 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:44.272544 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c2d6b-314e-40e3-8dc9-49d4a61ac6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:44.273913 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c2d6b-314e-40e3-8dc9-49d4a61ac6e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:44.274256 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c2d6b-314e-40e3-8dc9-49d4a61ac6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:44.274616 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c2d6b-314e-40e3-8dc9-49d4a61ac6e1 admin admin] PATH_INFO: `/v3/projects/efbd99d443a24062aaa6d209cb051735` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:44.275930 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c2d6b-314e-40e3-8dc9-49d4a61ac6e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efbd99d443a24062aaa6d209cb051735)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:44.278035 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c2d6b-314e-40e3-8dc9-49d4a61ac6e1 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:44.297119 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:44.341547 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b40c2d6b-314e-40e3-8dc9-49d4a61ac6e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efbd99d443a24062aaa6d209cb051735', 'request_id': 'req-b40c2d6b-314e-40e3-8dc9-49d4a61ac6e1'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:44.349652 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b40c2d6b-314e-40e3-8dc9-49d4a61ac6e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efbd99d443a24062aaa6d209cb051735', 'request_id': 'req-b40c2d6b-314e-40e3-8dc9-49d4a61ac6e1'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:44.357148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b40c2d6b-314e-40e3-8dc9-49d4a61ac6e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efbd99d443a24062aaa6d209cb051735', 'request_id': 'req-b40c2d6b-314e-40e3-8dc9-49d4a61ac6e1'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:44.370963 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b40c2d6b-314e-40e3-8dc9-49d4a61ac6e1 admin admin] The token cache is being invalidate because project efbd99d443a24062aaa6d209cb051735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:16:44.371312 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b40c2d6b-314e-40e3-8dc9-49d4a61ac6e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:44.371991 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-b40c2d6b-314e-40e3-8dc9-49d4a61ac6e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:16:44.373567 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1422/2852] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:16:44 2022] DELETE /identity/v3/projects/efbd99d443a24062aaa6d209cb051735 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:16:45.571229 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf2822-c834-4782-98bc-7aaee8fc37f4 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:45.571992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf2822-c834-4782-98bc-7aaee8fc37f4 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:45.571992 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf2822-c834-4782-98bc-7aaee8fc37f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:45.590185 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-7acf2822-c834-4782-98bc-7aaee8fc37f4 None None] MFA Rules not processed for user `690c315bf19b4b07beb2d1e7ca610f41`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:16:45.591666 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7acf2822-c834-4782-98bc-7aaee8fc37f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:45.660747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1431/2853] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:16:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:16:45.702544 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c2d6b-314e-40e3-8dc9-49d4a61ac6e1 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:45.704204 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b40c2d6b-314e-40e3-8dc9-49d4a61ac6e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:45.764267 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c2d6b-314e-40e3-8dc9-49d4a61ac6e1 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:45.776509 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d9300-431f-4e86-9115-ba241ffebacd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf64f4ec145742d78eee6c4a447515dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:45.777219 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d9300-431f-4e86-9115-ba241ffebacd service glance] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:45.777502 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d9300-431f-4e86-9115-ba241ffebacd service glance] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:45.777776 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d9300-431f-4e86-9115-ba241ffebacd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:45.779786 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ba7d9300-431f-4e86-9115-ba241ffebacd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:45.854105 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d9300-431f-4e86-9115-ba241ffebacd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:45.855543 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d9300-431f-4e86-9115-ba241ffebacd service glance] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:45.866945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1423/2854] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:16:47.418358 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf2822-c834-4782-98bc-7aaee8fc37f4 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:47.419877 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-7acf2822-c834-4782-98bc-7aaee8fc37f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:47.457890 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:47.484635 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf2822-c834-4782-98bc-7aaee8fc37f4 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:47.488761 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb277e-49a2-407f-8391-9610c2993aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:47.489409 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb277e-49a2-407f-8391-9610c2993aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:47.489690 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb277e-49a2-407f-8391-9610c2993aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:47.489964 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb277e-49a2-407f-8391-9610c2993aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:47.491746 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-11cb277e-49a2-407f-8391-9610c2993aa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:47.506833 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb277e-49a2-407f-8391-9610c2993aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:47.508288 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb277e-49a2-407f-8391-9610c2993aa6 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:47.519803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1432/2855] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:16:48.419150 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d9300-431f-4e86-9115-ba241ffebacd service glance] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:48.420596 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-ba7d9300-431f-4e86-9115-ba241ffebacd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:48.470683 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:16:48.494611 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d9300-431f-4e86-9115-ba241ffebacd service glance] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:48.499892 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7efaa-ecf7-4a26-a8ee-0aafb44ab5fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1004beeeaed4af4a92c89ad31008b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:48.500595 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7efaa-ecf7-4a26-a8ee-0aafb44ab5fa service placement] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:48.501406 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7efaa-ecf7-4a26-a8ee-0aafb44ab5fa service placement] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:48.501684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7efaa-ecf7-4a26-a8ee-0aafb44ab5fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:48.503475 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-60b7efaa-ecf7-4a26-a8ee-0aafb44ab5fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:48.515466 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7efaa-ecf7-4a26-a8ee-0aafb44ab5fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:48.517938 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7efaa-ecf7-4a26-a8ee-0aafb44ab5fa service placement] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:48.528102 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1424/2856] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:16:53.289062 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb277e-49a2-407f-8391-9610c2993aa6 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:16:53.298088 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb277e-49a2-407f-8391-9610c2993aa6 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:16:53.302416 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acab00b-6a33-4da5-a419-64c29ad48c35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:16:53.303061 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acab00b-6a33-4da5-a419-64c29ad48c35 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:16:53.303351 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acab00b-6a33-4da5-a419-64c29ad48c35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:16:53.303623 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acab00b-6a33-4da5-a419-64c29ad48c35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:16:53.305420 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0acab00b-6a33-4da5-a419-64c29ad48c35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:16:53.315172 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acab00b-6a33-4da5-a419-64c29ad48c35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:16:53.317575 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acab00b-6a33-4da5-a419-64c29ad48c35 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:16:53.325693 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1433/2857] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:16:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 22:16:58.523673 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=11 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:17:03.321984 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=19 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:17:07.829559 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fba6c-1f34-43a7-bf51-f2ecb40aca4b None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:07.830028 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fba6c-1f34-43a7-bf51-f2ecb40aca4b None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:07.830124 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fba6c-1f34-43a7-bf51-f2ecb40aca4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:07.847713 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-403fba6c-1f34-43a7-bf51-f2ecb40aca4b None None] MFA Rules not processed for user `690c315bf19b4b07beb2d1e7ca610f41`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:17:07.849606 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-403fba6c-1f34-43a7-bf51-f2ecb40aca4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:17:07.856511 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1425/2858] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:17:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:17:17.842692 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:17:25.956339 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426ef62-3fca-458f-b58d-411dc07096b2 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:25.956923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426ef62-3fca-458f-b58d-411dc07096b2 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:25.956923 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426ef62-3fca-458f-b58d-411dc07096b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:25.975734 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-0426ef62-3fca-458f-b58d-411dc07096b2 None None] MFA Rules not processed for user `6d4c4b75552b4c739079f328a6efba40`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:17:25.976993 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-0426ef62-3fca-458f-b58d-411dc07096b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:17:26.033786 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1434/2859] 10.222.0.35 () {58 vars in 1009 bytes} [Thu May 19 22:17:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:17:26.081733 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fba6c-1f34-43a7-bf51-f2ecb40aca4b None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:17:26.084594 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-403fba6c-1f34-43a7-bf51-f2ecb40aca4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:17:26.156697 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fba6c-1f34-43a7-bf51-f2ecb40aca4b None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:17:26.161561 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a6edd-478b-42d6-8f8f-e7850cb598ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a4208619f84f16b735871ee114e660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:17:26.162277 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a6edd-478b-42d6-8f8f-e7850cb598ed service swift] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:26.162554 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a6edd-478b-42d6-8f8f-e7850cb598ed service swift] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:26.162934 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a6edd-478b-42d6-8f8f-e7850cb598ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:26.171776 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a6edd-478b-42d6-8f8f-e7850cb598ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:17:26.173408 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a6edd-478b-42d6-8f8f-e7850cb598ed service swift] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:17:26.181605 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1426/2860] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 22:17:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 22:17:36.026976 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=25 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:17:36.178265 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=32 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:17:41.630291 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb001faf-6ab6-4907-acef-97ae87115a72 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:41.630794 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb001faf-6ab6-4907-acef-97ae87115a72 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:41.630892 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb001faf-6ab6-4907-acef-97ae87115a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:41.649787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-bb001faf-6ab6-4907-acef-97ae87115a72 None None] MFA Rules not processed for user `6d4c4b75552b4c739079f328a6efba40`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:17:41.651084 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-bb001faf-6ab6-4907-acef-97ae87115a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:17:41.658430 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1435/2861] 10.222.0.35 () {58 vars in 967 bytes} [Thu May 19 22:17:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:17:41.671100 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a6edd-478b-42d6-8f8f-e7850cb598ed service swift] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:17:41.685997 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a6edd-478b-42d6-8f8f-e7850cb598ed service swift] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:17:41.691215 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fb914-2757-4ebc-9fe4-491dba32e7f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a4208619f84f16b735871ee114e660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:17:41.691862 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fb914-2757-4ebc-9fe4-491dba32e7f0 service swift] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:41.692148 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fb914-2757-4ebc-9fe4-491dba32e7f0 service swift] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:41.692450 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fb914-2757-4ebc-9fe4-491dba32e7f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:41.701331 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fb914-2757-4ebc-9fe4-491dba32e7f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:17:41.702911 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fb914-2757-4ebc-9fe4-491dba32e7f0 service swift] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:17:41.711225 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1427/2862] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 22:17:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 22:17:43.698283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb001faf-6ab6-4907-acef-97ae87115a72 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:17:43.699841 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-bb001faf-6ab6-4907-acef-97ae87115a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:17:43.776653 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb001faf-6ab6-4907-acef-97ae87115a72 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:17:43.781080 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff13593-1bb7-4b22-bc25-5d3db2b047a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:17:43.781955 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff13593-1bb7-4b22-bc25-5d3db2b047a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:43.782236 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff13593-1bb7-4b22-bc25-5d3db2b047a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:43.782513 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff13593-1bb7-4b22-bc25-5d3db2b047a3 admin admin] PATH_INFO: `/v3/users/690c315bf19b4b07beb2d1e7ca610f41` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:43.783706 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff13593-1bb7-4b22-bc25-5d3db2b047a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=690c315bf19b4b07beb2d1e7ca610f41)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:17:43.785680 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff13593-1bb7-4b22-bc25-5d3db2b047a3 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:17:43.846964 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7ff13593-1bb7-4b22-bc25-5d3db2b047a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '690c315bf19b4b07beb2d1e7ca610f41'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:17:43.856855 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7ff13593-1bb7-4b22-bc25-5d3db2b047a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '690c315bf19b4b07beb2d1e7ca610f41'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:17:43.857874 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7ff13593-1bb7-4b22-bc25-5d3db2b047a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '690c315bf19b4b07beb2d1e7ca610f41'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:17:43.872274 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7ff13593-1bb7-4b22-bc25-5d3db2b047a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '690c315bf19b4b07beb2d1e7ca610f41'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:17:43.886615 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-7ff13593-1bb7-4b22-bc25-5d3db2b047a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '690c315bf19b4b07beb2d1e7ca610f41'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:17:43.894444 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1436/2863] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:17:43 2022] DELETE /identity/v3/users/690c315bf19b4b07beb2d1e7ca610f41 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:17:44.082428 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fb914-2757-4ebc-9fe4-491dba32e7f0 service swift] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:17:44.093867 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fb914-2757-4ebc-9fe4-491dba32e7f0 service swift] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:17:44.159759 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d27aa2-5e3f-49e5-bca0-a186db235f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:17:44.160596 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d27aa2-5e3f-49e5-bca0-a186db235f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:44.160882 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d27aa2-5e3f-49e5-bca0-a186db235f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:44.161159 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d27aa2-5e3f-49e5-bca0-a186db235f9b admin admin] PATH_INFO: `/v3/projects/7aa92b411345490eb693aecfd5c166ee` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:44.162373 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d27aa2-5e3f-49e5-bca0-a186db235f9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aa92b411345490eb693aecfd5c166ee)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:17:44.164305 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d27aa2-5e3f-49e5-bca0-a186db235f9b admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:17:44.217853 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-80d27aa2-5e3f-49e5-bca0-a186db235f9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aa92b411345490eb693aecfd5c166ee', 'request_id': 'req-80d27aa2-5e3f-49e5-bca0-a186db235f9b'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:17:44.225057 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-80d27aa2-5e3f-49e5-bca0-a186db235f9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aa92b411345490eb693aecfd5c166ee', 'request_id': 'req-80d27aa2-5e3f-49e5-bca0-a186db235f9b'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:17:44.234236 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-80d27aa2-5e3f-49e5-bca0-a186db235f9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aa92b411345490eb693aecfd5c166ee', 'request_id': 'req-80d27aa2-5e3f-49e5-bca0-a186db235f9b'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:17:44.245542 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-80d27aa2-5e3f-49e5-bca0-a186db235f9b admin admin] The token cache is being invalidate because project 7aa92b411345490eb693aecfd5c166ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:17:44.245860 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-80d27aa2-5e3f-49e5-bca0-a186db235f9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:17:44.246494 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-80d27aa2-5e3f-49e5-bca0-a186db235f9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:17:44.248043 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1428/2864] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:17:44 2022] DELETE /identity/v3/projects/7aa92b411345490eb693aecfd5c166ee => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:17:44.252939 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f4da8-3fae-4c0e-8388-0eab9fefdb10 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:44.253258 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f4da8-3fae-4c0e-8388-0eab9fefdb10 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:44.253570 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f4da8-3fae-4c0e-8388-0eab9fefdb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:44.272304 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-335f4da8-3fae-4c0e-8388-0eab9fefdb10 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:17:44.273545 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-335f4da8-3fae-4c0e-8388-0eab9fefdb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:17:44.344384 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1437/2865] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:17:44.352137 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2401a-23de-4772-9e69-ad2414c574ab None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:44.352485 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2401a-23de-4772-9e69-ad2414c574ab None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:44.352808 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2401a-23de-4772-9e69-ad2414c574ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:44.371926 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b4a2401a-23de-4772-9e69-ad2414c574ab None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:17:44.373194 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b4a2401a-23de-4772-9e69-ad2414c574ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:17:44.382676 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1429/2866] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:17:44.388048 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f4da8-3fae-4c0e-8388-0eab9fefdb10 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:17:44.397812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f4da8-3fae-4c0e-8388-0eab9fefdb10 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:17:44.402971 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91f86b-fce3-46ed-9842-4599d933753f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:17:44.403624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91f86b-fce3-46ed-9842-4599d933753f admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:44.403906 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91f86b-fce3-46ed-9842-4599d933753f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:44.404178 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91f86b-fce3-46ed-9842-4599d933753f admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:44.404929 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91f86b-fce3-46ed-9842-4599d933753f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:17:44.405233 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91f86b-fce3-46ed-9842-4599d933753f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:17:44.406824 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91f86b-fce3-46ed-9842-4599d933753f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:17:44.415689 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:17:44.419405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1438/2867] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:17:44.423854 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2401a-23de-4772-9e69-ad2414c574ab None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:17:44.435527 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2401a-23de-4772-9e69-ad2414c574ab None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:17:44.440360 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118317e-5501-476c-9fc3-0aba53cb3ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:17:44.441072 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118317e-5501-476c-9fc3-0aba53cb3ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:44.441354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118317e-5501-476c-9fc3-0aba53cb3ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:44.441632 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118317e-5501-476c-9fc3-0aba53cb3ee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:44.442340 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118317e-5501-476c-9fc3-0aba53cb3ee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:17:44.444263 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118317e-5501-476c-9fc3-0aba53cb3ee7 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:17:44.470920 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1430/2868] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:17:44 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:17:44.475074 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91f86b-fce3-46ed-9842-4599d933753f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:17:44.487820 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91f86b-fce3-46ed-9842-4599d933753f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:17:44.550506 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f51e90-3f89-43a5-ae0b-6cac1d43df54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:17:44.551186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f51e90-3f89-43a5-ae0b-6cac1d43df54 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:44.551597 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f51e90-3f89-43a5-ae0b-6cac1d43df54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:44.551881 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f51e90-3f89-43a5-ae0b-6cac1d43df54 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:44.552625 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f51e90-3f89-43a5-ae0b-6cac1d43df54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:17:44.554578 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f51e90-3f89-43a5-ae0b-6cac1d43df54 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:17:44.575485 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1439/2869] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:17:44 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 22:17:44.579629 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118317e-5501-476c-9fc3-0aba53cb3ee7 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:17:44.594237 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118317e-5501-476c-9fc3-0aba53cb3ee7 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:17:44.599172 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b393095-7790-4c28-b1e6-076e45659582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:17:44.599858 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b393095-7790-4c28-b1e6-076e45659582 admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:44.600166 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b393095-7790-4c28-b1e6-076e45659582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:44.600475 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b393095-7790-4c28-b1e6-076e45659582 admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:44.601220 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b393095-7790-4c28-b1e6-076e45659582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:17:44.603661 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b393095-7790-4c28-b1e6-076e45659582 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:17:44.615212 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1431/2870] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:17:44.619586 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f51e90-3f89-43a5-ae0b-6cac1d43df54 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:17:44.629964 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f51e90-3f89-43a5-ae0b-6cac1d43df54 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:17:44.635099 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc243b-ae48-4994-9d96-3bc6a3c2100a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:17:44.635676 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc243b-ae48-4994-9d96-3bc6a3c2100a admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:44.635963 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc243b-ae48-4994-9d96-3bc6a3c2100a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:44.636242 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc243b-ae48-4994-9d96-3bc6a3c2100a admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:44.637026 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc243b-ae48-4994-9d96-3bc6a3c2100a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:17:44.638642 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc243b-ae48-4994-9d96-3bc6a3c2100a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:17:44.651289 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1440/2871] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:17:44.655696 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b393095-7790-4c28-b1e6-076e45659582 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:17:44.666726 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b393095-7790-4c28-b1e6-076e45659582 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:17:44.671545 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6c80a-cc5b-4f7a-b5ee-c6e1db73c9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:17:44.672465 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6c80a-cc5b-4f7a-b5ee-c6e1db73c9d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:44.672748 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6c80a-cc5b-4f7a-b5ee-c6e1db73c9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:44.673021 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6c80a-cc5b-4f7a-b5ee-c6e1db73c9d8 admin admin] PATH_INFO: `/v3/projects/df326b24667842bdb2370d64bca9a591/users/57730a9e15cf497c898eaf3627258dad/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:44.688651 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6c80a-cc5b-4f7a-b5ee-c6e1db73c9d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df326b24667842bdb2370d64bca9a591, user_id=57730a9e15cf497c898eaf3627258dad, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:17:44.691572 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6c80a-cc5b-4f7a-b5ee-c6e1db73c9d8 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:17:44.706995 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1432/2872] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:17:44 2022] PUT /identity/v3/projects/df326b24667842bdb2370d64bca9a591/users/57730a9e15cf497c898eaf3627258dad/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:17:44.772773 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24481f9-8246-4247-a416-c469af25bb98 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:44.773327 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24481f9-8246-4247-a416-c469af25bb98 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:44.773453 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24481f9-8246-4247-a416-c469af25bb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:44.803395 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-e24481f9-8246-4247-a416-c469af25bb98 None None] MFA Rules not processed for user `57730a9e15cf497c898eaf3627258dad`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:17:44.804663 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-e24481f9-8246-4247-a416-c469af25bb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:17:44.870787 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1441/2873] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:17:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:17:44.881518 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6c80a-cc5b-4f7a-b5ee-c6e1db73c9d8 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:17:44.883843 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-bdc6c80a-cc5b-4f7a-b5ee-c6e1db73c9d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:17:44.899930 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:17:44.945649 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6c80a-cc5b-4f7a-b5ee-c6e1db73c9d8 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:17:44.949354 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e365660-38f1-478f-a7f7-15c8a4edbed2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85924e1dfe664f78af34565db18b0b55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:17:44.949994 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e365660-38f1-478f-a7f7-15c8a4edbed2 service cinder] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:44.950273 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e365660-38f1-478f-a7f7-15c8a4edbed2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:44.950543 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e365660-38f1-478f-a7f7-15c8a4edbed2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:44.968226 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e365660-38f1-478f-a7f7-15c8a4edbed2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:17:44.969702 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e365660-38f1-478f-a7f7-15c8a4edbed2 service cinder] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:17:44.978981 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1433/2874] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:17:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:17:54.867867 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:17:54.974494 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=20 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:17:55.048540 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24481f9-8246-4247-a416-c469af25bb98 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:17:55.122760 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24481f9-8246-4247-a416-c469af25bb98 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:17:55.127223 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461a634-bec3-4e05-a584-144efe981336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:17:55.128132 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461a634-bec3-4e05-a584-144efe981336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:55.128543 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461a634-bec3-4e05-a584-144efe981336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:55.128842 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461a634-bec3-4e05-a584-144efe981336 admin admin] PATH_INFO: `/v3/users/57730a9e15cf497c898eaf3627258dad` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:55.130154 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461a634-bec3-4e05-a584-144efe981336 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57730a9e15cf497c898eaf3627258dad)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:17:55.132075 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461a634-bec3-4e05-a584-144efe981336 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:17:55.184735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6461a634-bec3-4e05-a584-144efe981336 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57730a9e15cf497c898eaf3627258dad'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:17:55.191547 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6461a634-bec3-4e05-a584-144efe981336 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57730a9e15cf497c898eaf3627258dad'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:17:55.192226 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6461a634-bec3-4e05-a584-144efe981336 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57730a9e15cf497c898eaf3627258dad'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:17:55.205594 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6461a634-bec3-4e05-a584-144efe981336 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57730a9e15cf497c898eaf3627258dad'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:17:55.214011 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-6461a634-bec3-4e05-a584-144efe981336 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57730a9e15cf497c898eaf3627258dad'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:17:55.221617 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1442/2875] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:17:55 2022] DELETE /identity/v3/users/57730a9e15cf497c898eaf3627258dad => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:17:55.226424 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e8c87-887f-4db7-8835-7b25e27af557 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:55.226890 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e8c87-887f-4db7-8835-7b25e27af557 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:55.227272 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e8c87-887f-4db7-8835-7b25e27af557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:55.244504 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-be8e8c87-887f-4db7-8835-7b25e27af557 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:17:55.245700 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-be8e8c87-887f-4db7-8835-7b25e27af557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:17:55.314914 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1434/2876] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:17:55.326697 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461a634-bec3-4e05-a584-144efe981336 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:17:55.328160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6461a634-bec3-4e05-a584-144efe981336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:17:55.388496 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461a634-bec3-4e05-a584-144efe981336 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:17:55.392620 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b447753-be7b-4a4e-8148-91411884a3fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:17:55.393276 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b447753-be7b-4a4e-8148-91411884a3fa service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:55.393563 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b447753-be7b-4a4e-8148-91411884a3fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:55.393843 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b447753-be7b-4a4e-8148-91411884a3fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:55.403238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b447753-be7b-4a4e-8148-91411884a3fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:17:55.404709 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b447753-be7b-4a4e-8148-91411884a3fa service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:17:55.414661 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1443/2877] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:17:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:17:55.703983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e8c87-887f-4db7-8835-7b25e27af557 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:17:55.705922 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-be8e8c87-887f-4db7-8835-7b25e27af557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:17:55.719845 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e8c87-887f-4db7-8835-7b25e27af557 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:17:55.724554 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad460f0-707d-4e17-b8c5-8f4b3fe3ce56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:17:55.725444 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad460f0-707d-4e17-b8c5-8f4b3fe3ce56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:55.725733 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad460f0-707d-4e17-b8c5-8f4b3fe3ce56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:55.726018 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad460f0-707d-4e17-b8c5-8f4b3fe3ce56 admin admin] PATH_INFO: `/v3/projects/df326b24667842bdb2370d64bca9a591` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:55.727913 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad460f0-707d-4e17-b8c5-8f4b3fe3ce56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df326b24667842bdb2370d64bca9a591)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:17:55.729899 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad460f0-707d-4e17-b8c5-8f4b3fe3ce56 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:17:55.784157 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-0ad460f0-707d-4e17-b8c5-8f4b3fe3ce56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df326b24667842bdb2370d64bca9a591', 'request_id': 'req-0ad460f0-707d-4e17-b8c5-8f4b3fe3ce56'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:17:55.792069 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-0ad460f0-707d-4e17-b8c5-8f4b3fe3ce56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df326b24667842bdb2370d64bca9a591', 'request_id': 'req-0ad460f0-707d-4e17-b8c5-8f4b3fe3ce56'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:17:55.800626 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-0ad460f0-707d-4e17-b8c5-8f4b3fe3ce56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df326b24667842bdb2370d64bca9a591', 'request_id': 'req-0ad460f0-707d-4e17-b8c5-8f4b3fe3ce56'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:17:55.811419 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-0ad460f0-707d-4e17-b8c5-8f4b3fe3ce56 admin admin] The token cache is being invalidate because project df326b24667842bdb2370d64bca9a591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:17:55.811708 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-0ad460f0-707d-4e17-b8c5-8f4b3fe3ce56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:17:55.812339 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-0ad460f0-707d-4e17-b8c5-8f4b3fe3ce56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:17:55.813907 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1435/2878] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:17:55 2022] DELETE /identity/v3/projects/df326b24667842bdb2370d64bca9a591 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:17:55.819007 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa8bd7-dc91-43e4-aaeb-66926e67f5bf None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:55.819299 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa8bd7-dc91-43e4-aaeb-66926e67f5bf None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:55.819575 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa8bd7-dc91-43e4-aaeb-66926e67f5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:55.837856 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-fafa8bd7-dc91-43e4-aaeb-66926e67f5bf None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:17:55.839117 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-fafa8bd7-dc91-43e4-aaeb-66926e67f5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:17:55.857283 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:17:55.902547 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1444/2879] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:17:55.910623 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d20322-94f8-437c-9818-2510a6ea4d12 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:55.910915 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d20322-94f8-437c-9818-2510a6ea4d12 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:55.911197 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d20322-94f8-437c-9818-2510a6ea4d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:55.930112 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-b1d20322-94f8-437c-9818-2510a6ea4d12 None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:17:55.931329 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b1d20322-94f8-437c-9818-2510a6ea4d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:17:55.939564 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1436/2880] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:17:55.944186 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa8bd7-dc91-43e4-aaeb-66926e67f5bf None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:17:55.955620 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa8bd7-dc91-43e4-aaeb-66926e67f5bf None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:17:55.960248 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4820b1-25ba-4e16-a50f-8187841e8f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:17:55.961950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4820b1-25ba-4e16-a50f-8187841e8f04 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:55.962240 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4820b1-25ba-4e16-a50f-8187841e8f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:55.962521 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4820b1-25ba-4e16-a50f-8187841e8f04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:55.963255 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4820b1-25ba-4e16-a50f-8187841e8f04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80209) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 22:17:55.963567 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4820b1-25ba-4e16-a50f-8187841e8f04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:17:55.965208 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4820b1-25ba-4e16-a50f-8187841e8f04 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:17:55.977524 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1445/2881] 10.222.0.35 () {58 vars in 1152 bytes} [Thu May 19 22:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 22:17:55.981882 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d20322-94f8-437c-9818-2510a6ea4d12 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:17:55.993405 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d20322-94f8-437c-9818-2510a6ea4d12 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:17:55.998352 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e854733-1ab4-41c6-8f02-711177e04115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:17:55.999041 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e854733-1ab4-41c6-8f02-711177e04115 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:55.999325 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e854733-1ab4-41c6-8f02-711177e04115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:55.999598 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e854733-1ab4-41c6-8f02-711177e04115 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:56.000312 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e854733-1ab4-41c6-8f02-711177e04115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:17:56.002291 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e854733-1ab4-41c6-8f02-711177e04115 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:17:56.029700 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1437/2882] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:17:55 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:17:56.033723 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4820b1-25ba-4e16-a50f-8187841e8f04 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:17:56.044536 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4820b1-25ba-4e16-a50f-8187841e8f04 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:17:56.109474 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199707a2-324a-4767-8831-5bb2809f1af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:17:56.110163 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199707a2-324a-4767-8831-5bb2809f1af2 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:56.110452 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199707a2-324a-4767-8831-5bb2809f1af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:56.110733 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199707a2-324a-4767-8831-5bb2809f1af2 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:56.111435 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199707a2-324a-4767-8831-5bb2809f1af2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:17:56.113407 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199707a2-324a-4767-8831-5bb2809f1af2 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:17:56.135264 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1446/2883] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:17:56 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:17:56.139443 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e854733-1ab4-41c6-8f02-711177e04115 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:17:56.150621 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e854733-1ab4-41c6-8f02-711177e04115 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:17:56.155473 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84a896-f81e-411c-9177-b2d8fa221fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:17:56.156079 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84a896-f81e-411c-9177-b2d8fa221fee admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:56.156361 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84a896-f81e-411c-9177-b2d8fa221fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:56.156676 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84a896-f81e-411c-9177-b2d8fa221fee admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:56.157410 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84a896-f81e-411c-9177-b2d8fa221fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:17:56.159018 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84a896-f81e-411c-9177-b2d8fa221fee admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:17:56.170050 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1438/2884] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:17:56.174390 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199707a2-324a-4767-8831-5bb2809f1af2 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:17:56.185083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199707a2-324a-4767-8831-5bb2809f1af2 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:17:56.189735 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aae092-1395-4617-a0a8-65fc9c409d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:17:56.190396 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aae092-1395-4617-a0a8-65fc9c409d79 admin admin] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:56.190681 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aae092-1395-4617-a0a8-65fc9c409d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:56.190957 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aae092-1395-4617-a0a8-65fc9c409d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:56.191682 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aae092-1395-4617-a0a8-65fc9c409d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:17:56.193319 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aae092-1395-4617-a0a8-65fc9c409d79 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:17:56.204273 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1447/2885] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:17:56.212233 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84a896-f81e-411c-9177-b2d8fa221fee admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:17:56.222312 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84a896-f81e-411c-9177-b2d8fa221fee admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:17:56.227119 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39468cea-9502-4a59-9b0d-a5a89e16b4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:17:56.228004 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39468cea-9502-4a59-9b0d-a5a89e16b4c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:56.228285 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39468cea-9502-4a59-9b0d-a5a89e16b4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:56.228592 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39468cea-9502-4a59-9b0d-a5a89e16b4c6 admin admin] PATH_INFO: `/v3/projects/4246791f5ef147c89021cdc7dbfa24a9/users/760a19cb4201433da0aa2e23747fd415/roles/4749055b54a542b29f57155df3756136` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:56.243189 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39468cea-9502-4a59-9b0d-a5a89e16b4c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4246791f5ef147c89021cdc7dbfa24a9, user_id=760a19cb4201433da0aa2e23747fd415, role_id=4749055b54a542b29f57155df3756136)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:17:56.245872 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39468cea-9502-4a59-9b0d-a5a89e16b4c6 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:17:56.261042 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1439/2886] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:17:56 2022] PUT /identity/v3/projects/4246791f5ef147c89021cdc7dbfa24a9/users/760a19cb4201433da0aa2e23747fd415/roles/4749055b54a542b29f57155df3756136 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:17:56.266238 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62534bed-e710-4b68-a2e8-cf4a02d95bec None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:56.266539 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62534bed-e710-4b68-a2e8-cf4a02d95bec None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:56.266826 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62534bed-e710-4b68-a2e8-cf4a02d95bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:56.285711 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-62534bed-e710-4b68-a2e8-cf4a02d95bec None None] MFA Rules not processed for user `8b8aa11a54f3466da61ca05643c14d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:17:56.286934 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-62534bed-e710-4b68-a2e8-cf4a02d95bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:17:56.355604 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1448/2887] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:17:56.365501 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39468cea-9502-4a59-9b0d-a5a89e16b4c6 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:17:56.367332 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-39468cea-9502-4a59-9b0d-a5a89e16b4c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:17:56.390310 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:17:56.428550 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39468cea-9502-4a59-9b0d-a5a89e16b4c6 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:17:56.432205 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d38b7d-5b34-4776-bd6c-a77c63df59fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:17:56.432890 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d38b7d-5b34-4776-bd6c-a77c63df59fe service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:17:56.433170 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d38b7d-5b34-4776-bd6c-a77c63df59fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:17:56.434084 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d38b7d-5b34-4776-bd6c-a77c63df59fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:17:56.443112 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d38b7d-5b34-4776-bd6c-a77c63df59fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:17:56.444567 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d38b7d-5b34-4776-bd6c-a77c63df59fe service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:17:56.454460 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1440/2888] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:17:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:18:00.634889 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070493c-3e32-4f10-8cd2-783f0d9ac630 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:18:00.635899 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070493c-3e32-4f10-8cd2-783f0d9ac630 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:18:00.636434 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070493c-3e32-4f10-8cd2-783f0d9ac630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:18:00.671643 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-1070493c-3e32-4f10-8cd2-783f0d9ac630 None None] MFA Rules not processed for user `760a19cb4201433da0aa2e23747fd415`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:18:00.672979 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1070493c-3e32-4f10-8cd2-783f0d9ac630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:18:00.692972 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:18:00.750762 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1449/2889] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:18:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:18:00.755331 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d38b7d-5b34-4776-bd6c-a77c63df59fe service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:18:00.766071 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d38b7d-5b34-4776-bd6c-a77c63df59fe service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:18:00.771186 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990f663-b77b-48fa-a044-ce23d3b61ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:18:00.771875 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990f663-b77b-48fa-a044-ce23d3b61ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:18:00.772162 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990f663-b77b-48fa-a044-ce23d3b61ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:18:00.772487 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990f663-b77b-48fa-a044-ce23d3b61ec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:18:00.773349 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990f663-b77b-48fa-a044-ce23d3b61ec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:18:00.775549 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990f663-b77b-48fa-a044-ce23d3b61ec9 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:18:00.807932 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1441/2890] 10.222.0.35 () {60 vars in 1152 bytes} [Thu May 19 22:18:00 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:18:00.812086 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070493c-3e32-4f10-8cd2-783f0d9ac630 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:18:00.824799 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070493c-3e32-4f10-8cd2-783f0d9ac630 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:18:00.910120 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc76ad0-7162-445a-9da4-f0edd3cb8173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:18:00.910798 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc76ad0-7162-445a-9da4-f0edd3cb8173 admin admin] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:18:00.911083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc76ad0-7162-445a-9da4-f0edd3cb8173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:18:00.911361 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc76ad0-7162-445a-9da4-f0edd3cb8173 admin admin] PATH_INFO: `/v3/users` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:18:00.912045 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc76ad0-7162-445a-9da4-f0edd3cb8173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:18:00.915313 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc76ad0-7162-445a-9da4-f0edd3cb8173 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:18:00.939834 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1450/2891] 10.222.0.35 () {60 vars in 1143 bytes} [Thu May 19 22:18:00 2022] POST /identity/v3/users => generated 299 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 22:18:00.943960 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990f663-b77b-48fa-a044-ce23d3b61ec9 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:18:00.955797 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990f663-b77b-48fa-a044-ce23d3b61ec9 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:18:00.960452 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45da4c9-fbd6-40b1-acbe-d05db9772a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:18:00.961773 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45da4c9-fbd6-40b1-acbe-d05db9772a8a admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:18:00.962089 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45da4c9-fbd6-40b1-acbe-d05db9772a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:18:00.962371 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45da4c9-fbd6-40b1-acbe-d05db9772a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:18:00.963140 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45da4c9-fbd6-40b1-acbe-d05db9772a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:18:00.964820 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45da4c9-fbd6-40b1-acbe-d05db9772a8a admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:18:00.976967 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1442/2892] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:18:00.981464 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc76ad0-7162-445a-9da4-f0edd3cb8173 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:18:00.992465 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc76ad0-7162-445a-9da4-f0edd3cb8173 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:18:00.998978 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35136551-fa39-4941-a119-abd271bc698a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:18:00.999874 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35136551-fa39-4941-a119-abd271bc698a admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:18:01.000160 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35136551-fa39-4941-a119-abd271bc698a admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:18:01.000487 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35136551-fa39-4941-a119-abd271bc698a admin admin] PATH_INFO: `/v3/projects/e745876f79694e2b8fdb6f304a6ec602/users/4ca697bf440c4c81a73db02199763642/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:18:01.018803 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35136551-fa39-4941-a119-abd271bc698a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e745876f79694e2b8fdb6f304a6ec602, user_id=4ca697bf440c4c81a73db02199763642, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:18:01.021503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35136551-fa39-4941-a119-abd271bc698a admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:18:01.038834 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1451/2893] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:18:00 2022] PUT /identity/v3/projects/e745876f79694e2b8fdb6f304a6ec602/users/4ca697bf440c4c81a73db02199763642/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:18:01.042876 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45da4c9-fbd6-40b1-acbe-d05db9772a8a admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:18:01.053312 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45da4c9-fbd6-40b1-acbe-d05db9772a8a admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:18:01.118751 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc845f-085a-4679-9311-16c95160225d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:18:01.119362 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc845f-085a-4679-9311-16c95160225d admin admin] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:18:01.119644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc845f-085a-4679-9311-16c95160225d admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:18:01.119917 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc845f-085a-4679-9311-16c95160225d admin admin] PATH_INFO: `/v3/roles` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:18:01.120738 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc845f-085a-4679-9311-16c95160225d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:18:01.122350 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc845f-085a-4679-9311-16c95160225d admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:18:01.136811 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1443/2894] 10.222.0.35 () {58 vars in 1121 bytes} [Thu May 19 22:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 22:18:01.140984 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35136551-fa39-4941-a119-abd271bc698a admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:18:01.152439 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35136551-fa39-4941-a119-abd271bc698a admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:18:01.157462 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f91fdf-b66d-4f27-903a-93000931228f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:18:01.158365 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f91fdf-b66d-4f27-903a-93000931228f admin admin] REQUEST_METHOD: `PUT` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:18:01.158645 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f91fdf-b66d-4f27-903a-93000931228f admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:18:01.158915 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f91fdf-b66d-4f27-903a-93000931228f admin admin] PATH_INFO: `/v3/projects/e745876f79694e2b8fdb6f304a6ec602/users/4ca697bf440c4c81a73db02199763642/roles/04369f3c13174671a298fcd8175998d8` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:18:01.160939 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f91fdf-b66d-4f27-903a-93000931228f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e745876f79694e2b8fdb6f304a6ec602, user_id=4ca697bf440c4c81a73db02199763642, role_id=04369f3c13174671a298fcd8175998d8)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:18:01.163564 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f91fdf-b66d-4f27-903a-93000931228f admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:18:01.175157 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1452/2895] 10.222.0.35 () {60 vars in 1482 bytes} [Thu May 19 22:18:01 2022] PUT /identity/v3/projects/e745876f79694e2b8fdb6f304a6ec602/users/4ca697bf440c4c81a73db02199763642/roles/04369f3c13174671a298fcd8175998d8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:18:05.837076 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d27a5e-80f9-4d9f-b4aa-ec4d7f0e92e3 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:18:05.837875 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d27a5e-80f9-4d9f-b4aa-ec4d7f0e92e3 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:18:05.837875 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d27a5e-80f9-4d9f-b4aa-ec4d7f0e92e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:18:05.865467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-25d27a5e-80f9-4d9f-b4aa-ec4d7f0e92e3 None None] MFA Rules not processed for user `4ca697bf440c4c81a73db02199763642`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:18:05.866752 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-25d27a5e-80f9-4d9f-b4aa-ec4d7f0e92e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:18:05.946482 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1444/2896] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:18:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:18:05.961509 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f91fdf-b66d-4f27-903a-93000931228f admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:18:05.963282 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-f5f91fdf-b66d-4f27-903a-93000931228f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:18:06.039141 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f91fdf-b66d-4f27-903a-93000931228f admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:18:06.044645 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf53278-5a0e-493c-ace0-559c4835db3b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf64f4ec145742d78eee6c4a447515dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:18:06.045730 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf53278-5a0e-493c-ace0-559c4835db3b service glance] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:18:06.046083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf53278-5a0e-493c-ace0-559c4835db3b service glance] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:18:06.046429 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf53278-5a0e-493c-ace0-559c4835db3b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:18:06.076548 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:18:06.116821 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf53278-5a0e-493c-ace0-559c4835db3b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:18:06.118516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf53278-5a0e-493c-ace0-559c4835db3b service glance] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:18:06.130446 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1453/2897] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:18:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:18:06.267518 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e188c2a-60aa-4bc5-99c0-da773872ea51 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:18:06.267812 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e188c2a-60aa-4bc5-99c0-da773872ea51 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:18:06.268098 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e188c2a-60aa-4bc5-99c0-da773872ea51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:18:06.295510 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-2e188c2a-60aa-4bc5-99c0-da773872ea51 None None] MFA Rules not processed for user `6d4c4b75552b4c739079f328a6efba40`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:18:06.296813 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-2e188c2a-60aa-4bc5-99c0-da773872ea51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:18:06.303800 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:18:06.366874 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1445/2898] 10.222.0.35 () {58 vars in 1009 bytes} [Thu May 19 22:18:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 22:18:06.378956 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf53278-5a0e-493c-ace0-559c4835db3b service glance] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:18:06.380682 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-1cf53278-5a0e-493c-ace0-559c4835db3b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:18:06.457747 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf53278-5a0e-493c-ace0-559c4835db3b service glance] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:18:06.463408 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647795e-3205-4b2e-941d-7d504b26d47a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a4208619f84f16b735871ee114e660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:18:06.464082 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647795e-3205-4b2e-941d-7d504b26d47a service swift] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:18:06.464368 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647795e-3205-4b2e-941d-7d504b26d47a service swift] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:18:06.464679 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647795e-3205-4b2e-941d-7d504b26d47a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:18:06.473686 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647795e-3205-4b2e-941d-7d504b26d47a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:18:06.475306 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647795e-3205-4b2e-941d-7d504b26d47a service swift] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:18:06.484751 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1454/2899] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 22:18:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 22:18:16.290618 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b7cfe-cc24-4c39-9f23-0870c4e37046 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:18:16.291227 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b7cfe-cc24-4c39-9f23-0870c4e37046 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:18:16.291227 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b7cfe-cc24-4c39-9f23-0870c4e37046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:18:16.309352 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-884b7cfe-cc24-4c39-9f23-0870c4e37046 None None] MFA Rules not processed for user `760a19cb4201433da0aa2e23747fd415`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:18:16.310572 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-884b7cfe-cc24-4c39-9f23-0870c4e37046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:18:16.317857 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1446/2900] 10.222.0.35 () {58 vars in 957 bytes} [Thu May 19 22:18:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:18:16.481153 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=48 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:18:16.591173 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647795e-3205-4b2e-941d-7d504b26d47a service swift] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:18:16.646696 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647795e-3205-4b2e-941d-7d504b26d47a service swift] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:18:16.653182 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a65f0-c32c-4dde-8b74-ee948e797bc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:18:16.654431 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a65f0-c32c-4dde-8b74-ee948e797bc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:18:16.654957 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a65f0-c32c-4dde-8b74-ee948e797bc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:18:16.655483 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a65f0-c32c-4dde-8b74-ee948e797bc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:18:16.658602 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-d48a65f0-c32c-4dde-8b74-ee948e797bc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:18:16.672118 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a65f0-c32c-4dde-8b74-ee948e797bc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:18:16.673659 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a65f0-c32c-4dde-8b74-ee948e797bc6 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:18:16.682151 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1455/2901] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:18:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:18:18.331051 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a74771-069d-4d86-a55e-769dfa3cd500 None None] REQUEST_METHOD: `POST` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:18:18.331599 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a74771-069d-4d86-a55e-769dfa3cd500 None None] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:18:18.331599 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a74771-069d-4d86-a55e-769dfa3cd500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:18:18.351026 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.auth.core [None req-86a74771-069d-4d86-a55e-769dfa3cd500 None None] MFA Rules not processed for user `6d4c4b75552b4c739079f328a6efba40`. Rule list: `[]` (Enabled: `True`). {{(pid=80210) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:18:18.352239 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-86a74771-069d-4d86-a55e-769dfa3cd500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:18:18.366046 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1447/2902] 10.222.0.35 () {58 vars in 1009 bytes} [Thu May 19 22:18:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:18:18.378894 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a65f0-c32c-4dde-8b74-ee948e797bc6 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:18:18.392284 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a65f0-c32c-4dde-8b74-ee948e797bc6 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:18:18.397264 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e297f-c5c8-456d-acfa-0c98ed1bc9b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a4208619f84f16b735871ee114e660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:18:18.398316 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e297f-c5c8-456d-acfa-0c98ed1bc9b6 service swift] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:18:18.398702 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e297f-c5c8-456d-acfa-0c98ed1bc9b6 service swift] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:18:18.398987 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e297f-c5c8-456d-acfa-0c98ed1bc9b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:18:18.408059 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e297f-c5c8-456d-acfa-0c98ed1bc9b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:18:18.409720 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e297f-c5c8-456d-acfa-0c98ed1bc9b6 service swift] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:18:18.419758 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1456/2903] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 22:18:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 22:18:28.344243 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=26 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:18:28.415854 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=32 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:18:29.985590 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a74771-069d-4d86-a55e-769dfa3cd500 None None] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:18:29.988389 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-86a74771-069d-4d86-a55e-769dfa3cd500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:18:30.085687 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a74771-069d-4d86-a55e-769dfa3cd500 None None] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:18:30.093538 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173267ee-f7d6-4ae9-9dc8-e3c17a0835b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:18:30.094338 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173267ee-f7d6-4ae9-9dc8-e3c17a0835b1 service nova] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:18:30.094737 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173267ee-f7d6-4ae9-9dc8-e3c17a0835b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:18:30.095063 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173267ee-f7d6-4ae9-9dc8-e3c17a0835b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:18:30.097451 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-173267ee-f7d6-4ae9-9dc8-e3c17a0835b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:18:30.114523 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173267ee-f7d6-4ae9-9dc8-e3c17a0835b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:18:30.116376 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173267ee-f7d6-4ae9-9dc8-e3c17a0835b1 service nova] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:18:30.138555 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1448/2904] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:18:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:18:35.541297 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e297f-c5c8-456d-acfa-0c98ed1bc9b6 service swift] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:18:35.595220 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e297f-c5c8-456d-acfa-0c98ed1bc9b6 service swift] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:18:35.601714 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb1e5f-cd9b-490c-96ec-ade9db1406a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:18:35.602598 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb1e5f-cd9b-490c-96ec-ade9db1406a9 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:18:35.602700 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb1e5f-cd9b-490c-96ec-ade9db1406a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:18:35.602948 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb1e5f-cd9b-490c-96ec-ade9db1406a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:18:35.605503 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-64bb1e5f-cd9b-490c-96ec-ade9db1406a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:18:35.643857 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb1e5f-cd9b-490c-96ec-ade9db1406a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:18:35.645488 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb1e5f-cd9b-490c-96ec-ade9db1406a9 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:18:35.656792 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1457/2905] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:18:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:18:40.124799 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=34 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:18:43.780385 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173267ee-f7d6-4ae9-9dc8-e3c17a0835b1 service nova] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:18:43.781984 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-173267ee-f7d6-4ae9-9dc8-e3c17a0835b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:18:43.851826 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173267ee-f7d6-4ae9-9dc8-e3c17a0835b1 service nova] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:18:43.857642 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e782e9-3978-45be-91de-1028cc77d81a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:18:43.858310 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e782e9-3978-45be-91de-1028cc77d81a service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:18:43.858592 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e782e9-3978-45be-91de-1028cc77d81a service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:18:43.858869 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e782e9-3978-45be-91de-1028cc77d81a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:18:43.869802 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e782e9-3978-45be-91de-1028cc77d81a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:18:43.871253 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e782e9-3978-45be-91de-1028cc77d81a service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:18:43.880826 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1449/2906] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:18:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:18:45.652334 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=28 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:18:47.585749 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb1e5f-cd9b-490c-96ec-ade9db1406a9 service nova] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:18:47.587173 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-64bb1e5f-cd9b-490c-96ec-ade9db1406a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:18:47.614024 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb1e5f-cd9b-490c-96ec-ade9db1406a9 service nova] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:18:47.621111 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b0d6a-8de5-4f9c-bae6-2088f6abd5e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '902ca8f1d59547a0ab187b4748311f58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:18:47.622058 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b0d6a-8de5-4f9c-bae6-2088f6abd5e7 service nova] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:18:47.622516 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b0d6a-8de5-4f9c-bae6-2088f6abd5e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:18:47.622797 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b0d6a-8de5-4f9c-bae6-2088f6abd5e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:18:47.624843 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-084b0d6a-8de5-4f9c-bae6-2088f6abd5e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:18:47.641413 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b0d6a-8de5-4f9c-bae6-2088f6abd5e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:18:47.643038 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b0d6a-8de5-4f9c-bae6-2088f6abd5e7 service nova] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:18:47.656727 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1458/2907] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:18:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:18:53.876470 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=28 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:18:57.651928 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=6 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:19:02.495825 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e782e9-3978-45be-91de-1028cc77d81a service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:19:02.509891 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e782e9-3978-45be-91de-1028cc77d81a service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:19:02.513752 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b297db-929a-4bd9-aeac-764e43a19462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:19:02.514405 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b297db-929a-4bd9-aeac-764e43a19462 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:19:02.514684 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b297db-929a-4bd9-aeac-764e43a19462 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:19:02.514963 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b297db-929a-4bd9-aeac-764e43a19462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:19:02.516893 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b8b297db-929a-4bd9-aeac-764e43a19462 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:19:02.528156 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b297db-929a-4bd9-aeac-764e43a19462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:19:02.529945 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b297db-929a-4bd9-aeac-764e43a19462 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:19:02.539628 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1450/2908] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:19:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:19:02.625365 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b0d6a-8de5-4f9c-bae6-2088f6abd5e7 service nova] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:19:02.636147 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b0d6a-8de5-4f9c-bae6-2088f6abd5e7 service nova] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:19:02.640655 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34dde4-cbf8-4d92-87d6-acba3df98e31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:19:02.641325 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34dde4-cbf8-4d92-87d6-acba3df98e31 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:19:02.641612 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34dde4-cbf8-4d92-87d6-acba3df98e31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:19:02.641893 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34dde4-cbf8-4d92-87d6-acba3df98e31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:19:02.643769 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-bd34dde4-cbf8-4d92-87d6-acba3df98e31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:19:02.662170 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd34dde4-cbf8-4d92-87d6-acba3df98e31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:19:02.664035 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd34dde4-cbf8-4d92-87d6-acba3df98e31 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:19:02.676102 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1459/2909] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:19:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:19:12.534877 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=6 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:19:12.671116 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=6 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:20:43.518983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b297db-929a-4bd9-aeac-764e43a19462 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:20:43.520528 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-b8b297db-929a-4bd9-aeac-764e43a19462 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:20:43.615676 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b297db-929a-4bd9-aeac-764e43a19462 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:20:43.621433 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7ef23-c8f4-4b70-9e2a-af24125695a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1004beeeaed4af4a92c89ad31008b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:20:43.622021 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7ef23-c8f4-4b70-9e2a-af24125695a5 service placement] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:20:43.622303 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7ef23-c8f4-4b70-9e2a-af24125695a5 service placement] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:20:43.622580 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7ef23-c8f4-4b70-9e2a-af24125695a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:20:43.624364 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-4cb7ef23-c8f4-4b70-9e2a-af24125695a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:20:43.636814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7ef23-c8f4-4b70-9e2a-af24125695a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:20:43.638470 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7ef23-c8f4-4b70-9e2a-af24125695a5 service placement] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:20:43.649060 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1451/2910] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:20:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:20:52.984918 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34dde4-cbf8-4d92-87d6-acba3df98e31 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:20:52.994448 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34dde4-cbf8-4d92-87d6-acba3df98e31 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:20:52.998077 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36184008-431b-418b-91a3-7849041d8ec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:20:52.998715 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36184008-431b-418b-91a3-7849041d8ec6 service neutron] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:20:52.998997 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36184008-431b-418b-91a3-7849041d8ec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:20:52.999273 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36184008-431b-418b-91a3-7849041d8ec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:20:53.001080 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-36184008-431b-418b-91a3-7849041d8ec6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:20:53.061642 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36184008-431b-418b-91a3-7849041d8ec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:20:53.063197 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36184008-431b-418b-91a3-7849041d8ec6 service neutron] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:20:53.072985 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1460/2911] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:20:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:20:53.644225 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=41 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:20:57.865341 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7ef23-c8f4-4b70-9e2a-af24125695a5 service placement] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:20:57.877114 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7ef23-c8f4-4b70-9e2a-af24125695a5 service placement] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:20:57.880708 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9db6c-4842-4a12-a430-0a66f359a968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a571d6fe63334552b532aae15299ef9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:20:57.881355 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9db6c-4842-4a12-a430-0a66f359a968 service neutron] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:20:57.881642 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9db6c-4842-4a12-a430-0a66f359a968 service neutron] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:20:57.882000 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9db6c-4842-4a12-a430-0a66f359a968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:20:57.883821 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-c3b9db6c-4842-4a12-a430-0a66f359a968 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:20:57.977587 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9db6c-4842-4a12-a430-0a66f359a968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:20:57.979076 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9db6c-4842-4a12-a430-0a66f359a968 service neutron] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:20:57.998082 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1452/2912] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:20:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:21:01.236804 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36184008-431b-418b-91a3-7849041d8ec6 service neutron] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:21:01.251101 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36184008-431b-418b-91a3-7849041d8ec6 service neutron] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:21:01.258810 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9a11c-6b00-44ef-a1f3-fd833fc7b691 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1004beeeaed4af4a92c89ad31008b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:21:01.260074 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9a11c-6b00-44ef-a1f3-fd833fc7b691 service placement] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:21:01.260624 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9a11c-6b00-44ef-a1f3-fd833fc7b691 service placement] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:21:01.261069 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9a11c-6b00-44ef-a1f3-fd833fc7b691 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:21:01.264286 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-19b9a11c-6b00-44ef-a1f3-fd833fc7b691 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:21:01.285145 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9a11c-6b00-44ef-a1f3-fd833fc7b691 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:21:01.288083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9a11c-6b00-44ef-a1f3-fd833fc7b691 service placement] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:21:01.304606 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1461/2913] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:21:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:21:05.127282 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9db6c-4842-4a12-a430-0a66f359a968 service neutron] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:21:05.143208 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9db6c-4842-4a12-a430-0a66f359a968 service neutron] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:21:05.156562 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b815827-283e-4558-92a1-c26d6ba5154a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1004beeeaed4af4a92c89ad31008b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:21:05.157915 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b815827-283e-4558-92a1-c26d6ba5154a service placement] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:21:05.158457 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b815827-283e-4558-92a1-c26d6ba5154a service placement] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:21:05.159412 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b815827-283e-4558-92a1-c26d6ba5154a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:21:05.168013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9b815827-283e-4558-92a1-c26d6ba5154a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:21:05.186215 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b815827-283e-4558-92a1-c26d6ba5154a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:21:05.198360 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b815827-283e-4558-92a1-c26d6ba5154a service placement] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:21:05.214376 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9a11c-6b00-44ef-a1f3-fd833fc7b691 service placement] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:21:05.215936 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-19b9a11c-6b00-44ef-a1f3-fd833fc7b691 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:21:05.223950 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1453/2914] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:21:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:21:05.246405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9a11c-6b00-44ef-a1f3-fd833fc7b691 service placement] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:21:05.260187 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57259324-ff90-4abc-a94c-f7d75231e2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:21:05.261208 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57259324-ff90-4abc-a94c-f7d75231e2ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:21:05.261509 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57259324-ff90-4abc-a94c-f7d75231e2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:21:05.261966 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57259324-ff90-4abc-a94c-f7d75231e2ad admin admin] PATH_INFO: `/v3/users/0247c501a7894b279e3ca8f471df6429` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:21:05.263575 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57259324-ff90-4abc-a94c-f7d75231e2ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=0247c501a7894b279e3ca8f471df6429)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:21:05.265617 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57259324-ff90-4abc-a94c-f7d75231e2ad admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:21:05.347341 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-57259324-ff90-4abc-a94c-f7d75231e2ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0247c501a7894b279e3ca8f471df6429'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:05.357587 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-57259324-ff90-4abc-a94c-f7d75231e2ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0247c501a7894b279e3ca8f471df6429'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:05.358498 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-57259324-ff90-4abc-a94c-f7d75231e2ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0247c501a7894b279e3ca8f471df6429'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:05.386861 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-57259324-ff90-4abc-a94c-f7d75231e2ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0247c501a7894b279e3ca8f471df6429'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:05.400552 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-57259324-ff90-4abc-a94c-f7d75231e2ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0247c501a7894b279e3ca8f471df6429'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:05.408940 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1462/2915] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:21:05 2022] DELETE /identity/v3/users/0247c501a7894b279e3ca8f471df6429 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 22:21:05.614976 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b815827-283e-4558-92a1-c26d6ba5154a service placement] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:21:05.631539 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b815827-283e-4558-92a1-c26d6ba5154a service placement] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:21:05.719089 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687af02-eafe-44b7-ad19-5cfcce2b1d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:21:05.720874 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687af02-eafe-44b7-ad19-5cfcce2b1d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:21:05.721604 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687af02-eafe-44b7-ad19-5cfcce2b1d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:21:05.722525 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687af02-eafe-44b7-ad19-5cfcce2b1d39 admin admin] PATH_INFO: `/v3/projects/afc11aad09624b1a9cce76a9501960d2` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:21:05.724029 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a687af02-eafe-44b7-ad19-5cfcce2b1d39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afc11aad09624b1a9cce76a9501960d2)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:21:05.726320 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a687af02-eafe-44b7-ad19-5cfcce2b1d39 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:21:05.795937 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a687af02-eafe-44b7-ad19-5cfcce2b1d39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afc11aad09624b1a9cce76a9501960d2', 'request_id': 'req-a687af02-eafe-44b7-ad19-5cfcce2b1d39'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:05.802388 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a687af02-eafe-44b7-ad19-5cfcce2b1d39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afc11aad09624b1a9cce76a9501960d2', 'request_id': 'req-a687af02-eafe-44b7-ad19-5cfcce2b1d39'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:05.806008 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:21:05.815173 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a687af02-eafe-44b7-ad19-5cfcce2b1d39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afc11aad09624b1a9cce76a9501960d2', 'request_id': 'req-a687af02-eafe-44b7-ad19-5cfcce2b1d39'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:05.832766 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a687af02-eafe-44b7-ad19-5cfcce2b1d39 admin admin] The token cache is being invalidate because project afc11aad09624b1a9cce76a9501960d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:21:05.833193 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a687af02-eafe-44b7-ad19-5cfcce2b1d39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:05.835467 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-a687af02-eafe-44b7-ad19-5cfcce2b1d39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:05.838421 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1454/2916] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:21:05 2022] DELETE /identity/v3/projects/afc11aad09624b1a9cce76a9501960d2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:21:05.842925 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57259324-ff90-4abc-a94c-f7d75231e2ad admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:21:05.844514 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-57259324-ff90-4abc-a94c-f7d75231e2ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:21:05.858489 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57259324-ff90-4abc-a94c-f7d75231e2ad admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:21:05.918038 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:21:05.926074 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24c3d7-d4cc-4076-9910-063b8aa07fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:21:05.927413 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24c3d7-d4cc-4076-9910-063b8aa07fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:21:05.927940 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24c3d7-d4cc-4076-9910-063b8aa07fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:21:05.928289 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24c3d7-d4cc-4076-9910-063b8aa07fd5 admin admin] PATH_INFO: `/v3/users/8ff9389a3aee4188934db3e9f5259dec` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:21:05.930350 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24c3d7-d4cc-4076-9910-063b8aa07fd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff9389a3aee4188934db3e9f5259dec)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:21:05.932252 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24c3d7-d4cc-4076-9910-063b8aa07fd5 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:21:05.981032 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3f24c3d7-d4cc-4076-9910-063b8aa07fd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff9389a3aee4188934db3e9f5259dec'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:05.988710 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3f24c3d7-d4cc-4076-9910-063b8aa07fd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff9389a3aee4188934db3e9f5259dec'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:05.989323 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3f24c3d7-d4cc-4076-9910-063b8aa07fd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff9389a3aee4188934db3e9f5259dec'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:06.003279 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3f24c3d7-d4cc-4076-9910-063b8aa07fd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff9389a3aee4188934db3e9f5259dec'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:06.011656 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-3f24c3d7-d4cc-4076-9910-063b8aa07fd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff9389a3aee4188934db3e9f5259dec'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:06.018131 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1463/2917] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:21:05 2022] DELETE /identity/v3/users/8ff9389a3aee4188934db3e9f5259dec => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:21:06.208310 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687af02-eafe-44b7-ad19-5cfcce2b1d39 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:21:06.210438 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-a687af02-eafe-44b7-ad19-5cfcce2b1d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:21:06.227111 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687af02-eafe-44b7-ad19-5cfcce2b1d39 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:21:06.296205 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e18ca-4a42-40a3-8ebb-de7986ab0a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:21:06.297110 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e18ca-4a42-40a3-8ebb-de7986ab0a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:21:06.297399 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e18ca-4a42-40a3-8ebb-de7986ab0a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:21:06.297681 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e18ca-4a42-40a3-8ebb-de7986ab0a1f admin admin] PATH_INFO: `/v3/projects/d78cb4d39cf14b66a0d7d043eb8e26b2` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:21:06.299025 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e18ca-4a42-40a3-8ebb-de7986ab0a1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d78cb4d39cf14b66a0d7d043eb8e26b2)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:21:06.300994 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e18ca-4a42-40a3-8ebb-de7986ab0a1f admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:21:06.358213 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9a3e18ca-4a42-40a3-8ebb-de7986ab0a1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd78cb4d39cf14b66a0d7d043eb8e26b2', 'request_id': 'req-9a3e18ca-4a42-40a3-8ebb-de7986ab0a1f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:06.365122 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9a3e18ca-4a42-40a3-8ebb-de7986ab0a1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd78cb4d39cf14b66a0d7d043eb8e26b2', 'request_id': 'req-9a3e18ca-4a42-40a3-8ebb-de7986ab0a1f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:06.374431 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9a3e18ca-4a42-40a3-8ebb-de7986ab0a1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd78cb4d39cf14b66a0d7d043eb8e26b2', 'request_id': 'req-9a3e18ca-4a42-40a3-8ebb-de7986ab0a1f'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:06.385525 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9a3e18ca-4a42-40a3-8ebb-de7986ab0a1f admin admin] The token cache is being invalidate because project d78cb4d39cf14b66a0d7d043eb8e26b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:21:06.385814 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9a3e18ca-4a42-40a3-8ebb-de7986ab0a1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:06.386456 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-9a3e18ca-4a42-40a3-8ebb-de7986ab0a1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:06.388044 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1455/2918] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:21:06 2022] DELETE /identity/v3/projects/d78cb4d39cf14b66a0d7d043eb8e26b2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:21:10.620060 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c1591-7cdb-4b57-b1d9-ec3d0c7e3bf9 None None] REQUEST_METHOD: `POST` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:21:10.620551 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c1591-7cdb-4b57-b1d9-ec3d0c7e3bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:21:10.620659 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c1591-7cdb-4b57-b1d9-ec3d0c7e3bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:21:10.685959 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.auth.core [None req-744c1591-7cdb-4b57-b1d9-ec3d0c7e3bf9 None None] MFA Rules not processed for user `6d4c4b75552b4c739079f328a6efba40`. Rule list: `[]` (Enabled: `True`). {{(pid=80209) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 22:21:10.687216 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-744c1591-7cdb-4b57-b1d9-ec3d0c7e3bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:21:10.763214 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1464/2919] 10.222.0.35 () {58 vars in 967 bytes} [Thu May 19 22:21:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 22:21:10.804763 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e18ca-4a42-40a3-8ebb-de7986ab0a1f admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:21:10.806181 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-9a3e18ca-4a42-40a3-8ebb-de7986ab0a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:21:10.886644 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:21:10.903586 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e18ca-4a42-40a3-8ebb-de7986ab0a1f admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:21:10.908777 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46b0d9-9e4d-4242-9242-a5552346811e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a4208619f84f16b735871ee114e660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:21:10.909426 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46b0d9-9e4d-4242-9242-a5552346811e service swift] REQUEST_METHOD: `GET` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:21:10.909708 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46b0d9-9e4d-4242-9242-a5552346811e service swift] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:21:10.909983 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46b0d9-9e4d-4242-9242-a5552346811e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:21:10.918266 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46b0d9-9e4d-4242-9242-a5552346811e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:21:10.919856 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46b0d9-9e4d-4242-9242-a5552346811e service swift] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:21:10.927826 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1456/2920] 10.222.0.35 () {60 vars in 1384 bytes} [Thu May 19 22:21:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 22:21:17.499469 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c1591-7cdb-4b57-b1d9-ec3d0c7e3bf9 None None] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:21:17.500966 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-744c1591-7cdb-4b57-b1d9-ec3d0c7e3bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:21:17.546325 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:21:17.579812 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c1591-7cdb-4b57-b1d9-ec3d0c7e3bf9 None None] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:21:17.584475 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c9e7e-16e7-4ed1-b15c-1dc5e35bbfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:21:17.586426 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c9e7e-16e7-4ed1-b15c-1dc5e35bbfbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:21:17.586950 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c9e7e-16e7-4ed1-b15c-1dc5e35bbfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:21:17.587492 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c9e7e-16e7-4ed1-b15c-1dc5e35bbfbb admin admin] PATH_INFO: `/v3/users/760a19cb4201433da0aa2e23747fd415` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:21:17.588756 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c9e7e-16e7-4ed1-b15c-1dc5e35bbfbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=760a19cb4201433da0aa2e23747fd415)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:21:17.590750 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c9e7e-16e7-4ed1-b15c-1dc5e35bbfbb admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:21:17.643652 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c14c9e7e-16e7-4ed1-b15c-1dc5e35bbfbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '760a19cb4201433da0aa2e23747fd415'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:17.651200 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c14c9e7e-16e7-4ed1-b15c-1dc5e35bbfbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '760a19cb4201433da0aa2e23747fd415'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:17.651878 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c14c9e7e-16e7-4ed1-b15c-1dc5e35bbfbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '760a19cb4201433da0aa2e23747fd415'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:17.666379 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c14c9e7e-16e7-4ed1-b15c-1dc5e35bbfbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '760a19cb4201433da0aa2e23747fd415'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:17.674810 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-c14c9e7e-16e7-4ed1-b15c-1dc5e35bbfbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '760a19cb4201433da0aa2e23747fd415'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:17.681083 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1465/2921] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:21:17 2022] DELETE /identity/v3/users/760a19cb4201433da0aa2e23747fd415 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:21:17.857963 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46b0d9-9e4d-4242-9242-a5552346811e service swift] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:21:17.869298 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46b0d9-9e4d-4242-9242-a5552346811e service swift] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:21:17.934073 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07536265-67a8-401e-8ca6-9f1e481b5c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:21:17.934951 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07536265-67a8-401e-8ca6-9f1e481b5c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:21:17.935231 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07536265-67a8-401e-8ca6-9f1e481b5c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:21:17.935507 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07536265-67a8-401e-8ca6-9f1e481b5c22 admin admin] PATH_INFO: `/v3/projects/4246791f5ef147c89021cdc7dbfa24a9` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:21:17.936966 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07536265-67a8-401e-8ca6-9f1e481b5c22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4246791f5ef147c89021cdc7dbfa24a9)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:21:17.938732 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07536265-67a8-401e-8ca6-9f1e481b5c22 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:21:17.987633 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-07536265-67a8-401e-8ca6-9f1e481b5c22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4246791f5ef147c89021cdc7dbfa24a9', 'request_id': 'req-07536265-67a8-401e-8ca6-9f1e481b5c22'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:17.993733 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-07536265-67a8-401e-8ca6-9f1e481b5c22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4246791f5ef147c89021cdc7dbfa24a9', 'request_id': 'req-07536265-67a8-401e-8ca6-9f1e481b5c22'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:18.001514 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-07536265-67a8-401e-8ca6-9f1e481b5c22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4246791f5ef147c89021cdc7dbfa24a9', 'request_id': 'req-07536265-67a8-401e-8ca6-9f1e481b5c22'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:18.012697 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-07536265-67a8-401e-8ca6-9f1e481b5c22 admin admin] The token cache is being invalidate because project 4246791f5ef147c89021cdc7dbfa24a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:21:18.012987 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-07536265-67a8-401e-8ca6-9f1e481b5c22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:18.013628 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-07536265-67a8-401e-8ca6-9f1e481b5c22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:18.015188 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1457/2922] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:21:17 2022] DELETE /identity/v3/projects/4246791f5ef147c89021cdc7dbfa24a9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:21:18.019110 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c9e7e-16e7-4ed1-b15c-1dc5e35bbfbb admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:21:18.020603 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-c14c9e7e-16e7-4ed1-b15c-1dc5e35bbfbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:21:18.034851 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c9e7e-16e7-4ed1-b15c-1dc5e35bbfbb admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:21:18.091959 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7def8-0140-4ef7-85f0-40cd6f74f534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:21:18.092875 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7def8-0140-4ef7-85f0-40cd6f74f534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:21:18.093152 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7def8-0140-4ef7-85f0-40cd6f74f534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:21:18.093423 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7def8-0140-4ef7-85f0-40cd6f74f534 admin admin] PATH_INFO: `/v3/users/4ca697bf440c4c81a73db02199763642` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:21:18.094889 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7def8-0140-4ef7-85f0-40cd6f74f534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ca697bf440c4c81a73db02199763642)` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:21:18.096971 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7def8-0140-4ef7-85f0-40cd6f74f534 admin admin] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:21:18.146269 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-09c7def8-0140-4ef7-85f0-40cd6f74f534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ca697bf440c4c81a73db02199763642'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:18.152462 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:21:18.154854 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-09c7def8-0140-4ef7-85f0-40cd6f74f534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ca697bf440c4c81a73db02199763642'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:18.155730 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-09c7def8-0140-4ef7-85f0-40cd6f74f534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ca697bf440c4c81a73db02199763642'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:18.170061 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-09c7def8-0140-4ef7-85f0-40cd6f74f534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ca697bf440c4c81a73db02199763642'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:18.177438 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.notifications [None req-09c7def8-0140-4ef7-85f0-40cd6f74f534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ca697bf440c4c81a73db02199763642'} {{(pid=80209) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:18.185440 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1466/2923] 10.222.0.35 () {58 vars in 1223 bytes} [Thu May 19 22:21:18 2022] DELETE /identity/v3/users/4ca697bf440c4c81a73db02199763642 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:21:18.361899 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07536265-67a8-401e-8ca6-9f1e481b5c22 admin admin] Authenticating user token {{(pid=80210) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:21:18.363327 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.fernet_utils [None req-07536265-67a8-401e-8ca6-9f1e481b5c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80210) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:21:18.376910 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07536265-67a8-401e-8ca6-9f1e481b5c22 admin admin] Validating token access rules against request {{(pid=80210) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:21:18.440940 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac039ef6-0ec5-4745-90db-16bd0824c722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b8aa11a54f3466da61ca05643c14d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64ecee0211ba477d8f867eb1b5f77c2e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80210) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:21:18.441730 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac039ef6-0ec5-4745-90db-16bd0824c722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:21:18.442013 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac039ef6-0ec5-4745-90db-16bd0824c722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:21:18.442289 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac039ef6-0ec5-4745-90db-16bd0824c722 admin admin] PATH_INFO: `/v3/projects/e745876f79694e2b8fdb6f304a6ec602` {{(pid=80210) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:21:18.443601 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac039ef6-0ec5-4745-90db-16bd0824c722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e745876f79694e2b8fdb6f304a6ec602)` {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:21:18.446480 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac039ef6-0ec5-4745-90db-16bd0824c722 admin admin] RBAC: Authorization granted {{(pid=80210) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:21:18.462969 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:21:18.500850 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ac039ef6-0ec5-4745-90db-16bd0824c722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e745876f79694e2b8fdb6f304a6ec602', 'request_id': 'req-ac039ef6-0ec5-4745-90db-16bd0824c722'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:18.508267 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ac039ef6-0ec5-4745-90db-16bd0824c722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e745876f79694e2b8fdb6f304a6ec602', 'request_id': 'req-ac039ef6-0ec5-4745-90db-16bd0824c722'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:18.516448 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ac039ef6-0ec5-4745-90db-16bd0824c722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e745876f79694e2b8fdb6f304a6ec602', 'request_id': 'req-ac039ef6-0ec5-4745-90db-16bd0824c722'} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:18.528734 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ac039ef6-0ec5-4745-90db-16bd0824c722 admin admin] The token cache is being invalidate because project e745876f79694e2b8fdb6f304a6ec602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80210) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 22:21:18.529020 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ac039ef6-0ec5-4745-90db-16bd0824c722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:18.529657 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG keystone.notifications [None req-ac039ef6-0ec5-4745-90db-16bd0824c722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80210) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 22:21:18.531332 dv-cinder-842237-1-smb devstack@keystone.service[80210]: [pid: 80210|app: 0|req: 1458/2924] 10.222.0.35 () {58 vars in 1232 bytes} [Thu May 19 22:21:18 2022] DELETE /identity/v3/projects/e745876f79694e2b8fdb6f304a6ec602 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 22:21:28.181405 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=9,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:21:28.525722 dv-cinder-842237-1-smb devstack@keystone.service[80210]: DEBUG dbcounter [-] [80210] Writing DB stats keystone:SELECT=18,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 22:25:49.544449 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7def8-0140-4ef7-85f0-40cd6f74f534 admin admin] Authenticating user token {{(pid=80209) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 22:25:49.545860 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-09c7def8-0140-4ef7-85f0-40cd6f74f534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:25:49.618359 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7def8-0140-4ef7-85f0-40cd6f74f534 admin admin] Validating token access rules against request {{(pid=80209) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 22:25:49.685072 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516ace9-ded5-4fa6-bdf8-dab50301c981 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1004beeeaed4af4a92c89ad31008b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89b20e18525c473e94a2b263148f1f5f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80209) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 22:25:49.685862 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516ace9-ded5-4fa6-bdf8-dab50301c981 service placement] REQUEST_METHOD: `GET` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 22:25:49.686043 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516ace9-ded5-4fa6-bdf8-dab50301c981 service placement] SCRIPT_NAME: `/identity` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 22:25:49.686325 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516ace9-ded5-4fa6-bdf8-dab50301c981 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80209) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 22:25:49.688173 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.fernet_utils [None req-6516ace9-ded5-4fa6-bdf8-dab50301c981 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80209) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 22:25:49.701036 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516ace9-ded5-4fa6-bdf8-dab50301c981 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 22:25:49.702635 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516ace9-ded5-4fa6-bdf8-dab50301c981 service placement] RBAC: Authorization granted {{(pid=80209) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 22:25:49.712878 dv-cinder-842237-1-smb devstack@keystone.service[80209]: [pid: 80209|app: 0|req: 1467/2925] 10.222.0.35 () {60 vars in 1365 bytes} [Thu May 19 22:25:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 22:25:59.708533 dv-cinder-842237-1-smb devstack@keystone.service[80209]: DEBUG dbcounter [-] [80209] Writing DB stats keystone:SELECT=58 {{(pid=80209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}